2023-07-21T18:34:06.839 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T18:34:06.840 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871 --verbose --owner scheduled_rishabh@teuthology --name rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871/orig.config.yaml 2023-07-21T18:34:06.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:34:15.977 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871 branch: wip-rishabh-2023Jul13-m-quota description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7346871' kernel: flavor: default kdb: true sha1: c685da6f56cc77f2cfb9c4221be3960522616caf ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-2023Jul13-m-quota ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 81cf785aa7781c4e08381c540f890cb9bc987ef9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 81cf785aa7781c4e08381c540f890cb9bc987ef9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13-m-quota sha1: 81cf785aa7781c4e08381c540f890cb9bc987ef9 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 81cf785aa7781c4e08381c540f890cb9bc987ef9 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13-m-quota suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 81cf785aa7781c4e08381c540f890cb9bc987ef9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-21_17:58:19 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-21T18:34:15.978 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa; will attempt to use it 2023-07-21T18:34:15.979 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks 2023-07-21T18:34:15.979 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-21T18:34:15.981 INFO:teuthology.task.internal:Checking packages... 2023-07-21T18:34:16.015 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '81cf785aa7781c4e08381c540f890cb9bc987ef9' 2023-07-21T18:34:16.016 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-21T18:34:16.016 INFO:teuthology.packaging:ref: None 2023-07-21T18:34:16.016 INFO:teuthology.packaging:tag: None 2023-07-21T18:34:16.017 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13-m-quota 2023-07-21T18:34:16.017 INFO:teuthology.packaging:sha1: 81cf785aa7781c4e08381c540f890cb9bc987ef9 2023-07-21T18:34:16.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-2023Jul13-m-quota 2023-07-21T18:34:21.367 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4746-g81cf785a-1focal 2023-07-21T18:34:21.367 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-21T18:34:21.374 INFO:teuthology.task.internal:no buildpackages task found 2023-07-21T18:34:21.375 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-21T18:34:21.382 INFO:teuthology.task.internal:Saving configuration 2023-07-21T18:34:21.398 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-21T18:34:21.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:34:26.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:26:56.825484', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-21T18:34:31.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:26:56.827509', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-21T18:34:31.470 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-21T18:34:31.478 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-21T18:34:31.479 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-21T18:34:31.479 INFO:teuthology.run_tasks:Running task console_log... 2023-07-21T18:34:41.581 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe101d464c0>, signals=[15]) 2023-07-21T18:34:41.584 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-21T18:34:41.592 INFO:teuthology.task.internal:Opening connections... 2023-07-21T18:34:41.593 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T18:34:41.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:34:41.651 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T18:34:41.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:34:41.703 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-21T18:34:41.710 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-07-21T18:34:41.810 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-07-21T18:34:41.811 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-21T18:34:41.816 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T18:34:41.817 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T18:34:41.818 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T18:34:41.818 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T18:34:41.818 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2023-07-21T18:34:41.818 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2023-07-21T18:34:41.819 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-21T18:34:46.853 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-07-21T18:34:46.860 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-07-21T18:34:46.861 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-21T18:34:46.908 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2023-07-21T18:34:46.909 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T18:34:46.909 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2023-07-21T18:34:46.909 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2023-07-21T18:34:46.909 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T18:34:46.909 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="20.04" 2023-07-21T18:34:46.910 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T18:34:46.910 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T18:34:46.910 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T18:34:46.910 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T18:34:46.910 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=focal 2023-07-21T18:34:46.910 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=focal 2023-07-21T18:34:46.911 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-21T18:34:51.935 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-21T18:34:51.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-21T18:34:51.963 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-21T18:34:51.964 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2023-07-21T18:34:51.967 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2023-07-21T18:34:51.972 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-21T18:34:51.979 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-21T18:34:51.980 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2023-07-21T18:34:51.983 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2023-07-21T18:34:51.999 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-21T18:34:59.774 INFO:teuthology.run_tasks:Running task kernel... 2023-07-21T18:34:59.794 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'} 2023-07-21T18:34:59.795 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, timeout 300 2023-07-21T18:34:59.796 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T18:34:59.797 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T18:34:59.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T18:34:59.803 DEBUG:teuthology.task.kernel:sha1 for mon.a is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:34:59.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T18:34:59.803 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-07-21T18:34:59.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T18:34:59.805 DEBUG:teuthology.task.kernel:sha1 for mon.b is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:34:59.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T18:34:59.805 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2023-07-21T18:34:59.813 INFO:teuthology.orchestra.run.smithi145.stdout:5.4.0-124-generic 2023-07-21T18:34:59.813 INFO:teuthology.orchestra.run.smithi123.stdout:5.4.0-124-generic 2023-07-21T18:34:59.814 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:34:59.815 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T18:34:59.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:34:59.817 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:34:59.818 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T18:34:59.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:35:10.193 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-07-21T18:35:10.193 DEBUG:teuthology.orchestra.run.smithi145:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-21T18:35:10.213 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-07-21T18:35:10.295 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-07-21T18:35:10.296 DEBUG:teuthology.orchestra.run.smithi123:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-21T18:35:10.316 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-07-21T18:35:10.322 INFO:teuthology.orchestra.run.smithi145.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-21T18:35:10.324 DEBUG:teuthology.orchestra.run.smithi145:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-21T18:35:10.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-21T18:35:10.377 DEBUG:teuthology.orchestra.run.smithi145:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-21T18:35:10.434 INFO:teuthology.orchestra.run.smithi123.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-21T18:35:10.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-21T18:35:10.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-21T18:35:10.524 DEBUG:teuthology.orchestra.run.smithi123:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-21T18:47:37.597 INFO:teuthology.orchestra.run.smithi123.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-21T18:47:37.598 INFO:teuthology.orchestra.run.smithi123.stderr: * [new branch] main -> origin/main 2023-07-21T18:47:37.648 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190312 -> 20190312 2023-07-21T18:47:37.648 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190416 -> 20190416 2023-07-21T18:47:37.648 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190514 -> 20190514 2023-07-21T18:47:37.648 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190618 -> 20190618 2023-07-21T18:47:37.649 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190717 -> 20190717 2023-07-21T18:47:37.649 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190815 -> 20190815 2023-07-21T18:47:37.650 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190923 -> 20190923 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20191022 -> 20191022 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20191215 -> 20191215 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200122 -> 20200122 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200316 -> 20200316 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200421 -> 20200421 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200519 -> 20200519 2023-07-21T18:47:37.651 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200619 -> 20200619 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200721 -> 20200721 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200817 -> 20200817 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200918 -> 20200918 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20201022 -> 20201022 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20201118 -> 20201118 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20201218 -> 20201218 2023-07-21T18:47:37.652 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210208 -> 20210208 2023-07-21T18:47:37.653 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210315 -> 20210315 2023-07-21T18:47:37.653 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210511 -> 20210511 2023-07-21T18:47:37.653 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210716 -> 20210716 2023-07-21T18:47:37.653 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210818 -> 20210818 2023-07-21T18:47:37.654 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210919 -> 20210919 2023-07-21T18:47:37.655 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20211027 -> 20211027 2023-07-21T18:47:37.655 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20211216 -> 20211216 2023-07-21T18:47:37.655 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220209 -> 20220209 2023-07-21T18:47:37.655 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220310 -> 20220310 2023-07-21T18:47:37.655 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220411 -> 20220411 2023-07-21T18:47:37.655 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220509 -> 20220509 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220610 -> 20220610 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220708 -> 20220708 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220815 -> 20220815 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220913 -> 20220913 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20221012 -> 20221012 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20221109 -> 20221109 2023-07-21T18:47:37.656 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20221214 -> 20221214 2023-07-21T18:47:37.657 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230117 -> 20230117 2023-07-21T18:47:37.657 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230210 -> 20230210 2023-07-21T18:47:37.657 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230310 -> 20230310 2023-07-21T18:47:37.657 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230404 -> 20230404 2023-07-21T18:47:37.657 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230515 -> 20230515 2023-07-21T18:47:37.657 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230625 -> 20230625 2023-07-21T18:47:40.857 INFO:teuthology.orchestra.run.smithi123.stderr:Updating files: 51% (1522/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1957/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2461/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-21T18:47:40.861 INFO:teuthology.orchestra.run.smithi123.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-21T18:47:40.876 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-21T18:47:40.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:47:41.191 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T18:47:41.192 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-21T18:47:41.194 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi123.front.sepia.ceph.com to complete... 2023-07-21T18:48:03.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21 18:48:03 URL:https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851044/38851044] -> "/tmp/linux-image.deb" [1] 2023-07-21T18:48:03.599 INFO:teuthology.orchestra.run.smithi123.stderr:FINISHED --2023-07-21 18:48:03-- 2023-07-21T18:48:03.600 INFO:teuthology.orchestra.run.smithi123.stderr:Total wall clock time: 22s 2023-07-21T18:48:03.600 INFO:teuthology.orchestra.run.smithi123.stderr:Downloaded: 1 files, 37M in 22s (1.68 MB/s) 2023-07-21T18:48:03.601 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-21T18:48:03.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo dpkg -i /tmp/linux-image.deb 2023-07-21T18:48:03.911 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-21T18:48:05.698 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-07-21T18:48:05.702 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-21T18:48:05.900 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T18:48:08.986 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T18:48:09.105 INFO:teuthology.orchestra.run.smithi123.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2023-07-21T18:48:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T18:48:29.078 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2023-07-21T18:48:29.422 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:29.858 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T18:48:29.871 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T18:48:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:done 2023-07-21T18:48:32.729 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-deb -c /tmp/linux-image.deb 2023-07-21T18:48:32.738 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./ 2023-07-21T18:48:32.738 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./boot/ 2023-07-21T18:48:32.738 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 4380308 2023-07-20 12:16 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:32.751 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 168433 2023-07-20 12:16 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:32.751 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11280224 2023-07-20 12:16 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:32.773 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/ 2023-07-21T18:48:32.773 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/ 2023-07-21T18:48:32.773 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postinst.d/ 2023-07-21T18:48:32.773 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postrm.d/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/preinst.d/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/prerm.d/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-21T18:48:32.774 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-21T18:48:32.775 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-21T18:48:32.775 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-21T18:48:32.775 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 490385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-21T18:48:32.777 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T18:48:32.777 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T18:48:32.777 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T18:48:32.777 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 93113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T18:48:32.777 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 106729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 152241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T18:48:32.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T18:48:32.779 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-21T18:48:32.780 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 348417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T18:48:32.781 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 972641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T18:48:32.781 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2273145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T18:48:32.788 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-21T18:48:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-21T18:48:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-21T18:48:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-21T18:48:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T18:48:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T18:48:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T18:48:32.790 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T18:48:32.791 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-21T18:48:32.792 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T18:48:32.793 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T18:48:32.794 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 149193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T18:48:32.795 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T18:48:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T18:48:32.797 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 88625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-21T18:48:32.798 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T18:48:32.799 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T18:48:32.800 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T18:48:32.801 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T18:48:32.802 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T18:48:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T18:48:32.804 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T18:48:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T18:48:32.806 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-21T18:48:32.807 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-21T18:48:32.807 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 113705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T18:48:32.807 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-21T18:48:32.807 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 968433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T18:48:32.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 173201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T18:48:32.843 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-21T18:48:32.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 94297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 110361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 98225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 257529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-21T18:48:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 98129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-21T18:48:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 150665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T18:48:32.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 139057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T18:48:32.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-21T18:48:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-21T18:48:32.849 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T18:48:32.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T18:48:32.851 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-21T18:48:32.851 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-21T18:48:32.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T18:48:32.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 234473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T18:48:32.851 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 408489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T18:48:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-21T18:48:32.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 122641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T18:48:32.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T18:48:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-21T18:48:32.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-21T18:48:32.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-21T18:48:32.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-21T18:48:32.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-21T18:48:32.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-21T18:48:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T18:48:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-21T18:48:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-21T18:48:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-21T18:48:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-21T18:48:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-21T18:48:32.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T18:48:32.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T18:48:32.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T18:48:32.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-21T18:48:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T18:48:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T18:48:32.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T18:48:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T18:48:32.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 143585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 267713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-21T18:48:32.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 125721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 217401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 301449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T18:48:32.873 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T18:48:32.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T18:48:32.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T18:48:32.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 99601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T18:48:32.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 94457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T18:48:32.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 129217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T18:48:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T18:48:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T18:48:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T18:48:32.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T18:48:32.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 116737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T18:48:32.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 82337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T18:48:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T18:48:32.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T18:48:32.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T18:48:32.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T18:48:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T18:48:32.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T18:48:32.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 6929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T18:48:32.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T18:48:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T18:48:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-21T18:48:32.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 273641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 876913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 324145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T18:48:32.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 279321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 492561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-21T18:48:32.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 419217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 739705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 296649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 153681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-21T18:48:32.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 169017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 263177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-21T18:48:32.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 111993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 129081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 129553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-21T18:48:32.903 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T18:48:32.904 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-21T18:48:32.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-21T18:48:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-21T18:48:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-21T18:48:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-21T18:48:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-21T18:48:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-21T18:48:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-21T18:48:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T18:48:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 123681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 335849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T18:48:32.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 109849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-21T18:48:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T18:48:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T18:48:32.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-21T18:48:32.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-21T18:48:32.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T18:48:32.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T18:48:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T18:48:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T18:48:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T18:48:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T18:48:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T18:48:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 655473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 155993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T18:48:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 107049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T18:48:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 109593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T18:48:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 181585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-21T18:48:32.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 199937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 112609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 160553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 396153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 178113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T18:48:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 123305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 79017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-21T18:48:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 123721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-21T18:48:32.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-21T18:48:32.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-21T18:48:32.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T18:48:32.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T18:48:32.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-21T18:48:32.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T18:48:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 152137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-21T18:48:32.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T18:48:32.931 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 125209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 309857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T18:48:32.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 183857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-21T18:48:32.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 487801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T18:48:32.994 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-21T18:48:32.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-21T18:48:32.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 106009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T18:48:32.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T18:48:32.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T18:48:32.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 452481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T18:48:32.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 130489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 99113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T18:48:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T18:48:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T18:48:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 104585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-21T18:48:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 176881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1422209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 128377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 132289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T18:48:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 312145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 323601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 193433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-21T18:48:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 347641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1044145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 166113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T18:48:33.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 204329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T18:48:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 141161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T18:48:33.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 281329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-21T18:48:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 295713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 584249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-21T18:48:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 246321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 923969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 298097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 514889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T18:48:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 93593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 734297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 151841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 86921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-21T18:48:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 122681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 727433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 280513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-21T18:48:33.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1095817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 95665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T18:48:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-21T18:48:33.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 150905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 136785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-21T18:48:33.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 227113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 671393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T18:48:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 190089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 104241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-21T18:48:33.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 952881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T18:48:33.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T18:48:33.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 481681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 166121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-21T18:48:33.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 86465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-21T18:48:33.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-21T18:48:33.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 216977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 235593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-21T18:48:33.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-21T18:48:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T18:48:33.023 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T18:48:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T18:48:33.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-21T18:48:33.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T18:48:33.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-21T18:48:33.028 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-21T18:48:33.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T18:48:33.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T18:48:33.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T18:48:33.028 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-21T18:48:33.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 105961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 88193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T18:48:33.029 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 120497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 290665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 143801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-21T18:48:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 266561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 133817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T18:48:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-21T18:48:33.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 145785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T18:48:33.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 112913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-21T18:48:33.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-21T18:48:33.035 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T18:48:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 106873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T18:48:33.037 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T18:48:33.038 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T18:48:33.039 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-21T18:48:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-21T18:48:33.041 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-21T18:48:33.042 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-21T18:48:33.043 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T18:48:33.044 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T18:48:33.045 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T18:48:33.046 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T18:48:33.047 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-21T18:48:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-21T18:48:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-21T18:48:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-21T18:48:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T18:48:33.052 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 135169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 272353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 356265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T18:48:33.053 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 295801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 189321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 106569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-21T18:48:33.054 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 246897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1172185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 237169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T18:48:33.055 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 308889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 76193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T18:48:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 146785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 212401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T18:48:33.057 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 158193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 261913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 201793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T18:48:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 266521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 317249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T18:48:33.059 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 314961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 145569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 217209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2192449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T18:48:33.060 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 310729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 659577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T18:48:33.061 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-21T18:48:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 364257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 123489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1860025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T18:48:33.063 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 558865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 238801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 173921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 278865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T18:48:33.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 162121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T18:48:33.065 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 129417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-21T18:48:33.066 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 739089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 931721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T18:48:33.067 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 122545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T18:48:33.068 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T18:48:33.069 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-21T18:48:33.070 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 107545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-21T18:48:33.071 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-21T18:48:33.072 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 536617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T18:48:33.073 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-21T18:48:33.074 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-21T18:48:33.075 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 143785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T18:48:33.076 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-21T18:48:33.077 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 445801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-21T18:48:33.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 92377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 122073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-21T18:48:33.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-21T18:48:33.080 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-21T18:48:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-21T18:48:33.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 161233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 157665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-21T18:48:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 76033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-21T18:48:33.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 156033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-21T18:48:33.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-21T18:48:33.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T18:48:33.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-21T18:48:33.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T18:48:33.089 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 301521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-21T18:48:33.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T18:48:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 175145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 137105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T18:48:33.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 107417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T18:48:33.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T18:48:33.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 189729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T18:48:33.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T18:48:33.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 125505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-21T18:48:33.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T18:48:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 180017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-21T18:48:33.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 105401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 153697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T18:48:33.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 113889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 86521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-21T18:48:33.101 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-21T18:48:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-21T18:48:33.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-21T18:48:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T18:48:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T18:48:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T18:48:33.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T18:48:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-21T18:48:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-21T18:48:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-21T18:48:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-21T18:48:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-21T18:48:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T18:48:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-21T18:48:33.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-21T18:48:33.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-21T18:48:33.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-21T18:48:33.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 176417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T18:48:33.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 165697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-21T18:48:33.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 162617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 931937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-21T18:48:33.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 3468681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 305745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T18:48:33.117 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1312545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T18:48:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 633825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1500513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T18:48:33.119 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 226505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-21T18:48:33.120 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1226249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 141241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 221553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 193577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-21T18:48:33.121 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 420745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 279041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-21T18:48:33.122 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 117705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T18:48:33.123 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1053889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2041809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T18:48:33.124 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1504993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 591417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T18:48:33.125 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T18:48:33.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T18:48:33.127 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T18:48:33.128 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 94137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 142673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 165745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 118121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T18:48:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T18:48:33.130 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T18:48:33.131 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-21T18:48:33.132 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 219073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-21T18:48:33.132 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-21T18:48:33.132 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-21T18:48:33.132 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 244177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T18:48:33.132 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-21T18:48:33.132 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 440785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T18:48:33.163 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-21T18:48:33.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T18:48:33.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2589569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T18:48:33.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T18:48:33.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T18:48:33.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 336473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-21T18:48:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-21T18:48:33.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 530697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2658777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-21T18:48:33.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 134313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-21T18:48:33.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 248049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 160857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 3998129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-21T18:48:33.169 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 6833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 6529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T18:48:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T18:48:33.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 6617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-21T18:48:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 143433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 4760825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-21T18:48:33.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 6369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-21T18:48:33.174 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T18:48:33.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 6985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T18:48:33.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 198417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T18:48:33.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 652553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 772505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T18:48:33.178 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T18:48:33.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T18:48:33.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T18:48:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1046417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 194321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T18:48:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 390297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T18:48:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 254601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T18:48:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T18:48:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T18:48:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T18:48:33.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T18:48:33.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T18:48:33.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T18:48:33.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T18:48:33.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 92817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T18:48:33.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T18:48:33.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T18:48:33.194 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T18:48:33.195 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T18:48:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 82929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 125873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T18:48:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-21T18:48:33.198 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 267017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 291041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-21T18:48:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 104593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 105129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T18:48:33.200 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 114393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 111161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 114673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 114329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 113217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 116217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T18:48:33.201 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 412481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T18:48:33.202 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T18:48:33.203 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 408689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 118145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T18:48:33.204 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T18:48:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 88513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 95353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T18:48:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 592185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T18:48:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T18:48:33.208 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T18:48:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T18:48:33.210 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T18:48:33.211 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T18:48:33.212 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T18:48:33.213 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T18:48:33.214 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T18:48:33.215 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T18:48:33.216 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T18:48:33.217 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T18:48:33.218 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T18:48:33.219 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T18:48:33.220 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 379545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-21T18:48:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 109961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 252825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 165081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 820137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-21T18:48:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T18:48:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T18:48:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T18:48:33.225 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T18:48:33.226 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T18:48:33.227 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T18:48:33.228 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 930369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 335569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T18:48:33.229 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1514649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 707401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 862233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-21T18:48:33.230 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 95985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-21T18:48:33.231 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 125097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-21T18:48:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 638200 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 623896 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7656 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9821 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69903 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 146449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 232695 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 210 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72754 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 879 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 252883 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 307884 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/ 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/ 2023-07-21T18:48:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/ 2023-07-21T18:48:33.235 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T18:48:33.235 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 173 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-21T18:48:33.235 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 691 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-21T18:48:33.236 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:33.237 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:33.237 DEBUG:teuthology.orchestra.run.smithi123:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-21T18:48:33.245 INFO:teuthology.orchestra.run.smithi123.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T18:48:33.246 INFO:teuthology.orchestra.run.smithi123.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T18:48:33.246 INFO:teuthology.orchestra.run.smithi123.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T18:48:33.246 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-21T18:48:33.247 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:33.247 DEBUG:teuthology.orchestra.run.smithi123:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-21T18:48:33.249 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi123.front.sepia.ceph.com to complete... 2023-07-21T18:48:33.889 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2023-07-21T18:48:33.900 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T18:48:33.918 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2023-07-21T18:48:34.220 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:34.232 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:48:34.635 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T18:48:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T18:48:36.286 INFO:teuthology.orchestra.run.smithi123.stderr:done 2023-07-21T18:49:07.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-21T18:49:07.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:49:07.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:49:25.872 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T18:49:33.524 INFO:teuthology.orchestra.run.smithi145.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-21T18:49:33.524 INFO:teuthology.orchestra.run.smithi145.stderr: * [new branch] main -> origin/main 2023-07-21T18:49:33.577 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190312 -> 20190312 2023-07-21T18:49:33.577 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190416 -> 20190416 2023-07-21T18:49:33.578 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190514 -> 20190514 2023-07-21T18:49:33.578 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190618 -> 20190618 2023-07-21T18:49:33.578 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190717 -> 20190717 2023-07-21T18:49:33.579 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190815 -> 20190815 2023-07-21T18:49:33.579 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20190923 -> 20190923 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20191022 -> 20191022 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20191215 -> 20191215 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200122 -> 20200122 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200316 -> 20200316 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200421 -> 20200421 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200519 -> 20200519 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200619 -> 20200619 2023-07-21T18:49:33.580 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200721 -> 20200721 2023-07-21T18:49:33.581 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200817 -> 20200817 2023-07-21T18:49:33.581 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20200918 -> 20200918 2023-07-21T18:49:33.581 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20201022 -> 20201022 2023-07-21T18:49:33.581 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20201118 -> 20201118 2023-07-21T18:49:33.581 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20201218 -> 20201218 2023-07-21T18:49:33.581 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20210208 -> 20210208 2023-07-21T18:49:33.583 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20210315 -> 20210315 2023-07-21T18:49:33.583 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20210511 -> 20210511 2023-07-21T18:49:33.583 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20210716 -> 20210716 2023-07-21T18:49:33.583 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20210818 -> 20210818 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20210919 -> 20210919 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20211027 -> 20211027 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20211216 -> 20211216 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220209 -> 20220209 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220310 -> 20220310 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220411 -> 20220411 2023-07-21T18:49:33.584 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220509 -> 20220509 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220610 -> 20220610 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220708 -> 20220708 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220815 -> 20220815 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20220913 -> 20220913 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20221012 -> 20221012 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20221109 -> 20221109 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20221214 -> 20221214 2023-07-21T18:49:33.585 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20230117 -> 20230117 2023-07-21T18:49:33.586 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20230210 -> 20230210 2023-07-21T18:49:33.586 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20230310 -> 20230310 2023-07-21T18:49:33.586 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20230404 -> 20230404 2023-07-21T18:49:33.586 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20230515 -> 20230515 2023-07-21T18:49:33.586 INFO:teuthology.orchestra.run.smithi145.stderr: * [new tag] 20230625 -> 20230625 2023-07-21T18:49:34.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:49:34.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:49:36.789 INFO:teuthology.orchestra.run.smithi145.stderr:Updating files: 51% (1521/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1957/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2458/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-21T18:49:36.793 INFO:teuthology.orchestra.run.smithi145.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-21T18:49:36.808 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-21T18:49:36.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T18:49:37.069 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T18:49:37.070 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-21T18:49:37.072 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi145.front.sepia.ceph.com to complete... 2023-07-21T18:49:37.936 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T18:49:46.475 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21 18:49:46 URL:https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851044/38851044] -> "/tmp/linux-image.deb" [1] 2023-07-21T18:49:46.476 INFO:teuthology.orchestra.run.smithi145.stderr:FINISHED --2023-07-21 18:49:46-- 2023-07-21T18:49:46.476 INFO:teuthology.orchestra.run.smithi145.stderr:Total wall clock time: 9.4s 2023-07-21T18:49:46.476 INFO:teuthology.orchestra.run.smithi145.stderr:Downloaded: 1 files, 37M in 9.1s (4.07 MB/s) 2023-07-21T18:49:46.477 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-21T18:49:46.478 DEBUG:teuthology.orchestra.run.smithi145:> sudo dpkg -i /tmp/linux-image.deb 2023-07-21T18:49:46.833 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-21T18:49:48.533 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-07-21T18:49:48.538 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-21T18:49:48.753 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T18:49:49.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:49:49.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:49:51.951 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T18:49:52.071 INFO:teuthology.orchestra.run.smithi145.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:08.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T18:50:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub' 2023-07-21T18:50:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T18:50:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2023-07-21T18:50:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:15.710 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T18:50:15.723 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T18:50:18.462 INFO:teuthology.orchestra.run.smithi145.stderr:done 2023-07-21T18:50:18.654 DEBUG:teuthology.orchestra.run.smithi145:> dpkg-deb -c /tmp/linux-image.deb 2023-07-21T18:50:18.663 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./ 2023-07-21T18:50:18.663 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./boot/ 2023-07-21T18:50:18.664 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 4380308 2023-07-20 12:16 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:18.677 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 168433 2023-07-20 12:16 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:18.678 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11280224 2023-07-20 12:16 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:18.700 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/ 2023-07-21T18:50:18.700 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/ 2023-07-21T18:50:18.700 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postinst.d/ 2023-07-21T18:50:18.700 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postrm.d/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/preinst.d/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/prerm.d/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-21T18:50:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-21T18:50:18.702 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-21T18:50:18.702 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-21T18:50:18.702 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 490385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-21T18:50:18.704 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T18:50:18.704 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T18:50:18.704 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T18:50:18.704 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 93113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 106729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 152241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 83889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T18:50:18.705 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 58585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T18:50:18.706 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-21T18:50:18.707 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 348417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T18:50:18.708 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 972641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T18:50:18.708 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 2273145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T18:50:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-21T18:50:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-21T18:50:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-21T18:50:18.718 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T18:50:18.719 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T18:50:18.720 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T18:50:18.721 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-21T18:50:18.722 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T18:50:18.723 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 149193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T18:50:18.724 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-21T18:50:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T18:50:18.726 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 88625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 87841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T18:50:18.727 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T18:50:18.728 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T18:50:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T18:50:18.730 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T18:50:18.731 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T18:50:18.732 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 83225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 70537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T18:50:18.733 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T18:50:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 124457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 113705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-21T18:50:18.735 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 968433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T18:50:18.774 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 173201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 94297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 115345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 110361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 98225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T18:50:18.775 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 257529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 98129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-21T18:50:18.776 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-21T18:50:18.777 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 150665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 139057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 70833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T18:50:18.778 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 84121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-21T18:50:18.779 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-21T18:50:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-21T18:50:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 70785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 234473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-21T18:50:18.782 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 408489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T18:50:18.783 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 68937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-21T18:50:18.784 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 122641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 80273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 63617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T18:50:18.785 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 56809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T18:50:18.786 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-21T18:50:18.787 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-21T18:50:18.788 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 77849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T18:50:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-21T18:50:18.790 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T18:50:18.791 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-21T18:50:18.792 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-21T18:50:18.793 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T18:50:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-21T18:50:18.795 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T18:50:18.796 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 80993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T18:50:18.797 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 72937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T18:50:18.798 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T18:50:18.799 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T18:50:18.800 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T18:50:18.801 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 71457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 143585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T18:50:18.802 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 267713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 125721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 217401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-21T18:50:18.803 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 63497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 89609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 301449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T18:50:18.804 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 97977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T18:50:18.805 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 74433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T18:50:18.806 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 58617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-21T18:50:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 99601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T18:50:18.808 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 94457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T18:50:18.809 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T18:50:18.810 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 129217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T18:50:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 72833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T18:50:18.812 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 108841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T18:50:18.813 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T18:50:18.814 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-21T18:50:18.815 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 116737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 82337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-21T18:50:18.816 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 81841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T18:50:18.817 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T18:50:18.818 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T18:50:18.819 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T18:50:18.820 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 63289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 101457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T18:50:18.821 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 119505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-21T18:50:18.822 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T18:50:18.823 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 6929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T18:50:18.824 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 62729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T18:50:18.825 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T18:50:18.826 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T18:50:18.827 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-21T18:50:18.828 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 273641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 876913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 69321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 324145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 97961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T18:50:18.829 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 279321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 492561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 419217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-21T18:50:18.830 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 739705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 296649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 153681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 169017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-21T18:50:18.831 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 263177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 111993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-21T18:50:18.832 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 129081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 129553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T18:50:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-21T18:50:18.834 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-21T18:50:18.835 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-21T18:50:18.836 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-21T18:50:18.837 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 123681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 89449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 335849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T18:50:18.838 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 109849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T18:50:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-21T18:50:18.840 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-21T18:50:18.841 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-21T18:50:18.842 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-21T18:50:18.843 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T18:50:18.844 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-21T18:50:18.845 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 655473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 89601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 155993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 107049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-21T18:50:18.846 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 70769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-21T18:50:18.847 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 109593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 181585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-21T18:50:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 199937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 112609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 160553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T18:50:18.849 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 396153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 178113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 63385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 123305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T18:50:18.850 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 79017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-21T18:50:18.851 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 123721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-21T18:50:18.852 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-21T18:50:18.853 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 80425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-21T18:50:18.854 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-21T18:50:18.855 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-21T18:50:18.856 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-21T18:50:18.857 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 152137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-21T18:50:18.858 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 72601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-21T18:50:18.859 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 125209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 56521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 309857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-21T18:50:18.860 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 74905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 183857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T18:50:18.861 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-21T18:50:18.862 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-21T18:50:18.862 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 487801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T18:50:18.918 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-21T18:50:18.918 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-21T18:50:18.918 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 106009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T18:50:18.918 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 452481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-21T18:50:18.919 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 130489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 68785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T18:50:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 99113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 69145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-21T18:50:18.921 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 87345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-21T18:50:18.922 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 97321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 104585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 90257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 81505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T18:50:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 69713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 176881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1422209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 128377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T18:50:18.924 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 132289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 312145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 323601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-21T18:50:18.925 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 193433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 347641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1044145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 166113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-21T18:50:18.926 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 204329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 69449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T18:50:18.927 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 141161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 62865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T18:50:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 62833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 281329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T18:50:18.929 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 90465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 295713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 584249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T18:50:18.930 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 246321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 923969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 298097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-21T18:50:18.931 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 514889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 93593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 734297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 151841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 86921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T18:50:18.932 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 102385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 122681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 727433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 280513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T18:50:18.933 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1095817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-21T18:50:18.934 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 95665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 108809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-21T18:50:18.935 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 150905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 136785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-21T18:50:18.936 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 227113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 87081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 671393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-21T18:50:18.937 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 83921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 190089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 104241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-21T18:50:18.938 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 952881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 63273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T18:50:18.939 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 68209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T18:50:18.940 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 481681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 103321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 166121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-21T18:50:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 86465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 80257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 83681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T18:50:18.942 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 216977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-21T18:50:18.943 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 77401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 235593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 83737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T18:50:18.944 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 62065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T18:50:18.945 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-21T18:50:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T18:50:18.947 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 75713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 97265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T18:50:18.948 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T18:50:18.949 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-21T18:50:18.950 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 64889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 105961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T18:50:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 88193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 120497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-21T18:50:18.952 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 290665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 143801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 266561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T18:50:18.953 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 101937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 133817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 84337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-21T18:50:18.954 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 145785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-21T18:50:18.955 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 62081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 112913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-21T18:50:18.956 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 71521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-21T18:50:18.957 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T18:50:18.958 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 106873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T18:50:18.959 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-21T18:50:18.960 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T18:50:18.961 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-21T18:50:18.962 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-21T18:50:18.963 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-21T18:50:18.964 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-21T18:50:18.965 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T18:50:18.966 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-21T18:50:18.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 68577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T18:50:18.968 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T18:50:18.969 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T18:50:18.970 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T18:50:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T18:50:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T18:50:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 77617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T18:50:18.974 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 135169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 272353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 356265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T18:50:18.975 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 295801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 189321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 106569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T18:50:18.976 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 246897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1172185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 237169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 115393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T18:50:18.977 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 308889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 76193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 101449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T18:50:18.978 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 146785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 75529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 212401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T18:50:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 158193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 261913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 201793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T18:50:18.980 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 266521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 101881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 317249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T18:50:18.981 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 314961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 145569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 217209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 2192449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T18:50:18.982 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 310729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 84697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 659577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-21T18:50:18.983 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 119929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 81601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-21T18:50:18.984 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 364257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 123489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1860025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 85313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T18:50:18.985 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 558865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 238801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 173921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 278865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 97705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T18:50:18.986 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 115849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 162121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T18:50:18.987 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 129417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-21T18:50:18.988 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 739089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 931721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 122545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T18:50:18.989 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 75641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T18:50:18.990 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T18:50:18.991 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-21T18:50:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 50793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 107545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 68137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-21T18:50:18.993 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 72193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 103017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T18:50:18.994 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 536617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-21T18:50:18.995 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-21T18:50:18.996 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-21T18:50:18.997 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 143785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 85457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T18:50:18.998 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 89833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-21T18:50:18.999 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 445801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-21T18:50:19.000 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 92377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 122073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-21T18:50:19.001 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 85841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 58433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-21T18:50:19.002 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-21T18:50:19.003 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 62153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 161233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-21T18:50:19.004 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 157665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 69689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 56009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-21T18:50:19.005 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 76033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 75057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 81489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 156033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-21T18:50:19.006 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 80097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 87337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-21T18:50:19.007 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-21T18:50:19.008 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T18:50:19.009 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 64841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T18:50:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 70873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-21T18:50:19.011 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 301521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T18:50:19.012 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 70209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T18:50:19.013 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 175145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 137105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 124673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T18:50:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 107417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-21T18:50:19.015 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 78113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 56593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 189729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T18:50:19.016 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 51297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T18:50:19.017 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 125505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T18:50:19.018 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T18:50:19.019 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T18:50:19.020 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 180017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 105401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T18:50:19.021 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 153697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 75137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 113889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T18:50:19.022 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 58137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 86521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-21T18:50:19.023 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-21T18:50:19.024 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-21T18:50:19.025 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-21T18:50:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T18:50:19.027 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 56425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 102657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-21T18:50:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-21T18:50:19.029 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-21T18:50:19.030 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-21T18:50:19.030 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T18:50:19.030 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T18:50:19.030 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T18:50:19.030 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T18:50:19.030 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T18:50:19.031 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-21T18:50:19.032 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T18:50:19.033 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T18:50:19.034 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-21T18:50:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 176417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-21T18:50:19.036 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 165697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 162617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 931937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-21T18:50:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 64481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 3468681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T18:50:19.038 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 305745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1312545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 108073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-21T18:50:19.039 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 633825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-21T18:50:19.040 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1500513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 226505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T18:50:19.041 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1226249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 141241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 221553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T18:50:19.042 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 193577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 74393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 420745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-21T18:50:19.043 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 279041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 87897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 124697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 81521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T18:50:19.044 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-21T18:50:19.045 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T18:50:19.045 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-21T18:50:19.045 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 117705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T18:50:19.045 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1053889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T18:50:19.079 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-21T18:50:19.079 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 119801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T18:50:19.079 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 2041809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T18:50:19.079 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1504993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 591417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T18:50:19.080 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T18:50:19.081 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T18:50:19.082 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T18:50:19.083 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T18:50:19.084 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 94137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 142673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 165745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 118121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T18:50:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T18:50:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 219073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-21T18:50:19.087 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 244177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 440785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 2589569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T18:50:19.088 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 52569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 336473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T18:50:19.089 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 46649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-21T18:50:19.090 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 530697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-21T18:50:19.091 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 2658777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 134313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-21T18:50:19.092 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 89737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 248049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 160857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 3998129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-21T18:50:19.093 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 74865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 58473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 6833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 6529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-21T18:50:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-21T18:50:19.095 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 6617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-21T18:50:19.096 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 143433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-21T18:50:19.097 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 4760825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 6369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T18:50:19.098 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T18:50:19.099 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 6985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-21T18:50:19.100 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 81017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-21T18:50:19.101 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 198417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 652553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 63825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T18:50:19.102 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 772505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T18:50:19.103 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T18:50:19.104 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 55937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T18:50:19.105 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1046417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 124793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 194321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T18:50:19.106 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 56945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 390297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T18:50:19.107 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 100257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 45169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 254601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T18:50:19.108 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 60529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T18:50:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T18:50:19.110 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T18:50:19.111 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T18:50:19.112 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T18:50:19.113 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T18:50:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 41577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T18:50:19.115 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 80793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 92817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T18:50:19.116 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 42209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T18:50:19.117 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T18:50:19.118 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T18:50:19.119 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 73161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T18:50:19.120 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 82929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 125873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 25865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T18:50:19.121 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 53153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 267017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-21T18:50:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 291041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 119649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T18:50:19.123 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 102033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 103121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 104593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 105129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 114393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T18:50:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 111161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 114673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 114329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 113217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 116217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-21T18:50:19.125 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 412481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T18:50:19.126 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T18:50:19.127 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 408689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 118145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 108393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T18:50:19.128 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 66641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 88513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T18:50:19.129 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 95353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 44025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T18:50:19.130 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 592185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 39905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 49673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T18:50:19.131 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 40721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T18:50:19.132 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T18:50:19.133 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 89329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T18:50:19.134 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 18169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T18:50:19.135 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T18:50:19.136 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T18:50:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T18:50:19.138 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T18:50:19.139 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T18:50:19.140 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T18:50:19.141 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 30089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T18:50:19.142 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 8553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-21T18:50:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 12425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 379545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T18:50:19.144 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 109961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 54761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 252825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T18:50:19.145 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 165081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 67241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 820137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T18:50:19.146 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 34057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 43817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T18:50:19.147 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 37953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 59217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T18:50:19.148 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 21649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T18:50:19.149 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 33609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 48409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 16065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 29809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T18:50:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 35601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 47617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 32953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T18:50:19.151 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 26881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 31425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 28897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 27729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 930369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 19033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T18:50:19.152 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 335569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 61833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 1514649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 707401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-21T18:50:19.153 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 862233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 84841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 68033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 95985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T18:50:19.154 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 10705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 17521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 125097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 22657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 20705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T18:50:19.155 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 102265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 15513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 638200 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 623896 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 7656 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 23361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-21T18:50:19.156 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 9821 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 69903 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 146449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 232695 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 210 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 72754 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 879 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 252883 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T18:50:19.157 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 307884 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T18:50:19.158 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/ 2023-07-21T18:50:19.158 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/ 2023-07-21T18:50:19.158 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/ 2023-07-21T18:50:19.158 INFO:teuthology.orchestra.run.smithi145.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T18:50:19.158 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 173 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-21T18:50:19.158 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r-- root/root 691 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-21T18:50:19.159 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:19.159 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:19.160 DEBUG:teuthology.orchestra.run.smithi145:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-21T18:50:19.168 INFO:teuthology.orchestra.run.smithi145.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T18:50:19.168 INFO:teuthology.orchestra.run.smithi145.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T18:50:19.168 INFO:teuthology.orchestra.run.smithi145.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-21T18:50:19.168 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-21T18:50:19.169 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:19.169 DEBUG:teuthology.orchestra.run.smithi145:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-21T18:50:19.171 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi145.front.sepia.ceph.com to complete... 2023-07-21T18:50:19.928 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub' 2023-07-21T18:50:19.933 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T18:50:19.954 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2023-07-21T18:50:20.219 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:20.231 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:20.633 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-21T18:50:20.645 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-21T18:50:22.322 INFO:teuthology.orchestra.run.smithi145.stderr:done 2023-07-21T18:50:23.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:50:23.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:50:24.052 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-21T18:50:25.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:50:25.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T18:50:25.627 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-07-21T18:50:25.684 INFO:teuthology.orchestra.run.smithi123.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:25.684 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:50:25.685 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T18:50:25.685 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-21T18:50:26.686 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-21T18:50:26.687 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T18:50:26.823 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2023-07-21T18:50:26.893 DEBUG:teuthology.parallel:result is None 2023-07-21T18:50:53.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-21T18:50:53.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:50:53.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:51:11.856 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T18:51:20.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:51:20.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:51:23.920 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T18:51:35.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:51:35.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:51:54.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T18:52:09.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:52:09.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:09.637 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-21T18:52:10.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:52:10.402 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T18:52:10.403 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2023-07-21T18:52:10.461 INFO:teuthology.orchestra.run.smithi145.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T18:52:10.462 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T18:52:10.462 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T18:52:10.462 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-21T18:52:11.463 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-21T18:52:11.463 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T18:52:11.583 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2023-07-21T18:52:11.648 DEBUG:teuthology.parallel:result is None 2023-07-21T18:52:11.648 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-21T18:52:11.775 INFO:teuthology.task.internal:Creating test directory... 2023-07-21T18:52:11.776 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T18:52:11.786 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T18:52:11.807 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-21T18:52:11.845 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-21T18:52:11.861 INFO:teuthology.task.internal:Creating archive directory... 2023-07-21T18:52:11.862 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T18:52:11.870 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T18:52:11.908 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-21T18:52:11.916 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-21T18:52:11.916 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T18:52:11.940 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T18:52:11.994 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T18:52:12.003 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T18:52:12.017 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T18:52:12.027 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T18:52:12.031 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-21T18:52:12.039 INFO:teuthology.task.internal:Configuring sudo... 2023-07-21T18:52:12.039 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T18:52:12.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T18:52:12.082 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-21T18:52:12.091 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-21T18:52:12.092 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T18:52:12.129 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T18:52:12.146 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T18:52:12.201 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T18:52:12.258 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T18:52:12.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T18:52:12.336 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T18:52:12.354 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T18:52:12.416 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T18:52:12.416 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T18:52:12.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2023-07-21T18:52:12.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2023-07-21T18:52:12.673 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-21T18:52:12.681 INFO:teuthology.task.internal:Starting timer... 2023-07-21T18:52:12.682 INFO:teuthology.run_tasks:Running task pcp... 2023-07-21T18:52:12.693 INFO:teuthology.run_tasks:Running task selinux... 2023-07-21T18:52:12.709 DEBUG:teuthology.task.selinux:Excluding smithi123: OS 'ubuntu' does not support SELinux 2023-07-21T18:52:12.709 DEBUG:teuthology.task.selinux:Excluding smithi145: OS 'ubuntu' does not support SELinux 2023-07-21T18:52:12.710 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-21T18:52:12.710 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-21T18:52:12.710 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-21T18:52:12.710 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-21T18:52:12.719 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-21T18:52:12.725 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-21T18:52:12.892 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-21T18:52:12.929 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-21T18:52:12.931 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-21T18:59:58.340 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2023-07-21T18:59:58.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:59:58.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:59:58.445 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-21T18:59:58.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T18:59:58.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:59:58.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:59:58.757 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-21T18:59:58.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T18:59:58.992 INFO:teuthology.run_tasks:Running task clock... 2023-07-21T18:59:59.006 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-21T18:59:59.007 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T18:59:59.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T18:59:59.015 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T18:59:59.015 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T18:59:59.082 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-21T18:59:59.082 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Command line: ntpd -gq 2023-07-21T18:59:59.084 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: proto: precision = 0.072 usec (-24) 2023-07-21T18:59:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T18:59:59.085 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T18:59:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-21T18:59:59.086 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: restrict ::: KOD does nothing without LIMITED. 2023-07-21T18:59:59.086 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listen and drop on 0 v6wildcard [::]:123 2023-07-21T18:59:59.086 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-21T18:59:59.086 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listen normally on 2 lo 127.0.0.1:123 2023-07-21T18:59:59.086 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listen normally on 3 enp3s0f1 172.21.15.123:123 2023-07-21T18:59:59.087 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listen normally on 4 lo [::1]:123 2023-07-21T18:59:59.087 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3f1%5]:123 2023-07-21T18:59:59.087 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 18:59:59 ntpd[22081]: Listening on routing socket on fd #22 for interface updates 2023-07-21T18:59:59.107 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-21T18:59:59.107 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Command line: ntpd -gq 2023-07-21T18:59:59.108 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: proto: precision = 0.056 usec (-24) 2023-07-21T18:59:59.109 INFO:teuthology.orchestra.run.smithi145.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T18:59:59.109 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T18:59:59.109 INFO:teuthology.orchestra.run.smithi145.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-21T18:59:59.110 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: restrict ::: KOD does nothing without LIMITED. 2023-07-21T18:59:59.110 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listen and drop on 0 v6wildcard [::]:123 2023-07-21T18:59:59.111 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-21T18:59:59.111 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listen normally on 2 lo 127.0.0.1:123 2023-07-21T18:59:59.111 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listen normally on 3 enp3s0f1 172.21.15.145:123 2023-07-21T18:59:59.111 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listen normally on 4 lo [::1]:123 2023-07-21T18:59:59.111 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7791%5]:123 2023-07-21T18:59:59.111 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 18:59:59 ntpd[22088]: Listening on routing socket on fd #22 for interface updates 2023-07-21T19:00:00.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:00 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:00.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:00 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:00.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:00 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:00.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:00 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:00.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:00 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:00 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:00.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:00.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:00.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:00.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:00.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:00.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:00.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:00.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:00 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:01 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:01 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:01 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:01 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:01 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:01 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:02 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:02 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:02 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:02 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:02 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:02 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:02.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:02.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:02.112 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:02.112 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:02 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:03.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:03.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:03.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:03.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:03.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:03.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:03.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:03.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:03.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:03.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:03.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:03.086 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:03 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:04.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:04 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:04.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:04.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:04.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:04.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:04.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:04.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:04.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:04.112 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:04 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:05.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:05.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:05.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:05.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:05.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:05.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:05.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:05.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:05.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:05.086 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:05.086 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:05.086 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:05 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:06.085 INFO:teuthology.orchestra.run.smithi123.stdout:21 Jul 19:00:06 ntpd[22081]: ntpd: time slew +0.003721 s 2023-07-21T19:00:06.085 INFO:teuthology.orchestra.run.smithi123.stdout:ntpd: time slew +0.003721s 2023-07-21T19:00:06.085 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-21T19:00:06.086 INFO:teuthology.orchestra.run.smithi123.stderr:21 Jul 19:00:06 ntpd[22081]: can't open /var/log/ntpstats/loopstats.20230721: Permission denied 2023-07-21T19:00:06.108 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.109 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.110 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:06.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:06.111 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T19:00:06.112 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T19:00:06.112 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T19:00:06.113 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T19:00:06.113 INFO:teuthology.orchestra.run.smithi145.stdout:21 Jul 19:00:06 ntpd[22088]: ntpd: time slew -0.003719 s 2023-07-21T19:00:06.113 INFO:teuthology.orchestra.run.smithi145.stdout:ntpd: time slew -0.003719s 2023-07-21T19:00:06.114 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-21T19:00:06.114 INFO:teuthology.orchestra.run.smithi145.stderr:21 Jul 19:00:06 ntpd[22088]: can't open /var/log/ntpstats/loopstats.20230721: Permission denied 2023-07-21T19:00:06.246 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T19:00:06.246 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2023-07-21T19:00:06.247 INFO:teuthology.orchestra.run.smithi123.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.247 INFO:teuthology.orchestra.run.smithi123.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.247 INFO:teuthology.orchestra.run.smithi123.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.247 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.259 INFO:teuthology.orchestra.run.smithi145.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T19:00:06.260 INFO:teuthology.orchestra.run.smithi145.stdout:============================================================================== 2023-07-21T19:00:06.260 INFO:teuthology.orchestra.run.smithi145.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.260 INFO:teuthology.orchestra.run.smithi145.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.260 INFO:teuthology.orchestra.run.smithi145.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.260 INFO:teuthology.orchestra.run.smithi145.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-21T19:00:06.261 INFO:teuthology.run_tasks:Running task install... 2023-07-21T19:00:06.271 DEBUG:teuthology.task.install:project ceph 2023-07-21T19:00:06.272 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9'}} 2023-07-21T19:00:06.272 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9'} 2023-07-21T19:00:06.273 INFO:teuthology.task.install:Using flavor: default 2023-07-21T19:00:06.278 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-21T19:00:06.279 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-21T19:00:06.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-key list | grep Ceph 2023-07-21T19:00:06.280 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-key list | grep Ceph 2023-07-21T19:00:06.497 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-21T19:00:06.515 INFO:teuthology.orchestra.run.smithi145.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-21T19:00:06.641 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-21T19:00:06.641 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph.com (release key) 2023-07-21T19:00:06.643 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-21T19:00:06.643 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-21T19:00:06.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=81cf785aa7781c4e08381c540f890cb9bc987ef9 2023-07-21T19:00:06.660 INFO:teuthology.orchestra.run.smithi145.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-21T19:00:06.661 INFO:teuthology.orchestra.run.smithi145.stdout:uid [ unknown] Ceph.com (release key) 2023-07-21T19:00:06.662 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-21T19:00:06.662 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-21T19:00:06.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=81cf785aa7781c4e08381c540f890cb9bc987ef9 2023-07-21T19:00:07.033 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default/ 2023-07-21T19:00:07.034 INFO:teuthology.task.install.deb:Package version is 18.0.0-4746-g81cf785a-1focal 2023-07-21T19:00:07.246 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default/ 2023-07-21T19:00:07.246 INFO:teuthology.task.install.deb:Package version is 18.0.0-4746-g81cf785a-1focal 2023-07-21T19:00:07.275 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:00:07.276 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-21T19:00:07.309 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2023-07-21T19:00:07.494 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:00:07.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-21T19:00:07.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2023-07-21T19:00:07.772 INFO:teuthology.orchestra.run.smithi145.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal InRelease 2023-07-21T19:00:07.832 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-21T19:00:07.897 INFO:teuthology.orchestra.run.smithi145.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal Release.gpg 2023-07-21T19:00:07.959 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-07-21T19:00:07.986 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-21T19:00:08.014 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal InRelease 2023-07-21T19:00:08.047 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main i386 Packages [3,403 B] 2023-07-21T19:00:08.086 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-21T19:00:08.097 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-21T19:00:08.167 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal Release.gpg 2023-07-21T19:00:08.246 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-07-21T19:00:08.342 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main i386 Packages [3,403 B] 2023-07-21T19:00:08.621 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-21T19:00:13.465 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:9 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-21T19:00:13.947 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 251 kB in 6s (41.2 kB/s) 2023-07-21T19:00:14.203 INFO:teuthology.orchestra.run.smithi145.stdout:Err:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-21T19:00:14.203 INFO:teuthology.orchestra.run.smithi145.stdout: Connection failed [IP: 91.189.91.38 80] 2023-07-21T19:00:14.594 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-21T19:00:14.719 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-21T19:00:15.110 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-07-21T19:00:15.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4746-g81cf785a-1focal cephadm=18.0.0-4746-g81cf785a-1focal ceph-mds=18.0.0-4746-g81cf785a-1focal ceph-mgr=18.0.0-4746-g81cf785a-1focal ceph-common=18.0.0-4746-g81cf785a-1focal ceph-fuse=18.0.0-4746-g81cf785a-1focal ceph-test=18.0.0-4746-g81cf785a-1focal ceph-volume=18.0.0-4746-g81cf785a-1focal radosgw=18.0.0-4746-g81cf785a-1focal python3-rados=18.0.0-4746-g81cf785a-1focal python3-rgw=18.0.0-4746-g81cf785a-1focal python3-cephfs=18.0.0-4746-g81cf785a-1focal python3-rbd=18.0.0-4746-g81cf785a-1focal libcephfs2=18.0.0-4746-g81cf785a-1focal libcephfs-dev=18.0.0-4746-g81cf785a-1focal librados2=18.0.0-4746-g81cf785a-1focal librbd1=18.0.0-4746-g81cf785a-1focal rbd-fuse=18.0.0-4746-g81cf785a-1focal python3-cephfs=18.0.0-4746-g81cf785a-1focal cephfs-shell=18.0.0-4746-g81cf785a-1focal cephfs-top=18.0.0-4746-g81cf785a-1focal cephfs-mirror=18.0.0-4746-g81cf785a-1focal 2023-07-21T19:00:15.275 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-07-21T19:00:15.323 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-21T19:00:15.469 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-07-21T19:00:15.470 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-07-21T19:00:15.651 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T19:00:15.652 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T19:00:15.652 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T19:00:15.652 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2023-07-21T19:00:15.652 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-21T19:00:15.653 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-21T19:00:15.653 INFO:teuthology.orchestra.run.smithi123.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-21T19:00:15.654 INFO:teuthology.orchestra.run.smithi123.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-21T19:00:15.654 INFO:teuthology.orchestra.run.smithi123.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-21T19:00:15.654 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-21T19:00:15.654 INFO:teuthology.orchestra.run.smithi123.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T19:00:15.654 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-21T19:00:15.655 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-07-21T19:00:15.656 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-07-21T19:00:15.656 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-21T19:00:15.656 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T19:00:15.656 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T19:00:15.656 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T19:00:15.656 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T19:00:15.657 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-21T19:00:15.657 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2023-07-21T19:00:15.657 INFO:teuthology.orchestra.run.smithi123.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-21T19:00:15.657 INFO:teuthology.orchestra.run.smithi123.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-21T19:00:15.657 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2023-07-21T19:00:15.658 INFO:teuthology.orchestra.run.smithi123.stdout: btrfs-tools 2023-07-21T19:00:15.858 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2023-07-21T19:00:15.858 INFO:teuthology.orchestra.run.smithi123.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-21T19:00:15.858 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-21T19:00:15.858 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-21T19:00:15.858 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-07-21T19:00:15.859 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-07-21T19:00:15.859 INFO:teuthology.orchestra.run.smithi123.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-07-21T19:00:15.859 INFO:teuthology.orchestra.run.smithi123.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-07-21T19:00:15.860 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-07-21T19:00:15.860 INFO:teuthology.orchestra.run.smithi123.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T19:00:15.860 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T19:00:15.860 INFO:teuthology.orchestra.run.smithi123.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T19:00:15.860 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-07-21T19:00:15.861 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-07-21T19:00:15.862 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2023-07-21T19:00:15.863 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 librbd1 2023-07-21T19:00:15.999 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 251 kB in 8s (30.0 kB/s) 2023-07-21T19:00:16.061 INFO:teuthology.orchestra.run.smithi123.stdout:2 upgraded, 116 newly installed, 0 to remove and 210 not upgraded. 2023-07-21T19:00:16.062 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 210 MB of archives. 2023-07-21T19:00:16.062 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 1,039 MB of additional disk space will be used. 2023-07-21T19:00:16.062 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-07-21T19:00:16.146 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-21T19:00:16.178 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-07-21T19:00:16.291 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-21T19:00:16.392 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4746-g81cf785a-1focal [3,428 kB] 2023-07-21T19:00:16.424 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-21T19:00:16.446 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-21T19:00:16.511 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-21T19:00:16.700 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-21T19:00:16.709 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-21T19:00:16.736 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-21T19:00:16.744 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-21T19:00:16.745 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-21T19:00:16.748 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-21T19:00:16.750 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-21T19:00:16.768 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-21T19:00:16.769 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-21T19:00:16.784 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-21T19:00:16.855 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-21T19:00:16.856 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-21T19:00:16.857 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-21T19:00:16.859 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-21T19:00:16.859 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-21T19:00:16.860 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-21T19:00:16.863 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-21T19:00:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-21T19:00:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-21T19:00:16.956 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-21T19:00:16.957 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-21T19:00:16.968 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-21T19:00:16.969 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-21T19:00:16.969 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-21T19:00:16.970 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-21T19:00:16.971 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-21T19:00:16.973 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-21T19:00:17.056 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-21T19:00:17.057 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-21T19:00:17.144 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-21T19:00:17.147 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-21T19:00:17.148 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-21T19:00:17.150 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-21T19:00:17.151 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-21T19:00:17.154 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-21T19:00:17.155 INFO:teuthology.orchestra.run.smithi123.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-21T19:00:17.156 INFO:teuthology.orchestra.run.smithi123.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-21T19:00:17.194 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2023-07-21T19:00:17.221 INFO:teuthology.orchestra.run.smithi123.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-21T19:00:17.222 INFO:teuthology.orchestra.run.smithi123.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-21T19:00:17.226 INFO:teuthology.orchestra.run.smithi145.stderr:W: Failed to fetch http://security.ubuntu.com/ubuntu/dists/focal-security/InRelease Connection failed [IP: 91.189.91.38 80] 2023-07-21T19:00:17.227 INFO:teuthology.orchestra.run.smithi145.stderr:W: Some index files failed to download. They have been ignored, or old ones used instead. 2023-07-21T19:00:17.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4746-g81cf785a-1focal cephadm=18.0.0-4746-g81cf785a-1focal ceph-mds=18.0.0-4746-g81cf785a-1focal ceph-mgr=18.0.0-4746-g81cf785a-1focal ceph-common=18.0.0-4746-g81cf785a-1focal ceph-fuse=18.0.0-4746-g81cf785a-1focal ceph-test=18.0.0-4746-g81cf785a-1focal ceph-volume=18.0.0-4746-g81cf785a-1focal radosgw=18.0.0-4746-g81cf785a-1focal python3-rados=18.0.0-4746-g81cf785a-1focal python3-rgw=18.0.0-4746-g81cf785a-1focal python3-cephfs=18.0.0-4746-g81cf785a-1focal python3-rbd=18.0.0-4746-g81cf785a-1focal libcephfs2=18.0.0-4746-g81cf785a-1focal libcephfs-dev=18.0.0-4746-g81cf785a-1focal librados2=18.0.0-4746-g81cf785a-1focal librbd1=18.0.0-4746-g81cf785a-1focal rbd-fuse=18.0.0-4746-g81cf785a-1focal python3-cephfs=18.0.0-4746-g81cf785a-1focal cephfs-shell=18.0.0-4746-g81cf785a-1focal cephfs-top=18.0.0-4746-g81cf785a-1focal cephfs-mirror=18.0.0-4746-g81cf785a-1focal 2023-07-21T19:00:17.351 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2023-07-21T19:00:17.528 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2023-07-21T19:00:17.529 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2023-07-21T19:00:17.667 INFO:teuthology.orchestra.run.smithi123.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-21T19:00:17.694 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T19:00:17.695 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T19:00:17.695 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T19:00:17.695 INFO:teuthology.orchestra.run.smithi145.stdout:The following additional packages will be installed: 2023-07-21T19:00:17.695 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-21T19:00:17.695 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-21T19:00:17.696 INFO:teuthology.orchestra.run.smithi145.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-21T19:00:17.696 INFO:teuthology.orchestra.run.smithi145.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-21T19:00:17.696 INFO:teuthology.orchestra.run.smithi145.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-21T19:00:17.697 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-21T19:00:17.697 INFO:teuthology.orchestra.run.smithi145.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T19:00:17.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T19:00:17.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-21T19:00:17.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T19:00:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-21T19:00:17.700 INFO:teuthology.orchestra.run.smithi145.stdout:Suggested packages: 2023-07-21T19:00:17.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-21T19:00:17.700 INFO:teuthology.orchestra.run.smithi145.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-21T19:00:17.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-21T19:00:17.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout:Recommended packages: 2023-07-21T19:00:17.701 INFO:teuthology.orchestra.run.smithi145.stdout: btrfs-tools 2023-07-21T19:00:17.722 INFO:teuthology.orchestra.run.smithi123.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-21T19:00:17.724 INFO:teuthology.orchestra.run.smithi123.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-21T19:00:17.771 INFO:teuthology.orchestra.run.smithi123.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-21T19:00:17.771 INFO:teuthology.orchestra.run.smithi123.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-21T19:00:17.772 INFO:teuthology.orchestra.run.smithi123.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-21T19:00:17.772 INFO:teuthology.orchestra.run.smithi123.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-21T19:00:17.773 INFO:teuthology.orchestra.run.smithi123.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-21T19:00:17.774 INFO:teuthology.orchestra.run.smithi123.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-21T19:00:17.774 INFO:teuthology.orchestra.run.smithi123.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-21T19:00:17.802 INFO:teuthology.orchestra.run.smithi123.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-21T19:00:17.803 INFO:teuthology.orchestra.run.smithi123.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-21T19:00:17.875 INFO:teuthology.orchestra.run.smithi123.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-21T19:00:17.882 INFO:teuthology.orchestra.run.smithi123.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-21T19:00:17.885 INFO:teuthology.orchestra.run.smithi123.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-21T19:00:17.887 INFO:teuthology.orchestra.run.smithi123.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-21T19:00:17.888 INFO:teuthology.orchestra.run.smithi123.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-21T19:00:17.891 INFO:teuthology.orchestra.run.smithi123.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-21T19:00:17.894 INFO:teuthology.orchestra.run.smithi123.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-07-21T19:00:17.895 INFO:teuthology.orchestra.run.smithi123.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-21T19:00:17.897 INFO:teuthology.orchestra.run.smithi145.stdout:The following NEW packages will be installed: 2023-07-21T19:00:17.897 INFO:teuthology.orchestra.run.smithi145.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-21T19:00:17.898 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-21T19:00:17.898 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-21T19:00:17.899 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-07-21T19:00:17.899 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-07-21T19:00:17.899 INFO:teuthology.orchestra.run.smithi145.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-07-21T19:00:17.899 INFO:teuthology.orchestra.run.smithi145.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-07-21T19:00:17.899 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-21T19:00:17.900 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-21T19:00:17.901 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-21T19:00:17.902 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-21T19:00:17.902 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-21T19:00:17.902 INFO:teuthology.orchestra.run.smithi145.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-07-21T19:00:17.902 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages will be upgraded: 2023-07-21T19:00:17.902 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 librbd1 2023-07-21T19:00:17.962 INFO:teuthology.orchestra.run.smithi123.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-21T19:00:17.967 INFO:teuthology.orchestra.run.smithi123.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-21T19:00:17.997 INFO:teuthology.orchestra.run.smithi123.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4746-g81cf785a-1focal [3,991 kB] 2023-07-21T19:00:18.018 INFO:teuthology.orchestra.run.smithi123.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-21T19:00:18.093 INFO:teuthology.orchestra.run.smithi145.stdout:2 upgraded, 116 newly installed, 0 to remove and 210 not upgraded. 2023-07-21T19:00:18.093 INFO:teuthology.orchestra.run.smithi145.stdout:Need to get 210 MB of archives. 2023-07-21T19:00:18.093 INFO:teuthology.orchestra.run.smithi145.stdout:After this operation, 1,039 MB of additional disk space will be used. 2023-07-21T19:00:18.094 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-07-21T19:00:18.158 INFO:teuthology.orchestra.run.smithi123.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-21T19:00:18.159 INFO:teuthology.orchestra.run.smithi123.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-21T19:00:18.159 INFO:teuthology.orchestra.run.smithi123.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-21T19:00:18.160 INFO:teuthology.orchestra.run.smithi123.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-21T19:00:18.161 INFO:teuthology.orchestra.run.smithi123.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-21T19:00:18.162 INFO:teuthology.orchestra.run.smithi123.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-21T19:00:18.173 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-21T19:00:18.200 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-07-21T19:00:18.209 INFO:teuthology.orchestra.run.smithi123.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-21T19:00:18.210 INFO:teuthology.orchestra.run.smithi123.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-21T19:00:18.210 INFO:teuthology.orchestra.run.smithi123.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-21T19:00:18.230 INFO:teuthology.orchestra.run.smithi123.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-21T19:00:18.306 INFO:teuthology.orchestra.run.smithi123.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-21T19:00:18.309 INFO:teuthology.orchestra.run.smithi123.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-21T19:00:18.310 INFO:teuthology.orchestra.run.smithi123.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-21T19:00:18.314 INFO:teuthology.orchestra.run.smithi123.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-21T19:00:18.316 INFO:teuthology.orchestra.run.smithi123.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-21T19:00:18.327 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-21T19:00:18.411 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4746-g81cf785a-1focal [3,428 kB] 2023-07-21T19:00:18.448 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-21T19:00:19.324 INFO:teuthology.orchestra.run.smithi123.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4746-g81cf785a-1focal [725 kB] 2023-07-21T19:00:19.507 INFO:teuthology.orchestra.run.smithi123.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4746-g81cf785a-1focal [377 kB] 2023-07-21T19:00:19.598 INFO:teuthology.orchestra.run.smithi123.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4746-g81cf785a-1focal [22.5 kB] 2023-07-21T19:00:19.599 INFO:teuthology.orchestra.run.smithi123.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4746-g81cf785a-1focal [191 kB] 2023-07-21T19:00:19.684 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4746-g81cf785a-1focal [3,991 kB] 2023-07-21T19:00:19.698 INFO:teuthology.orchestra.run.smithi123.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4746-g81cf785a-1focal [48.4 kB] 2023-07-21T19:00:19.700 INFO:teuthology.orchestra.run.smithi123.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4746-g81cf785a-1focal [354 kB] 2023-07-21T19:00:19.793 INFO:teuthology.orchestra.run.smithi123.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4746-g81cf785a-1focal [6,781 kB] 2023-07-21T19:00:20.476 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4746-g81cf785a-1focal [725 kB] 2023-07-21T19:00:20.583 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4746-g81cf785a-1focal [377 kB] 2023-07-21T19:00:20.679 INFO:teuthology.orchestra.run.smithi145.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4746-g81cf785a-1focal [22.5 kB] 2023-07-21T19:00:20.680 INFO:teuthology.orchestra.run.smithi145.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4746-g81cf785a-1focal [191 kB] 2023-07-21T19:00:20.683 INFO:teuthology.orchestra.run.smithi145.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4746-g81cf785a-1focal [48.4 kB] 2023-07-21T19:00:20.683 INFO:teuthology.orchestra.run.smithi145.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4746-g81cf785a-1focal [354 kB] 2023-07-21T19:00:20.788 INFO:teuthology.orchestra.run.smithi145.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4746-g81cf785a-1focal [6,781 kB] 2023-07-21T19:00:21.655 INFO:teuthology.orchestra.run.smithi145.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4746-g81cf785a-1focal [103 kB] 2023-07-21T19:00:21.657 INFO:teuthology.orchestra.run.smithi145.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4746-g81cf785a-1focal [466 kB] 2023-07-21T19:00:21.739 INFO:teuthology.orchestra.run.smithi145.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4746-g81cf785a-1focal [25.6 MB] 2023-07-21T19:00:22.079 INFO:teuthology.orchestra.run.smithi123.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4746-g81cf785a-1focal [103 kB] 2023-07-21T19:00:22.081 INFO:teuthology.orchestra.run.smithi123.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4746-g81cf785a-1focal [466 kB] 2023-07-21T19:00:22.295 INFO:teuthology.orchestra.run.smithi123.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4746-g81cf785a-1focal [25.6 MB] 2023-07-21T19:00:23.541 INFO:teuthology.orchestra.run.smithi145.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4746-g81cf785a-1focal [11.0 MB] 2023-07-21T19:00:24.320 INFO:teuthology.orchestra.run.smithi145.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4746-g81cf785a-1focal [223 kB] 2023-07-21T19:00:24.323 INFO:teuthology.orchestra.run.smithi145.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4746-g81cf785a-1focal [133 kB] 2023-07-21T19:00:24.382 INFO:teuthology.orchestra.run.smithi145.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4746-g81cf785a-1focal [1,552 kB] 2023-07-21T19:00:24.617 INFO:teuthology.orchestra.run.smithi145.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4746-g81cf785a-1focal [9,401 kB] 2023-07-21T19:00:27.239 INFO:teuthology.orchestra.run.smithi145.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4746-g81cf785a-1focal [31.3 MB] 2023-07-21T19:00:29.149 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-21T19:00:29.507 INFO:teuthology.orchestra.run.smithi145.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-21T19:00:30.047 INFO:teuthology.orchestra.run.smithi145.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-21T19:00:30.817 INFO:teuthology.orchestra.run.smithi145.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-21T19:00:30.927 INFO:teuthology.orchestra.run.smithi145.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-21T19:00:31.083 INFO:teuthology.orchestra.run.smithi145.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-21T19:00:31.217 INFO:teuthology.orchestra.run.smithi145.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-21T19:00:31.368 INFO:teuthology.orchestra.run.smithi145.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-21T19:00:31.530 INFO:teuthology.orchestra.run.smithi145.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-21T19:00:31.678 INFO:teuthology.orchestra.run.smithi145.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-21T19:00:31.849 INFO:teuthology.orchestra.run.smithi145.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-21T19:00:32.174 INFO:teuthology.orchestra.run.smithi145.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-21T19:00:32.980 INFO:teuthology.orchestra.run.smithi145.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-21T19:00:33.157 INFO:teuthology.orchestra.run.smithi145.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-21T19:00:33.321 INFO:teuthology.orchestra.run.smithi145.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-21T19:00:33.494 INFO:teuthology.orchestra.run.smithi145.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-21T19:00:33.694 INFO:teuthology.orchestra.run.smithi145.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-21T19:00:33.862 INFO:teuthology.orchestra.run.smithi145.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-21T19:00:34.024 INFO:teuthology.orchestra.run.smithi145.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-21T19:00:34.240 INFO:teuthology.orchestra.run.smithi145.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-21T19:00:34.415 INFO:teuthology.orchestra.run.smithi145.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-21T19:00:34.634 INFO:teuthology.orchestra.run.smithi145.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-21T19:00:34.987 INFO:teuthology.orchestra.run.smithi145.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-21T19:00:35.261 INFO:teuthology.orchestra.run.smithi145.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-21T19:00:36.032 INFO:teuthology.orchestra.run.smithi145.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-21T19:00:36.176 INFO:teuthology.orchestra.run.smithi145.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-21T19:00:36.323 INFO:teuthology.orchestra.run.smithi145.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-21T19:00:36.473 INFO:teuthology.orchestra.run.smithi145.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-21T19:00:36.648 INFO:teuthology.orchestra.run.smithi145.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-21T19:00:36.839 INFO:teuthology.orchestra.run.smithi145.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-21T19:00:37.051 INFO:teuthology.orchestra.run.smithi145.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-21T19:00:37.212 INFO:teuthology.orchestra.run.smithi145.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-21T19:00:37.408 INFO:teuthology.orchestra.run.smithi145.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-21T19:00:37.755 INFO:teuthology.orchestra.run.smithi145.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-21T19:00:38.171 INFO:teuthology.orchestra.run.smithi145.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-21T19:00:38.531 INFO:teuthology.orchestra.run.smithi145.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-21T19:00:38.934 INFO:teuthology.orchestra.run.smithi145.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-21T19:00:39.797 INFO:teuthology.orchestra.run.smithi145.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-21T19:00:40.350 INFO:teuthology.orchestra.run.smithi145.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-21T19:00:40.769 INFO:teuthology.orchestra.run.smithi145.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-21T19:00:40.905 INFO:teuthology.orchestra.run.smithi145.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-21T19:00:41.097 INFO:teuthology.orchestra.run.smithi145.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-21T19:00:53.900 INFO:teuthology.orchestra.run.smithi145.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-21T19:00:54.932 INFO:teuthology.orchestra.run.smithi145.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-21T19:00:55.205 INFO:teuthology.orchestra.run.smithi145.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-21T19:00:56.293 INFO:teuthology.orchestra.run.smithi145.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-21T19:00:56.385 INFO:teuthology.orchestra.run.smithi145.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-21T19:00:56.476 INFO:teuthology.orchestra.run.smithi145.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-21T19:00:56.573 INFO:teuthology.orchestra.run.smithi145.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-21T19:00:56.689 INFO:teuthology.orchestra.run.smithi145.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-21T19:00:56.823 INFO:teuthology.orchestra.run.smithi145.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-21T19:00:57.168 INFO:teuthology.orchestra.run.smithi145.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-21T19:00:57.279 INFO:teuthology.orchestra.run.smithi145.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-21T19:00:57.388 INFO:teuthology.orchestra.run.smithi145.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-21T19:00:57.495 INFO:teuthology.orchestra.run.smithi145.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-21T19:00:57.738 INFO:teuthology.orchestra.run.smithi145.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-21T19:00:58.223 INFO:teuthology.orchestra.run.smithi145.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-21T19:00:58.400 INFO:teuthology.orchestra.run.smithi145.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-21T19:00:58.538 INFO:teuthology.orchestra.run.smithi145.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-21T19:00:58.858 INFO:teuthology.orchestra.run.smithi145.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-21T19:00:59.049 INFO:teuthology.orchestra.run.smithi123.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4746-g81cf785a-1focal [11.0 MB] 2023-07-21T19:00:59.088 INFO:teuthology.orchestra.run.smithi145.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-07-21T19:00:59.209 INFO:teuthology.orchestra.run.smithi145.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-21T19:00:59.657 INFO:teuthology.orchestra.run.smithi145.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-21T19:00:59.768 INFO:teuthology.orchestra.run.smithi145.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-21T19:00:59.877 INFO:teuthology.orchestra.run.smithi145.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-21T19:01:00.223 INFO:teuthology.orchestra.run.smithi145.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-21T19:01:00.427 INFO:teuthology.orchestra.run.smithi145.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-21T19:01:00.542 INFO:teuthology.orchestra.run.smithi145.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-21T19:01:00.767 INFO:teuthology.orchestra.run.smithi145.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-21T19:01:00.891 INFO:teuthology.orchestra.run.smithi145.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-21T19:01:01.118 INFO:teuthology.orchestra.run.smithi145.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-21T19:01:01.703 INFO:teuthology.orchestra.run.smithi145.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-21T19:01:01.876 INFO:teuthology.orchestra.run.smithi145.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-21T19:01:02.005 INFO:teuthology.orchestra.run.smithi145.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-21T19:01:02.099 INFO:teuthology.orchestra.run.smithi145.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-21T19:01:02.221 INFO:teuthology.orchestra.run.smithi145.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-21T19:01:02.315 INFO:teuthology.orchestra.run.smithi145.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-21T19:01:02.518 INFO:teuthology.orchestra.run.smithi145.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-21T19:01:03.064 INFO:teuthology.orchestra.run.smithi145.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-21T19:01:03.221 INFO:teuthology.orchestra.run.smithi145.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-21T19:01:05.995 INFO:teuthology.orchestra.run.smithi145.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4746-g81cf785a-1focal [3,804 B] 2023-07-21T19:01:05.996 INFO:teuthology.orchestra.run.smithi145.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4746-g81cf785a-1focal [834 kB] 2023-07-21T19:01:06.638 INFO:teuthology.orchestra.run.smithi145.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4746-g81cf785a-1focal [2,303 kB] 2023-07-21T19:01:07.111 INFO:teuthology.orchestra.run.smithi123.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4746-g81cf785a-1focal [223 kB] 2023-07-21T19:01:07.234 INFO:teuthology.orchestra.run.smithi123.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4746-g81cf785a-1focal [133 kB] 2023-07-21T19:01:07.303 INFO:teuthology.orchestra.run.smithi123.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4746-g81cf785a-1focal [1,552 kB] 2023-07-21T19:01:08.039 INFO:teuthology.orchestra.run.smithi145.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4746-g81cf785a-1focal [217 kB] 2023-07-21T19:01:08.139 INFO:teuthology.orchestra.run.smithi123.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4746-g81cf785a-1focal [9,401 kB] 2023-07-21T19:01:08.171 INFO:teuthology.orchestra.run.smithi145.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4746-g81cf785a-1focal [124 kB] 2023-07-21T19:01:08.255 INFO:teuthology.orchestra.run.smithi145.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4746-g81cf785a-1focal [1,776 kB] 2023-07-21T19:01:09.300 INFO:teuthology.orchestra.run.smithi145.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4746-g81cf785a-1focal [7,867 kB] 2023-07-21T19:01:13.852 INFO:teuthology.orchestra.run.smithi123.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4746-g81cf785a-1focal [31.3 MB] 2023-07-21T19:01:14.620 INFO:teuthology.orchestra.run.smithi145.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4746-g81cf785a-1focal [3,928 B] 2023-07-21T19:01:14.620 INFO:teuthology.orchestra.run.smithi145.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4746-g81cf785a-1focal [50.9 MB] 2023-07-21T19:01:52.597 INFO:teuthology.orchestra.run.smithi123.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4746-g81cf785a-1focal [3,804 B] 2023-07-21T19:01:52.639 INFO:teuthology.orchestra.run.smithi123.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4746-g81cf785a-1focal [834 kB] 2023-07-21T19:01:54.179 INFO:teuthology.orchestra.run.smithi123.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4746-g81cf785a-1focal [2,303 kB] 2023-07-21T19:01:58.180 INFO:teuthology.orchestra.run.smithi123.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4746-g81cf785a-1focal [217 kB] 2023-07-21T19:01:58.548 INFO:teuthology.orchestra.run.smithi123.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4746-g81cf785a-1focal [124 kB] 2023-07-21T19:01:58.787 INFO:teuthology.orchestra.run.smithi123.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4746-g81cf785a-1focal [1,776 kB] 2023-07-21T19:02:01.593 INFO:teuthology.orchestra.run.smithi123.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4746-g81cf785a-1focal [7,867 kB] 2023-07-21T19:02:10.317 INFO:teuthology.orchestra.run.smithi123.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4746-g81cf785a-1focal [3,928 B] 2023-07-21T19:02:10.330 INFO:teuthology.orchestra.run.smithi123.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4746-g81cf785a-1focal [50.9 MB] 2023-07-21T19:02:24.471 INFO:teuthology.orchestra.run.smithi145.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4746-g81cf785a-1focal [220 kB] 2023-07-21T19:02:24.683 INFO:teuthology.orchestra.run.smithi145.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4746-g81cf785a-1focal [256 kB] 2023-07-21T19:02:24.888 INFO:teuthology.orchestra.run.smithi145.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4746-g81cf785a-1focal [23.3 kB] 2023-07-21T19:02:24.889 INFO:teuthology.orchestra.run.smithi145.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4746-g81cf785a-1focal [12.9 kB] 2023-07-21T19:02:24.909 INFO:teuthology.orchestra.run.smithi145.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4746-g81cf785a-1focal [28.0 kB] 2023-07-21T19:02:24.930 INFO:teuthology.orchestra.run.smithi145.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4746-g81cf785a-1focal [13.8 MB] 2023-07-21T19:02:35.116 INFO:teuthology.orchestra.run.smithi145.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4746-g81cf785a-1focal [97.4 kB] 2023-07-21T19:02:36.076 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 210 MB in 2min 17s (1,527 kB/s) 2023-07-21T19:02:36.260 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-21T19:02:36.332 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-07-21T19:02:36.335 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-07-21T19:02:36.373 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-07-21T19:02:36.767 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-21T19:02:36.786 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-21T19:02:36.826 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T19:02:37.204 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cmd2. 2023-07-21T19:02:37.223 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-07-21T19:02:37.262 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-07-21T19:02:37.665 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-21T19:02:37.682 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-21T19:02:37.765 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T19:02:38.185 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-21T19:02:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-21T19:02:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T19:02:38.655 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-21T19:02:38.668 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-21T19:02:38.705 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T19:02:39.283 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-21T19:02:39.296 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T19:02:39.357 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:02:39.903 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-21T19:02:39.922 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T19:02:39.961 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:02:40.375 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-21T19:02:40.393 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T19:02:40.433 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:02:40.911 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-21T19:02:40.924 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-21T19:02:40.961 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T19:02:41.395 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../010-librbd1_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:41.523 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librbd1 (18.0.0-4746-g81cf785a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T19:02:42.293 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../011-librados2_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:42.467 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librados2 (18.0.0-4746-g81cf785a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T19:02:43.280 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libcephfs2. 2023-07-21T19:02:43.298 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:43.371 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libcephfs2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:43.732 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rados. 2023-07-21T19:02:43.751 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:43.824 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rados (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:44.243 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-21T19:02:44.262 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:02:44.301 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-ceph-argparse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:44.554 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cephfs. 2023-07-21T19:02:44.574 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:44.612 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cephfs (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:44.991 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-21T19:02:45.010 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:02:45.049 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:45.452 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-prettytable. 2023-07-21T19:02:45.470 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-07-21T19:02:45.510 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-21T19:02:45.837 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rbd. 2023-07-21T19:02:45.857 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rbd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:46.315 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-21T19:02:46.334 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-21T19:02:46.373 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T19:02:46.810 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-21T19:02:46.822 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-21T19:02:46.860 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T19:02:47.238 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-21T19:02:47.250 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-21T19:02:47.296 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T19:02:47.716 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librgw2. 2023-07-21T19:02:47.735 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../022-librgw2_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:47.774 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librgw2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:48.694 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rgw. 2023-07-21T19:02:48.714 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:48.777 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:49.114 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liboath0. 2023-07-21T19:02:49.133 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-21T19:02:49.222 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-21T19:02:49.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4746-g81cf785a-1focal [220 kB] 2023-07-21T19:02:49.558 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libradosstriper1. 2023-07-21T19:02:49.577 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:49.621 INFO:teuthology.orchestra.run.smithi123.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4746-g81cf785a-1focal [256 kB] 2023-07-21T19:02:49.658 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libradosstriper1 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:49.858 INFO:teuthology.orchestra.run.smithi123.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4746-g81cf785a-1focal [23.3 kB] 2023-07-21T19:02:49.859 INFO:teuthology.orchestra.run.smithi123.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4746-g81cf785a-1focal [12.9 kB] 2023-07-21T19:02:49.880 INFO:teuthology.orchestra.run.smithi123.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4746-g81cf785a-1focal [28.0 kB] 2023-07-21T19:02:49.900 INFO:teuthology.orchestra.run.smithi123.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4746-g81cf785a-1focal [13.8 MB] 2023-07-21T19:02:50.178 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-common. 2023-07-21T19:02:50.197 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:50.236 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:52.858 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-base. 2023-07-21T19:02:52.876 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:02:52.939 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-base (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:02:54.713 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-21T19:02:54.732 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-21T19:02:54.762 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-21T19:02:55.183 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-natsort. 2023-07-21T19:02:55.202 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-07-21T19:02:55.241 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-21T19:02:55.611 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-logutils. 2023-07-21T19:02:55.630 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-07-21T19:02:55.661 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-21T19:02:56.006 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-21T19:02:56.026 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-21T19:02:56.064 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-21T19:02:56.442 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-mako. 2023-07-21T19:02:56.461 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-21T19:02:56.500 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T19:02:56.887 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-21T19:02:56.906 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-21T19:02:56.944 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-21T19:02:57.340 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-21T19:02:57.359 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-21T19:02:57.397 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T19:02:57.776 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webob. 2023-07-21T19:02:57.794 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-21T19:02:57.833 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-21T19:02:58.245 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-21T19:02:58.264 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-21T19:02:58.303 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T19:02:58.700 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-bs4. 2023-07-21T19:02:58.719 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-07-21T19:02:58.758 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-21T19:02:59.170 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-waitress. 2023-07-21T19:02:59.189 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-21T19:02:59.234 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T19:02:59.631 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-tempita. 2023-07-21T19:02:59.650 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-07-21T19:02:59.689 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-21T19:03:00.075 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-paste. 2023-07-21T19:03:00.088 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-21T19:03:00.125 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T19:03:00.520 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-21T19:03:00.535 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-21T19:03:00.578 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T19:03:00.932 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-21T19:03:00.944 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-21T19:03:00.998 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-21T19:03:01.376 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webtest. 2023-07-21T19:03:01.389 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-07-21T19:03:01.434 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-21T19:03:01.812 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pecan. 2023-07-21T19:03:01.830 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-21T19:03:01.870 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T19:03:02.292 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-21T19:03:02.306 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-21T19:03:02.350 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T19:03:02.704 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-21T19:03:02.722 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:02.761 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:03.200 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-21T19:03:03.212 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:03.257 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:03.636 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cryptography. 2023-07-21T19:03:03.648 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-21T19:03:03.694 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T19:03:04.140 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-openssl. 2023-07-21T19:03:04.158 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-21T19:03:04.197 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-21T19:03:04.601 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr. 2023-07-21T19:03:04.620 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:04.659 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:05.221 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mon. 2023-07-21T19:03:05.239 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:05.278 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mon (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:06.516 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-osd. 2023-07-21T19:03:06.535 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:06.573 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-osd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:09.310 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph. 2023-07-21T19:03:09.330 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../053-ceph_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:09.384 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:09.763 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-fuse. 2023-07-21T19:03:09.782 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:09.820 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:10.316 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mds. 2023-07-21T19:03:10.335 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:10.374 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mds (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:10.985 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package cephadm. 2023-07-21T19:03:11.005 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../056-cephadm_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:11.043 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:11.438 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-21T19:03:11.457 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-21T19:03:11.495 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-21T19:03:11.924 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jinja2. 2023-07-21T19:03:11.943 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-07-21T19:03:11.982 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-21T19:03:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-21T19:03:12.395 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:12.435 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:12.872 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-21T19:03:12.891 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-21T19:03:12.929 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T19:03:13.291 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jwt. 2023-07-21T19:03:13.311 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-21T19:03:13.349 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T19:03:13.744 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-21T19:03:13.764 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-07-21T19:03:13.802 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-21T19:03:14.104 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libjs-underscore. 2023-07-21T19:03:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-21T19:03:14.162 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T19:03:14.399 INFO:teuthology.orchestra.run.smithi123.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-m-quota/81cf785aa7781c4e08381c540f890cb9bc987ef9/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4746-g81cf785a-1focal [97.4 kB] 2023-07-21T19:03:14.448 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-21T19:03:14.462 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-21T19:03:14.531 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T19:03:14.859 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-routes. 2023-07-21T19:03:14.872 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-07-21T19:03:14.950 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-21T19:03:15.321 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-21T19:03:15.340 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:15.386 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 210 MB in 2min 59s (1,173 kB/s) 2023-07-21T19:03:15.428 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:15.573 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-21T19:03:15.645 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-07-21T19:03:15.647 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-07-21T19:03:15.702 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-07-21T19:03:15.982 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-decorator. 2023-07-21T19:03:15.995 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-21T19:03:16.040 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T19:03:16.064 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-21T19:03:16.083 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-21T19:03:16.122 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T19:03:16.401 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-21T19:03:16.414 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-21T19:03:16.459 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T19:03:16.491 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cmd2. 2023-07-21T19:03:16.510 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-07-21T19:03:16.549 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-07-21T19:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-scipy. 2023-07-21T19:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-21T19:03:16.903 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-21T19:03:16.927 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-21T19:03:16.946 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-21T19:03:17.035 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T19:03:17.439 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-21T19:03:17.458 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-21T19:03:17.497 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T19:03:17.959 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-21T19:03:17.977 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-21T19:03:18.017 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T19:03:18.338 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-21T19:03:18.359 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-21T19:03:18.396 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T19:03:18.554 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-21T19:03:18.574 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T19:03:18.632 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:03:19.066 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-joblib. 2023-07-21T19:03:19.085 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-07-21T19:03:19.124 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-21T19:03:19.223 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-21T19:03:19.241 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T19:03:19.281 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:03:19.561 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-sklearn. 2023-07-21T19:03:19.581 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-21T19:03:19.620 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T19:03:19.711 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-21T19:03:19.729 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-21T19:03:19.769 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:03:20.241 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-21T19:03:20.254 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-21T19:03:20.314 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T19:03:20.436 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-21T19:03:20.456 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:20.494 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:20.744 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../010-librbd1_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:20.872 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librbd1 (18.0.0-4746-g81cf785a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T19:03:21.638 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../011-librados2_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:21.781 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cachetools. 2023-07-21T19:03:21.793 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librados2 (18.0.0-4746-g81cf785a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-21T19:03:21.799 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-07-21T19:03:21.838 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-21T19:03:22.208 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-21T19:03:22.227 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-21T19:03:22.266 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T19:03:22.656 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs2. 2023-07-21T19:03:22.670 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-21T19:03:22.675 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:22.689 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-21T19:03:22.714 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:22.727 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T19:03:23.117 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rados. 2023-07-21T19:03:23.122 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rsa. 2023-07-21T19:03:23.136 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:23.142 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-07-21T19:03:23.175 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rados (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:23.180 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-21T19:03:23.550 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-google-auth. 2023-07-21T19:03:23.553 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-21T19:03:23.570 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-07-21T19:03:23.570 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:23.608 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-21T19:03:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-argparse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:23.930 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cephfs. 2023-07-21T19:03:23.949 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:23.988 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cephfs (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:24.011 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-blinker. 2023-07-21T19:03:24.031 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-21T19:03:24.069 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T19:03:24.400 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-21T19:03:24.414 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-21T19:03:24.418 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:24.427 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-21T19:03:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:24.472 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T19:03:24.836 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-prettytable. 2023-07-21T19:03:24.854 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-07-21T19:03:24.927 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-21T19:03:24.977 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-21T19:03:24.992 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-21T19:03:25.213 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rbd. 2023-07-21T19:03:25.233 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:25.261 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T19:03:25.305 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rbd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:25.606 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-websocket. 2023-07-21T19:03:25.626 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-21T19:03:25.714 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T19:03:25.724 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-21T19:03:25.743 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-21T19:03:25.782 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T19:03:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-21T19:03:26.079 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-21T19:03:26.159 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T19:03:26.185 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-21T19:03:26.204 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-21T19:03:26.243 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T19:03:26.663 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-21T19:03:26.676 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-21T19:03:26.713 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T19:03:26.857 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-21T19:03:26.875 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:26.915 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:27.141 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librgw2. 2023-07-21T19:03:27.153 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../022-librgw2_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:27.232 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librgw2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:27.293 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-21T19:03:27.312 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-07-21T19:03:27.351 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-21T19:03:27.785 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-21T19:03:27.805 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:03:27.843 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:03:28.181 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package jq. 2023-07-21T19:03:28.186 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rgw. 2023-07-21T19:03:28.201 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:03:28.206 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:28.239 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:03:28.244 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:28.583 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package socat. 2023-07-21T19:03:28.603 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-07-21T19:03:28.633 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-21T19:03:28.639 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liboath0. 2023-07-21T19:03:28.657 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-21T19:03:28.728 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-21T19:03:29.020 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package xmlstarlet. 2023-07-21T19:03:29.039 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-21T19:03:29.077 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-21T19:03:29.125 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libradosstriper1. 2023-07-21T19:03:29.142 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:29.182 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libradosstriper1 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:29.524 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-test. 2023-07-21T19:03:29.543 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:29.581 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-test (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:29.720 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-common. 2023-07-21T19:03:29.738 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:29.778 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:32.399 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-base. 2023-07-21T19:03:32.418 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:32.478 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-base (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:33.877 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-volume. 2023-07-21T19:03:33.897 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:33.935 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-volume (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:33.996 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-21T19:03:34.015 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-21T19:03:34.053 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-21T19:03:34.441 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-21T19:03:34.459 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:34.466 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-natsort. 2023-07-21T19:03:34.484 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-07-21T19:03:34.498 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking cephfs-mirror (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:34.523 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-21T19:03:34.906 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-colorama. 2023-07-21T19:03:34.910 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-logutils. 2023-07-21T19:03:34.922 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-07-21T19:03:34.926 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-07-21T19:03:34.964 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-07-21T19:03:34.993 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-21T19:03:35.276 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package cephfs-shell. 2023-07-21T19:03:35.295 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:35.329 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-21T19:03:35.342 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-21T19:03:35.366 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking cephfs-shell (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:35.412 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-21T19:03:35.653 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package cephfs-top. 2023-07-21T19:03:35.671 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:35.718 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking cephfs-top (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:35.773 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-mako. 2023-07-21T19:03:35.786 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-21T19:03:35.823 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T19:03:36.054 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-21T19:03:36.074 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T19:03:36.112 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:03:36.235 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-21T19:03:36.253 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-21T19:03:36.293 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-21T19:03:36.655 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-21T19:03:36.674 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-21T19:03:36.683 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-21T19:03:36.703 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:36.713 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T19:03:36.740 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libcephfs-dev (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:37.082 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webob. 2023-07-21T19:03:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-21T19:03:37.140 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-21T19:03:37.186 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package nvme-cli. 2023-07-21T19:03:37.204 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-21T19:03:37.280 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T19:03:37.543 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-21T19:03:37.562 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-21T19:03:37.601 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T19:03:37.668 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-21T19:03:37.689 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-21T19:03:37.734 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-21T19:03:37.971 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bs4. 2023-07-21T19:03:37.991 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-07-21T19:03:38.029 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-21T19:03:38.179 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-21T19:03:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T19:03:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:03:38.557 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-waitress. 2023-07-21T19:03:38.576 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-21T19:03:38.621 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T19:03:39.010 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempita. 2023-07-21T19:03:39.028 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-07-21T19:03:39.068 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-21T19:03:39.446 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-paste. 2023-07-21T19:03:39.469 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-21T19:03:39.513 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T19:03:39.891 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-21T19:03:39.910 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-21T19:03:39.949 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T19:03:40.268 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-21T19:03:40.287 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-21T19:03:40.318 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-21T19:03:40.401 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-21T19:03:40.423 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-21T19:03:40.467 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-21T19:03:40.680 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webtest. 2023-07-21T19:03:40.698 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-07-21T19:03:40.787 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-21T19:03:40.863 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-21T19:03:40.884 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-21T19:03:40.929 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T19:03:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pecan. 2023-07-21T19:03:41.200 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-21T19:03:41.240 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T19:03:41.324 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-attr. 2023-07-21T19:03:41.344 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-07-21T19:03:41.382 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-21T19:03:41.687 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-21T19:03:41.706 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-21T19:03:41.744 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T19:03:41.785 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webencodings. 2023-07-21T19:03:41.805 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-21T19:03:41.843 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T19:03:42.098 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-21T19:03:42.116 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:42.156 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:42.230 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-html5lib. 2023-07-21T19:03:42.250 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-07-21T19:03:42.287 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-21T19:03:42.635 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-21T19:03:42.655 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:42.708 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-21T19:03:42.718 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:42.729 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-21T19:03:42.766 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T19:03:43.096 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cryptography. 2023-07-21T19:03:43.109 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-21T19:03:43.146 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T19:03:43.311 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-packaging. 2023-07-21T19:03:43.332 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-07-21T19:03:43.369 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-21T19:03:43.583 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-openssl. 2023-07-21T19:03:43.603 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-21T19:03:43.641 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-21T19:03:43.756 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pastescript. 2023-07-21T19:03:43.776 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-07-21T19:03:43.813 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-21T19:03:44.047 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr. 2023-07-21T19:03:44.066 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:44.104 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:44.213 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pluggy. 2023-07-21T19:03:44.233 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-07-21T19:03:44.270 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-21T19:03:44.632 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-psutil. 2023-07-21T19:03:44.633 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mon. 2023-07-21T19:03:44.652 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-21T19:03:44.652 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:44.690 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T19:03:44.690 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mon (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:45.077 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-py. 2023-07-21T19:03:45.097 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-21T19:03:45.142 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T19:03:45.546 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-21T19:03:45.567 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-21T19:03:45.596 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T19:03:45.966 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pytest. 2023-07-21T19:03:45.986 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-07-21T19:03:46.012 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-osd. 2023-07-21T19:03:46.023 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-21T19:03:46.033 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:46.068 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-osd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:46.453 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-simplejson. 2023-07-21T19:03:46.473 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-21T19:03:46.511 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T19:03:46.880 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-21T19:03:46.900 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-21T19:03:46.938 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T19:03:47.747 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package radosgw. 2023-07-21T19:03:47.767 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../116-radosgw_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:47.804 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking radosgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:48.797 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph. 2023-07-21T19:03:48.816 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../053-ceph_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:48.855 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:49.224 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-fuse. 2023-07-21T19:03:49.233 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package rbd-fuse. 2023-07-21T19:03:49.243 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:49.253 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:49.282 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:49.291 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking rbd-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:49.706 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-21T19:03:49.735 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mds. 2023-07-21T19:03:49.755 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:49.835 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mds (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:50.065 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T19:03:50.191 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T19:03:50.358 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T19:03:50.379 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephadm. 2023-07-21T19:03:50.392 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../056-cephadm_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:03:50.429 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:50.585 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:50.798 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-21T19:03:50.811 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-21T19:03:50.848 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-21T19:03:51.277 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jinja2. 2023-07-21T19:03:51.295 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-07-21T19:03:51.366 INFO:teuthology.orchestra.run.smithi145.stdout:Adding system user cephadm....done 2023-07-21T19:03:51.384 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-21T19:03:51.549 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:03:51.717 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T19:03:51.796 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-21T19:03:51.816 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:51.854 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:52.161 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-21T19:03:52.266 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-21T19:03:52.284 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-21T19:03:52.323 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T19:03:52.562 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:03:52.688 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-21T19:03:52.718 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jwt. 2023-07-21T19:03:52.737 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-21T19:03:52.776 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T19:03:52.814 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T19:03:53.162 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-21T19:03:53.181 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-07-21T19:03:53.207 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-21T19:03:53.228 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-21T19:03:53.540 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-underscore. 2023-07-21T19:03:53.559 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-21T19:03:53.598 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T19:03:53.684 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T19:03:53.934 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-21T19:03:53.953 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-21T19:03:53.991 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T19:03:54.061 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-21T19:03:54.378 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-routes. 2023-07-21T19:03:54.397 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-07-21T19:03:54.412 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-07-21T19:03:54.469 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-21T19:03:54.813 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T19:03:54.889 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-21T19:03:54.908 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:03:54.946 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:55.156 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T19:03:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-decorator. 2023-07-21T19:03:55.540 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-ceph-argparse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:03:55.545 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-21T19:03:55.624 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T19:03:56.027 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-21T19:03:56.047 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-21T19:03:56.075 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T19:03:56.085 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T19:03:56.243 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-07-21T19:03:56.463 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-scipy. 2023-07-21T19:03:56.483 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-21T19:03:56.521 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-21T19:03:56.620 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-21T19:03:56.972 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T19:03:57.374 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T19:03:57.541 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T19:03:57.963 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-21T19:03:57.983 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-21T19:03:58.001 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-21T19:03:58.021 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T19:03:58.402 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T19:03:58.600 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-joblib. 2023-07-21T19:03:58.620 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-07-21T19:03:58.699 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-21T19:03:58.746 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T19:03:59.137 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn. 2023-07-21T19:03:59.156 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-21T19:03:59.188 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T19:03:59.194 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T19:03:59.584 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-21T19:03:59.978 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-21T19:04:00.019 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-21T19:04:00.038 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:04:00.076 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:00.344 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-21T19:04:00.712 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T19:04:00.830 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T19:04:00.958 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T19:04:01.297 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cachetools. 2023-07-21T19:04:01.315 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-07-21T19:04:01.350 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T19:04:01.396 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-21T19:04:01.766 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-21T19:04:01.784 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-21T19:04:01.823 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T19:04:01.827 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-07-21T19:04:02.237 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T19:04:02.252 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-21T19:04:02.272 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-21T19:04:02.309 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T19:04:02.672 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T19:04:02.713 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rsa. 2023-07-21T19:04:02.732 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-07-21T19:04:02.770 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-21T19:04:03.115 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-21T19:04:03.140 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-google-auth. 2023-07-21T19:04:03.153 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-07-21T19:04:03.198 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-21T19:04:03.241 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:03.593 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-blinker. 2023-07-21T19:04:03.613 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-21T19:04:03.676 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:04:03.693 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T19:04:03.860 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-21T19:04:04.071 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-21T19:04:04.089 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-21T19:04:04.145 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T19:04:04.295 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T19:04:04.421 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-21T19:04:04.547 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-21T19:04:04.651 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-21T19:04:04.670 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-21T19:04:04.709 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T19:04:04.940 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T19:04:05.070 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-websocket. 2023-07-21T19:04:05.083 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-21T19:04:05.128 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T19:04:05.324 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:04:05.450 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T19:04:05.524 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-21T19:04:05.543 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-21T19:04:05.609 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T19:04:05.615 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T19:04:06.028 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T19:04:06.371 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-21T19:04:06.546 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-21T19:04:06.565 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:04:06.603 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:06.780 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T19:04:06.948 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-21T19:04:06.973 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-21T19:04:06.993 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-07-21T19:04:07.031 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-21T19:04:07.341 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-21T19:04:07.482 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-21T19:04:07.501 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:04:07.539 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:04:07.700 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T19:04:07.883 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package jq. 2023-07-21T19:04:07.903 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:04:07.941 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:04:08.118 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T19:04:08.278 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package socat. 2023-07-21T19:04:08.297 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-07-21T19:04:08.335 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-21T19:04:08.540 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-21T19:04:08.655 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package xmlstarlet. 2023-07-21T19:04:08.673 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-21T19:04:08.721 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-21T19:04:08.854 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-21T19:04:08.980 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T19:04:09.151 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-test. 2023-07-21T19:04:09.171 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:04:09.209 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-test (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:09.356 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-21T19:04:09.774 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T19:04:09.900 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T19:04:10.067 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-21T19:04:10.494 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T19:04:10.845 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-21T19:04:12.717 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:04:12.845 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-21T19:04:13.297 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-21T19:04:13.438 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-volume. 2023-07-21T19:04:13.457 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:04:13.538 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-volume (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:13.665 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-21T19:04:14.036 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-21T19:04:14.056 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:04:14.057 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:04:14.096 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-mirror (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:14.183 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-21T19:04:14.516 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-colorama. 2023-07-21T19:04:14.535 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-07-21T19:04:14.574 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-07-21T19:04:14.610 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T19:04:14.935 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-shell. 2023-07-21T19:04:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:04:14.993 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-shell (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:15.013 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-21T19:04:15.361 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-top. 2023-07-21T19:04:15.374 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4746-g81cf785a-1focal_all.deb ... 2023-07-21T19:04:15.418 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-top (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:15.488 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T19:04:15.722 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-21T19:04:15.741 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T19:04:15.779 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:04:15.897 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T19:04:16.383 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-21T19:04:16.402 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:04:16.449 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs-dev (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:16.902 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package nvme-cli. 2023-07-21T19:04:16.922 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-21T19:04:16.989 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T19:04:17.128 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T19:04:17.287 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-21T19:04:17.341 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-21T19:04:17.361 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-21T19:04:17.413 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:04:17.440 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-21T19:04:17.539 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-21T19:04:17.852 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-21T19:04:17.873 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-21T19:04:17.918 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:04:17.940 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T19:04:18.116 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-21T19:04:18.476 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T19:04:18.877 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-21T19:04:19.312 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T19:04:19.789 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librados2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:19.989 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-21T19:04:20.009 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-21T19:04:20.059 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-21T19:04:20.081 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-21T19:04:20.185 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librgw2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:20.352 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:20.479 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libcephfs2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:20.508 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-21T19:04:20.529 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-21T19:04:20.574 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T19:04:20.608 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-21T19:04:20.936 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-attr. 2023-07-21T19:04:20.956 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-07-21T19:04:20.960 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libradosstriper1 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:20.994 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-21T19:04:21.085 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-21T19:04:21.421 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webencodings. 2023-07-21T19:04:21.441 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-21T19:04:21.470 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librbd1 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:21.479 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T19:04:21.597 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-modules-core (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:21.764 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:21.840 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-html5lib. 2023-07-21T19:04:21.861 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-07-21T19:04:21.907 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-21T19:04:22.018 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T19:04:22.019 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T19:04:22.311 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-21T19:04:22.331 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-21T19:04:22.410 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T19:04:22.807 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libcephfs-dev (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:22.922 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-packaging. 2023-07-21T19:04:22.933 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rados (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:22.941 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-07-21T19:04:22.979 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-21T19:04:23.101 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up cephfs-top (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:23.227 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T19:04:23.324 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastescript. 2023-07-21T19:04:23.344 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-07-21T19:04:23.382 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-21T19:04:23.772 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pluggy. 2023-07-21T19:04:23.793 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-07-21T19:04:23.838 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-21T19:04:24.233 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-psutil. 2023-07-21T19:04:24.252 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-21T19:04:24.332 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T19:04:24.383 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rbd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:24.509 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up rbd-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:24.635 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:24.744 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-py. 2023-07-21T19:04:24.764 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-21T19:04:24.795 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cephfs (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:24.802 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T19:04:24.929 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up cephfs-shell (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:25.055 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:25.188 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-21T19:04:25.202 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-21T19:04:25.247 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T19:04:25.624 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pytest. 2023-07-21T19:04:25.638 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-07-21T19:04:25.682 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-21T19:04:25.752 INFO:teuthology.orchestra.run.smithi145.stdout:Adding group ceph....done 2023-07-21T19:04:26.103 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplejson. 2023-07-21T19:04:26.122 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-21T19:04:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T19:04:26.242 INFO:teuthology.orchestra.run.smithi145.stdout:Adding system user ceph....done 2023-07-21T19:04:26.506 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-21T19:04:26.525 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-21T19:04:26.563 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T19:04:26.640 INFO:teuthology.orchestra.run.smithi145.stdout:Setting system user ceph properties....done 2023-07-21T19:04:26.681 INFO:teuthology.orchestra.run.smithi145.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-21T19:04:26.876 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-21T19:04:27.389 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-21T19:04:27.437 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package radosgw. 2023-07-21T19:04:27.457 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../116-radosgw_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:04:27.495 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking radosgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:28.292 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up cephfs-mirror (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:28.546 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T19:04:28.546 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T19:04:28.924 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package rbd-fuse. 2023-07-21T19:04:28.943 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4746-g81cf785a-1focal_amd64.deb ... 2023-07-21T19:04:29.023 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking rbd-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:29.384 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-test (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:29.392 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-21T19:04:29.510 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up radosgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:29.805 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-21T19:04:29.825 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T19:04:29.825 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T19:04:29.931 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-21T19:04:30.056 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-21T19:04:30.308 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:31.004 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-base (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:31.106 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user cephadm....done 2023-07-21T19:04:31.281 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:04:31.440 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-21T19:04:31.541 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-21T19:04:31.858 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-21T19:04:32.209 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-21T19:04:32.335 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-21T19:04:32.431 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mds (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:32.503 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-21T19:04:32.760 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T19:04:32.761 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T19:04:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-21T19:04:33.389 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-21T19:04:33.558 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:33.740 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-21T19:04:33.826 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T19:04:33.827 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T19:04:34.091 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-07-21T19:04:34.459 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-21T19:04:34.684 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-osd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:34.811 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-21T19:04:35.195 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-argparse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:35.501 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T19:04:35.501 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T19:04:35.588 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-21T19:04:35.716 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-07-21T19:04:36.076 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-21T19:04:36.344 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:36.427 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-21T19:04:36.486 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:36.671 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mon (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:36.787 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-21T19:04:36.936 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T19:04:36.936 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T19:04:37.270 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-21T19:04:37.738 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-21T19:04:37.773 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:37.957 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:38.083 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-dashboard (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:38.097 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-21T19:04:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-volume (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:38.403 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T19:04:38.459 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-21T19:04:38.563 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T19:04:38.878 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-21T19:04:39.014 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T19:04:39.220 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-21T19:04:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-21T19:04:39.981 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-21T19:04:40.357 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-21T19:04:40.483 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-21T19:04:40.642 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-21T19:04:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-21T19:04:41.480 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-07-21T19:04:41.864 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-21T19:04:42.307 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-21T19:04:42.751 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-21T19:04:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:43.311 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:04:43.454 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-21T19:04:43.880 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-21T19:04:44.056 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-21T19:04:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-21T19:04:44.226 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-21T19:04:44.533 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-21T19:04:44.935 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:04:45.001 INFO:teuthology.orchestra.run.smithi145.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T19:04:45.008 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-21T19:04:45.060 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-21T19:04:45.130 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2023-07-21T19:04:45.228 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-21T19:04:45.328 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2023-07-21T19:04:45.329 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2023-07-21T19:04:45.506 INFO:teuthology.orchestra.run.smithi145.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-07-21T19:04:45.506 INFO:teuthology.orchestra.run.smithi145.stdout:flex is already the newest version (2.6.4-6.2). 2023-07-21T19:04:45.507 INFO:teuthology.orchestra.run.smithi145.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-07-21T19:04:45.507 INFO:teuthology.orchestra.run.smithi145.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-21T19:04:45.507 INFO:teuthology.orchestra.run.smithi145.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-21T19:04:45.507 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T19:04:45.507 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T19:04:45.508 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T19:04:45.508 INFO:teuthology.orchestra.run.smithi145.stdout:The following additional packages will be installed: 2023-07-21T19:04:45.508 INFO:teuthology.orchestra.run.smithi145.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-07-21T19:04:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-07-21T19:04:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: modemmanager network-manager-pptp postgresql-12 postgresql-client-12 2023-07-21T19:04:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-07-21T19:04:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: wpasupplicant 2023-07-21T19:04:45.509 INFO:teuthology.orchestra.run.smithi145.stdout:Suggested packages: 2023-07-21T19:04:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-07-21T19:04:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-07-21T19:04:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: libengine-pkcs11-openssl 2023-07-21T19:04:45.603 INFO:teuthology.orchestra.run.smithi145.stdout:The following NEW packages will be installed: 2023-07-21T19:04:45.603 INFO:teuthology.orchestra.run.smithi145.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-07-21T19:04:45.603 INFO:teuthology.orchestra.run.smithi145.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-07-21T19:04:45.604 INFO:teuthology.orchestra.run.smithi145.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-07-21T19:04:45.604 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-07-21T19:04:45.604 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-07-21T19:04:45.604 INFO:teuthology.orchestra.run.smithi145.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T19:04:45.605 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages will be upgraded: 2023-07-21T19:04:45.605 INFO:teuthology.orchestra.run.smithi145.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-07-21T19:04:45.621 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-21T19:04:45.722 INFO:teuthology.orchestra.run.smithi145.stdout:4 upgraded, 31 newly installed, 0 to remove and 206 not upgraded. 2023-07-21T19:04:45.722 INFO:teuthology.orchestra.run.smithi145.stdout:Need to get 25.1 MB of archives. 2023-07-21T19:04:45.722 INFO:teuthology.orchestra.run.smithi145.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-07-21T19:04:45.723 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-07-21T19:04:45.914 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-07-21T19:04:45.915 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-07-21T19:04:45.917 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-07-21T19:04:45.950 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-07-21T19:04:45.951 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-07-21T19:04:45.954 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-07-21T19:04:45.955 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-07-21T19:04:45.955 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-07-21T19:04:45.956 INFO:teuthology.orchestra.run.smithi145.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-07-21T19:04:45.957 INFO:teuthology.orchestra.run.smithi145.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-07-21T19:04:45.969 INFO:teuthology.orchestra.run.smithi145.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-07-21T19:04:45.970 INFO:teuthology.orchestra.run.smithi145.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-07-21T19:04:45.981 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-21T19:04:45.993 INFO:teuthology.orchestra.run.smithi145.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-07-21T19:04:45.994 INFO:teuthology.orchestra.run.smithi145.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-07-21T19:04:46.005 INFO:teuthology.orchestra.run.smithi145.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-07-21T19:04:46.007 INFO:teuthology.orchestra.run.smithi145.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-07-21T19:04:46.014 INFO:teuthology.orchestra.run.smithi145.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-07-21T19:04:46.014 INFO:teuthology.orchestra.run.smithi145.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-07-21T19:04:46.037 INFO:teuthology.orchestra.run.smithi145.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-07-21T19:04:46.037 INFO:teuthology.orchestra.run.smithi145.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-07-21T19:04:46.049 INFO:teuthology.orchestra.run.smithi145.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-07-21T19:04:46.068 INFO:teuthology.orchestra.run.smithi145.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-07-21T19:04:46.098 INFO:teuthology.orchestra.run.smithi145.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-07-21T19:04:46.102 INFO:teuthology.orchestra.run.smithi145.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-07-21T19:04:46.102 INFO:teuthology.orchestra.run.smithi145.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-07-21T19:04:46.103 INFO:teuthology.orchestra.run.smithi145.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-07-21T19:04:46.103 INFO:teuthology.orchestra.run.smithi145.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-07-21T19:04:46.122 INFO:teuthology.orchestra.run.smithi145.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-07-21T19:04:46.125 INFO:teuthology.orchestra.run.smithi145.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-07-21T19:04:46.341 INFO:teuthology.orchestra.run.smithi145.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-07-21T19:04:46.342 INFO:teuthology.orchestra.run.smithi145.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-07-21T19:04:46.342 INFO:teuthology.orchestra.run.smithi145.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-07-21T19:04:46.343 INFO:teuthology.orchestra.run.smithi145.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-07-21T19:04:46.344 INFO:teuthology.orchestra.run.smithi145.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-07-21T19:04:46.357 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-21T19:04:46.474 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-21T19:04:46.818 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-21T19:04:46.878 INFO:teuthology.orchestra.run.smithi145.stdout:Preconfiguring packages ... 2023-07-21T19:04:47.120 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 25.1 MB in 1s (34.3 MB/s) 2023-07-21T19:04:47.185 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-21T19:04:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-21T19:04:47.673 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T19:04:47.677 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:04:47.851 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:04:47.959 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-21T19:04:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-21T19:04:48.431 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-21T19:04:48.824 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-21T19:04:49.259 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-21T19:04:49.418 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-21T19:04:49.531 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-07-21T19:04:49.543 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-21T19:04:49.946 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-21T19:04:50.296 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-21T19:04:51.599 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T19:04:51.602 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:04:51.785 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:04:52.135 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:04:52.261 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-21T19:04:52.278 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:04:52.651 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:04:52.712 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-21T19:04:53.066 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T19:04:53.079 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-21T19:04:53.431 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-21T19:04:53.556 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-21T19:04:53.616 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T19:04:53.620 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T19:04:53.793 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-07-21T19:04:54.010 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-21T19:04:54.355 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-21T19:04:54.369 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-07-21T19:04:54.413 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-07-21T19:04:54.434 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-21T19:04:54.825 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package dump. 2023-07-21T19:04:54.846 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-07-21T19:04:54.883 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking dump (0.4b46-6) ... 2023-07-21T19:04:54.902 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-21T19:04:55.270 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package indent. 2023-07-21T19:04:55.290 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-07-21T19:04:55.311 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-21T19:04:55.328 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking indent (2.2.12-1) ... 2023-07-21T19:04:55.706 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-21T19:04:55.726 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-07-21T19:04:55.765 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T19:04:56.127 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-21T19:04:56.147 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-07-21T19:04:56.185 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T19:04:56.521 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-21T19:04:56.542 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-07-21T19:04:56.550 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-21T19:04:56.579 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T19:04:56.710 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-21T19:04:56.827 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-21T19:04:56.953 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-21T19:04:56.983 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-21T19:04:57.004 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:04:57.049 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:04:57.329 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-21T19:04:57.505 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-21T19:04:57.661 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-21T19:04:57.680 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:04:57.881 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-21T19:04:57.903 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:04:58.266 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-21T19:04:58.314 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-21T19:04:58.335 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:04:58.381 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:04:58.675 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-21T19:04:58.818 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-21T19:04:58.838 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-07-21T19:04:58.875 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T19:04:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librados2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:59.280 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-21T19:04:59.299 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T19:04:59.337 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T19:04:59.346 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-21T19:04:59.514 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librgw2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:59.643 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:59.782 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-21T19:04:59.802 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:04:59.803 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs2 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:04:59.840 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:04:59.929 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-21T19:05:00.276 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-21T19:05:00.297 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libradosstriper1 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:00.334 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:05:00.423 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-21T19:05:00.737 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-21T19:05:00.756 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:00.795 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:05:00.824 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librbd1 (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:00.992 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-modules-core (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:01.107 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-21T19:05:01.118 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:01.127 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T19:05:01.164 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T19:05:01.370 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T19:05:01.370 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T19:05:01.768 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-21T19:05:01.788 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-07-21T19:05:01.827 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-07-21T19:05:02.219 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs-dev (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:02.255 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package modemmanager. 2023-07-21T19:05:02.275 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:02.345 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rados (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:02.381 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:05:02.513 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-top (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-21T19:05:03.094 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package wpasupplicant. 2023-07-21T19:05:03.108 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-07-21T19:05:03.152 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T19:05:03.791 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package network-manager. 2023-07-21T19:05:03.803 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rbd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:03.812 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T19:05:03.893 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T19:05:03.929 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up rbd-fuse (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:04.105 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:04.231 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cephfs (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:04.398 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-shell (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:04.527 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-common (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:04.707 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ppp. 2023-07-21T19:05:04.727 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-07-21T19:05:05.160 INFO:teuthology.orchestra.run.smithi123.stdout:Adding group ceph....done 2023-07-21T19:05:05.223 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T19:05:05.640 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user ceph....done 2023-07-21T19:05:05.662 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package pptp-linux. 2023-07-21T19:05:05.684 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-07-21T19:05:05.728 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-07-21T19:05:05.871 INFO:teuthology.orchestra.run.smithi123.stdout:Setting system user ceph properties....done 2023-07-21T19:05:05.909 INFO:teuthology.orchestra.run.smithi123.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-21T19:05:06.096 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-21T19:05:06.173 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-21T19:05:06.193 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-07-21T19:05:06.266 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-07-21T19:05:06.650 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-21T19:05:06.651 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-21T19:05:06.672 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-07-21T19:05:06.709 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-07-21T19:05:07.081 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql-client-12. 2023-07-21T19:05:07.101 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:05:07.138 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:07.529 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-mirror (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:07.783 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T19:05:07.784 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T19:05:07.852 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql-common. 2023-07-21T19:05:07.872 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-07-21T19:05:07.950 INFO:teuthology.orchestra.run.smithi145.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-21T19:05:07.980 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-07-21T19:05:08.509 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql-12. 2023-07-21T19:05:08.528 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:05:08.574 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:08.639 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-test (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:08.764 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up radosgw (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:09.083 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T19:05:09.083 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T19:05:10.237 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql. 2023-07-21T19:05:10.257 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-07-21T19:05:10.295 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-07-21T19:05:10.325 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-base (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:10.614 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql-client. 2023-07-21T19:05:10.636 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-07-21T19:05:10.672 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-07-21T19:05:10.872 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-21T19:05:10.984 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-21T19:05:11.004 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-07-21T19:05:11.049 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T19:05:11.369 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-21T19:05:11.390 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-07-21T19:05:11.435 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-07-21T19:05:11.776 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mds (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:11.922 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-21T19:05:11.942 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-07-21T19:05:12.010 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T19:05:12.049 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T19:05:12.050 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T19:05:12.383 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-07-21T19:05:12.619 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T19:05:12.903 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:13.037 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:13.185 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T19:05:13.185 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T19:05:13.196 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-07-21T19:05:13.323 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T19:05:13.448 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T19:05:13.923 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T19:05:13.923 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T19:05:14.029 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-osd (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:14.839 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T19:05:14.839 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T19:05:14.854 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:15.664 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:15.790 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:15.983 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mon (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:16.235 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T19:05:16.235 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T19:05:16.997 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-21T19:05:17.084 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-cephadm (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:17.149 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T19:05:17.236 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:17.284 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-07-21T19:05:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-dashboard (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:17.419 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-07-21T19:05:17.570 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-volume (18.0.0-4746-g81cf785a-1focal) ... 2023-07-21T19:05:17.697 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T19:05:17.890 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T19:05:18.334 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T19:05:19.137 INFO:teuthology.orchestra.run.smithi145.stdout:Adding user postgres to group ssl-cert 2023-07-21T19:05:19.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:19.545 INFO:teuthology.orchestra.run.smithi145.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-21T19:05:20.023 INFO:teuthology.orchestra.run.smithi145.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-21T19:05:20.023 INFO:teuthology.orchestra.run.smithi145.stdout:Removing obsolete dictionary files: 2023-07-21T19:05:20.571 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-21T19:05:21.920 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T19:05:22.046 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-07-21T19:05:22.215 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T19:05:22.340 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T19:05:22.466 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T19:05:23.437 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-21T19:05:23.767 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-07-21T19:05:24.221 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up dump (0.4b46-6) ... 2023-07-21T19:05:24.321 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T19:05:24.322 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-21T19:05:24.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-21T19:05:24.415 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:05:24.447 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-07-21T19:05:24.541 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T19:05:24.644 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-07-21T19:05:24.645 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-07-21T19:05:24.667 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up indent (2.2.12-1) ... 2023-07-21T19:05:24.830 INFO:teuthology.orchestra.run.smithi123.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-07-21T19:05:24.831 INFO:teuthology.orchestra.run.smithi123.stdout:flex is already the newest version (2.6.4-6.2). 2023-07-21T19:05:24.831 INFO:teuthology.orchestra.run.smithi123.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-07-21T19:05:24.831 INFO:teuthology.orchestra.run.smithi123.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-21T19:05:24.831 INFO:teuthology.orchestra.run.smithi123.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-21T19:05:24.831 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T19:05:24.833 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T19:05:24.833 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T19:05:24.833 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2023-07-21T19:05:24.834 INFO:teuthology.orchestra.run.smithi123.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-07-21T19:05:24.834 INFO:teuthology.orchestra.run.smithi123.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-07-21T19:05:24.834 INFO:teuthology.orchestra.run.smithi123.stdout: modemmanager network-manager-pptp postgresql-12 postgresql-client-12 2023-07-21T19:05:24.834 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-07-21T19:05:24.834 INFO:teuthology.orchestra.run.smithi123.stdout: wpasupplicant 2023-07-21T19:05:24.835 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T19:05:24.835 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2023-07-21T19:05:24.835 INFO:teuthology.orchestra.run.smithi123.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-07-21T19:05:24.835 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-07-21T19:05:24.835 INFO:teuthology.orchestra.run.smithi123.stdout: libengine-pkcs11-openssl 2023-07-21T19:05:24.929 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2023-07-21T19:05:24.930 INFO:teuthology.orchestra.run.smithi123.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-07-21T19:05:24.930 INFO:teuthology.orchestra.run.smithi123.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-07-21T19:05:24.930 INFO:teuthology.orchestra.run.smithi123.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-07-21T19:05:24.930 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-07-21T19:05:24.931 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-07-21T19:05:24.931 INFO:teuthology.orchestra.run.smithi123.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T19:05:24.932 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2023-07-21T19:05:24.932 INFO:teuthology.orchestra.run.smithi123.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-07-21T19:05:25.019 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T19:05:25.112 INFO:teuthology.orchestra.run.smithi123.stdout:4 upgraded, 31 newly installed, 0 to remove and 206 not upgraded. 2023-07-21T19:05:25.112 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 25.1 MB of archives. 2023-07-21T19:05:25.113 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-07-21T19:05:25.113 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-07-21T19:05:25.145 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:25.706 INFO:teuthology.orchestra.run.smithi145.stdout:Creating new PostgreSQL cluster 12/main ... 2023-07-21T19:05:25.708 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-07-21T19:05:25.710 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-07-21T19:05:25.712 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-07-21T19:05:25.732 INFO:teuthology.orchestra.run.smithi145.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-07-21T19:05:25.811 INFO:teuthology.orchestra.run.smithi145.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-21T19:05:25.811 INFO:teuthology.orchestra.run.smithi145.stdout:This user must also own the server process. 2023-07-21T19:05:25.812 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:25.812 INFO:teuthology.orchestra.run.smithi145.stdout:The database cluster will be initialized with locale "en_US". 2023-07-21T19:05:25.812 INFO:teuthology.orchestra.run.smithi145.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-21T19:05:25.812 INFO:teuthology.orchestra.run.smithi145.stdout:The default text search configuration will be set to "english". 2023-07-21T19:05:25.812 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:25.812 INFO:teuthology.orchestra.run.smithi145.stdout:Data page checksums are disabled. 2023-07-21T19:05:25.813 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:25.813 INFO:teuthology.orchestra.run.smithi145.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-07-21T19:05:25.815 INFO:teuthology.orchestra.run.smithi145.stdout:creating subdirectories ... ok 2023-07-21T19:05:25.815 INFO:teuthology.orchestra.run.smithi145.stdout:selecting dynamic shared memory implementation ... posix 2023-07-21T19:05:25.850 INFO:teuthology.orchestra.run.smithi145.stdout:selecting default max_connections ... 100 2023-07-21T19:05:25.867 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-07-21T19:05:25.868 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-07-21T19:05:25.894 INFO:teuthology.orchestra.run.smithi145.stdout:selecting default shared_buffers ... 128MB 2023-07-21T19:05:25.902 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-07-21T19:05:25.908 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-07-21T19:05:25.909 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-07-21T19:05:25.911 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-07-21T19:05:25.913 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-07-21T19:05:25.916 INFO:teuthology.orchestra.run.smithi145.stdout:selecting default time zone ... Etc/UTC 2023-07-21T19:05:25.916 INFO:teuthology.orchestra.run.smithi145.stdout:creating configuration files ... ok 2023-07-21T19:05:25.924 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-07-21T19:05:25.924 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-07-21T19:05:26.019 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-07-21T19:05:26.020 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-07-21T19:05:26.104 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-07-21T19:05:26.106 INFO:teuthology.orchestra.run.smithi145.stdout:running bootstrap script ... ok 2023-07-21T19:05:26.107 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-07-21T19:05:26.208 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-07-21T19:05:26.209 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-07-21T19:05:26.249 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-07-21T19:05:26.249 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-07-21T19:05:26.379 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-07-21T19:05:26.387 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-07-21T19:05:26.422 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-07-21T19:05:26.425 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-07-21T19:05:26.427 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-07-21T19:05:26.428 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-07-21T19:05:26.428 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-07-21T19:05:26.465 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-07-21T19:05:26.467 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-07-21T19:05:26.782 INFO:teuthology.orchestra.run.smithi145.stdout:performing post-bootstrap initialization ... ok 2023-07-21T19:05:26.957 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-07-21T19:05:26.958 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-07-21T19:05:26.958 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-07-21T19:05:26.958 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-07-21T19:05:26.959 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-07-21T19:05:27.352 INFO:teuthology.orchestra.run.smithi145.stdout:syncing data to disk ... ok 2023-07-21T19:05:27.353 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:27.353 INFO:teuthology.orchestra.run.smithi145.stdout:Success. You can now start the database server using: 2023-07-21T19:05:27.353 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:27.353 INFO:teuthology.orchestra.run.smithi145.stdout: pg_ctlcluster 12 main start 2023-07-21T19:05:27.353 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:27.516 INFO:teuthology.orchestra.run.smithi123.stdout:Preconfiguring packages ... 2023-07-21T19:05:27.756 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 25.1 MB in 2s (12.4 MB/s) 2023-07-21T19:05:27.891 INFO:teuthology.orchestra.run.smithi145.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-07-21T19:05:27.891 INFO:teuthology.orchestra.run.smithi145.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-07-21T19:05:28.102 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-21T19:05:28.116 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T19:05:28.119 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:05:28.330 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:05:30.097 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-07-21T19:05:31.869 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:05:31.995 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-07-21T19:05:32.086 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T19:05:32.089 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:05:32.222 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-07-21T19:05:32.246 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:05:32.347 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T19:05:32.714 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:05:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:05:33.272 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T19:05:33.619 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:33.619 INFO:teuthology.orchestra.run.smithi145.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-21T19:05:33.619 INFO:teuthology.orchestra.run.smithi145.stdout:which means they are currently configured by ifupdown: 2023-07-21T19:05:33.619 INFO:teuthology.orchestra.run.smithi145.stdout:- enp3s0f1 2023-07-21T19:05:33.620 INFO:teuthology.orchestra.run.smithi145.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-21T19:05:33.620 INFO:teuthology.orchestra.run.smithi145.stdout:remove their configuration from /etc/network/interfaces. 2023-07-21T19:05:33.620 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:05:33.846 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-21T19:05:33.961 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-21T19:05:33.964 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T19:05:34.145 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-07-21T19:05:34.402 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-21T19:05:34.748 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-21T19:05:34.772 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-07-21T19:05:34.840 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-07-21T19:05:35.243 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package dump. 2023-07-21T19:05:35.264 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-07-21T19:05:35.301 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking dump (0.4b46-6) ... 2023-07-21T19:05:35.378 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-21T19:05:35.622 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package indent. 2023-07-21T19:05:35.642 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-07-21T19:05:35.680 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking indent (2.2.12-1) ... 2023-07-21T19:05:36.058 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-21T19:05:36.078 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-07-21T19:05:36.116 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T19:05:36.342 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:05:36.477 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-07-21T19:05:36.519 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-21T19:05:36.540 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-07-21T19:05:36.577 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T19:05:36.686 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T19:05:36.812 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-07-21T19:05:36.914 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-21T19:05:36.933 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-07-21T19:05:36.938 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:05:36.988 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T19:05:37.098 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:05:37.240 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:05:37.434 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-21T19:05:37.454 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:37.542 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:05:37.552 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T19:05:37.553 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T19:05:37.844 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-21T19:05:37.864 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:37.927 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:05:38.314 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-21T19:05:38.334 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:38.371 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:05:38.543 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-07-21T19:05:38.652 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-21T19:05:38.787 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T19:05:38.980 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T19:05:39.250 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-21T19:05:39.271 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-07-21T19:05:39.308 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T19:05:39.481 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T19:05:39.711 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-21T19:05:39.732 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T19:05:39.769 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T19:05:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-21T19:05:40.225 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:05:40.288 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:40.717 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-21T19:05:40.737 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:40.775 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:05:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-21T19:05:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:41.227 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:05:41.546 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-21T19:05:41.566 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-21T19:05:41.604 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T19:05:42.216 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-21T19:05:42.237 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-07-21T19:05:42.283 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-07-21T19:05:42.744 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package modemmanager. 2023-07-21T19:05:42.758 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T19:05:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:05:43.550 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package wpasupplicant. 2023-07-21T19:05:43.572 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-07-21T19:05:43.608 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T19:05:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager. 2023-07-21T19:05:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-21T19:05:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T19:05:45.145 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ppp. 2023-07-21T19:05:45.166 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-07-21T19:05:45.624 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T19:05:46.050 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package pptp-linux. 2023-07-21T19:05:46.070 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-07-21T19:05:46.108 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-07-21T19:05:46.553 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-21T19:05:46.573 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-07-21T19:05:46.665 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-07-21T19:05:47.032 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-21T19:05:47.051 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-07-21T19:05:47.089 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-07-21T19:05:47.469 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client-12. 2023-07-21T19:05:47.490 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:05:47.576 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-common. 2023-07-21T19:05:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-07-21T19:05:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-21T19:05:48.392 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-07-21T19:05:48.921 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-12. 2023-07-21T19:05:48.941 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-21T19:05:48.986 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:50.632 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql. 2023-07-21T19:05:50.652 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-07-21T19:05:50.690 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-07-21T19:05:51.017 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client. 2023-07-21T19:05:51.038 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-07-21T19:05:51.075 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-07-21T19:05:51.403 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-21T19:05:51.423 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-07-21T19:05:51.460 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T19:05:51.765 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-21T19:05:51.786 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-07-21T19:05:51.837 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-07-21T19:05:52.291 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-21T19:05:52.312 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-07-21T19:05:52.370 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T19:05:52.730 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-07-21T19:05:52.934 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-21T19:05:52.984 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T19:05:53.042 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-21T19:05:53.381 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:53.507 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-07-21T19:05:53.633 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-07-21T19:05:53.793 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-21T19:05:54.262 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T19:05:54.263 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T19:05:54.301 INFO:teuthology.orchestra.run.smithi145.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T19:05:54.307 DEBUG:teuthology.parallel:result is None 2023-07-21T19:05:55.187 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:05:57.374 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-21T19:05:57.484 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-21T19:05:57.643 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-07-21T19:05:57.769 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-07-21T19:05:59.098 INFO:teuthology.orchestra.run.smithi123.stdout:Adding user postgres to group ssl-cert 2023-07-21T19:05:59.536 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:05:59.537 INFO:teuthology.orchestra.run.smithi123.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-21T19:06:00.028 INFO:teuthology.orchestra.run.smithi123.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-21T19:06:00.029 INFO:teuthology.orchestra.run.smithi123.stdout:Removing obsolete dictionary files: 2023-07-21T19:06:00.549 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-21T19:06:02.019 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-21T19:06:02.145 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-07-21T19:06:02.304 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-21T19:06:02.430 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-21T19:06:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-21T19:06:03.871 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-07-21T19:06:04.304 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up dump (0.4b46-6) ... 2023-07-21T19:06:04.414 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-21T19:06:04.530 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:06:04.656 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-21T19:06:04.782 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up indent (2.2.12-1) ... 2023-07-21T19:06:04.950 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-21T19:06:05.136 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-21T19:06:05.294 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-21T19:06:05.812 INFO:teuthology.orchestra.run.smithi123.stdout:Creating new PostgreSQL cluster 12/main ... 2023-07-21T19:06:05.849 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-07-21T19:06:05.917 INFO:teuthology.orchestra.run.smithi123.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-21T19:06:05.917 INFO:teuthology.orchestra.run.smithi123.stdout:This user must also own the server process. 2023-07-21T19:06:05.917 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout:The database cluster will be initialized with locale "en_US". 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout:The default text search configuration will be set to "english". 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout:Data page checksums are disabled. 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:05.918 INFO:teuthology.orchestra.run.smithi123.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-07-21T19:06:05.921 INFO:teuthology.orchestra.run.smithi123.stdout:creating subdirectories ... ok 2023-07-21T19:06:05.921 INFO:teuthology.orchestra.run.smithi123.stdout:selecting dynamic shared memory implementation ... posix 2023-07-21T19:06:05.958 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default max_connections ... 100 2023-07-21T19:06:06.007 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default shared_buffers ... 128MB 2023-07-21T19:06:06.029 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default time zone ... Etc/UTC 2023-07-21T19:06:06.029 INFO:teuthology.orchestra.run.smithi123.stdout:creating configuration files ... ok 2023-07-21T19:06:06.220 INFO:teuthology.orchestra.run.smithi123.stdout:running bootstrap script ... ok 2023-07-21T19:06:06.881 INFO:teuthology.orchestra.run.smithi123.stdout:performing post-bootstrap initialization ... ok 2023-07-21T19:06:07.417 INFO:teuthology.orchestra.run.smithi123.stdout:syncing data to disk ... ok 2023-07-21T19:06:07.417 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:07.417 INFO:teuthology.orchestra.run.smithi123.stdout:Success. You can now start the database server using: 2023-07-21T19:06:07.417 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:07.417 INFO:teuthology.orchestra.run.smithi123.stdout: pg_ctlcluster 12 main start 2023-07-21T19:06:07.418 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:07.958 INFO:teuthology.orchestra.run.smithi123.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-07-21T19:06:07.959 INFO:teuthology.orchestra.run.smithi123.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-07-21T19:06:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-21T19:06:11.743 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:06:11.910 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-07-21T19:06:12.078 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-07-21T19:06:12.237 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-07-21T19:06:13.423 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:13.423 INFO:teuthology.orchestra.run.smithi123.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-21T19:06:13.423 INFO:teuthology.orchestra.run.smithi123.stdout:which means they are currently configured by ifupdown: 2023-07-21T19:06:13.423 INFO:teuthology.orchestra.run.smithi123.stdout:- enp3s0f1 2023-07-21T19:06:13.424 INFO:teuthology.orchestra.run.smithi123.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-21T19:06:13.424 INFO:teuthology.orchestra.run.smithi123.stdout:remove their configuration from /etc/network/interfaces. 2023-07-21T19:06:13.424 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:13.648 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-21T19:06:14.189 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-21T19:06:15.107 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-21T19:06:16.099 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-21T19:06:16.233 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-07-21T19:06:16.401 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-07-21T19:06:16.560 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-07-21T19:06:16.686 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:06:16.853 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-21T19:06:16.979 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-21T19:06:17.295 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T19:06:17.296 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T19:06:18.267 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-07-21T19:06:18.402 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-21T19:06:18.536 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T19:06:18.696 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T19:06:19.230 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T19:06:32.993 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-21T19:06:33.109 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-21T19:06:34.321 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T19:06:34.326 DEBUG:teuthology.parallel:result is None 2023-07-21T19:06:34.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=81cf785aa7781c4e08381c540f890cb9bc987ef9 2023-07-21T19:06:34.643 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-query -W -f '${Version}' ceph 2023-07-21T19:06:34.679 INFO:teuthology.orchestra.run.smithi123.stdout:18.0.0-4746-g81cf785a-1focal 2023-07-21T19:06:34.680 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4746-g81cf785a-1focal 2023-07-21T19:06:34.680 INFO:teuthology.task.install:The correct ceph version 18.0.0-4746-g81cf785a-1focal is installed. 2023-07-21T19:06:34.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=81cf785aa7781c4e08381c540f890cb9bc987ef9 2023-07-21T19:06:34.988 DEBUG:teuthology.orchestra.run.smithi145:> dpkg-query -W -f '${Version}' ceph 2023-07-21T19:06:35.029 INFO:teuthology.orchestra.run.smithi145.stdout:18.0.0-4746-g81cf785a-1focal 2023-07-21T19:06:35.030 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4746-g81cf785a-1focal 2023-07-21T19:06:35.030 INFO:teuthology.task.install:The correct ceph version 18.0.0-4746-g81cf785a-1focal is installed. 2023-07-21T19:06:35.030 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-21T19:06:35.031 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:35.031 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T19:06:35.067 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:35.067 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T19:06:35.113 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-21T19:06:35.113 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:35.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T19:06:35.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T19:06:35.227 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:35.227 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T19:06:35.261 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T19:06:35.341 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-21T19:06:35.341 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:35.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T19:06:35.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T19:06:35.452 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:35.452 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T19:06:35.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T19:06:35.564 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-21T19:06:35.565 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:35.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T19:06:35.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T19:06:35.674 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:35.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T19:06:35.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T19:06:35.784 INFO:teuthology.run_tasks:Running task ceph... 2023-07-21T19:06:35.856 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-21T19:06:35.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2023-07-21T19:06:35.864 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2023-07-21T19:06:35.896 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-21T19:06:35.897 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T19:06:35.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T19:06:35.975 INFO:tasks.ceph:Creating extra log directories... 2023-07-21T19:06:35.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T19:06:36.013 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T19:06:36.061 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-21T19:06:36.061 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-21T19:06:36.061 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-21T19:06:36.062 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:36.062 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T19:06:36.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T19:06:36.243 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:36.244 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T19:06:36.262 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T19:06:36.406 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-21T19:06:36.406 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-21T19:06:36.407 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871', 'branch': 'wip-rishabh-2023Jul13-m-quota', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7346871', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul13-m-quota'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul13-m-quota', 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul13-m-quota', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi145.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81cf785aa7781c4e08381c540f890cb9bc987ef9'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '79491cb69dd37a1eafb93b3471998174bdfa2fd9', 'timestamp': '2023-07-21_17:58:19', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-21T19:06:36.408 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T19:06:36.416 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T19:06:36.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T19:06:36.477 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T19:06:36.512 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:36.513 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T19:06:36.567 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T19:06:36.568 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2023-07-21T19:06:36.630 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T19:06:36.630 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:36.630 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-07-21T19:06:36.631 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:36.631 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-21 18:58:00.897404211 +0000 2023-07-21T19:06:36.631 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-21 18:58:00.405426332 +0000 2023-07-21T19:06:36.632 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-21 18:58:00.405426332 +0000 2023-07-21T19:06:36.632 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-21T19:06:36.633 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T19:06:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-21T19:06:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-21T19:06:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000705425 s, 726 kB/s 2023-07-21T19:06:36.704 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T19:06:36.770 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2023-07-21T19:06:36.830 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T19:06:36.830 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:36.830 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-07-21T19:06:36.830 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:36.830 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-21 18:58:01.193394925 +0000 2023-07-21T19:06:36.831 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-21 18:58:01.189395021 +0000 2023-07-21T19:06:36.831 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-21 18:58:01.189395021 +0000 2023-07-21T19:06:36.831 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-21T19:06:36.831 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T19:06:36.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-21T19:06:36.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-21T19:06:36.902 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000740708 s, 691 kB/s 2023-07-21T19:06:36.904 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T19:06:36.972 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2023-07-21T19:06:37.033 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T19:06:37.034 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:37.034 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-07-21T19:06:37.034 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:37.034 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-21 18:58:02.417365603 +0000 2023-07-21T19:06:37.034 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-21 18:58:01.953376718 +0000 2023-07-21T19:06:37.035 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-21 18:58:01.953376718 +0000 2023-07-21T19:06:37.035 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-21T19:06:37.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T19:06:37.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-21T19:06:37.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-21T19:06:37.110 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000540532 s, 947 kB/s 2023-07-21T19:06:37.111 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T19:06:37.179 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2023-07-21T19:06:37.241 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T19:06:37.242 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:37.242 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-07-21T19:06:37.242 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:37.242 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-21 18:58:03.161347783 +0000 2023-07-21T19:06:37.242 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-21 18:58:02.721358322 +0000 2023-07-21T19:06:37.242 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-21 18:58:02.721358322 +0000 2023-07-21T19:06:37.243 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-21T19:06:37.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T19:06:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-21T19:06:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-21T19:06:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000599247 s, 854 kB/s 2023-07-21T19:06:37.319 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T19:06:37.386 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:37.387 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:37.387 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T19:06:37.407 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T19:06:37.407 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2023-07-21T19:06:37.471 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T19:06:37.471 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:37.472 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-07-21T19:06:37.472 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:37.472 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-07-21 18:58:00.838312097 +0000 2023-07-21T19:06:37.473 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-07-21 18:58:00.354323259 +0000 2023-07-21T19:06:37.473 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-07-21 18:58:00.354323259 +0000 2023-07-21T19:06:37.473 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2023-07-21T19:06:37.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T19:06:37.543 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-07-21T19:06:37.543 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-07-21T19:06:37.543 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000709132 s, 722 kB/s 2023-07-21T19:06:37.545 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T19:06:37.617 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2023-07-21T19:06:37.679 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T19:06:37.679 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:37.679 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-07-21T19:06:37.679 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:37.680 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-07-21 18:58:01.602294478 +0000 2023-07-21T19:06:37.680 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-07-21 18:58:01.130305363 +0000 2023-07-21T19:06:37.680 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-07-21 18:58:01.130305363 +0000 2023-07-21T19:06:37.680 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2023-07-21T19:06:37.681 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T19:06:37.750 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-07-21T19:06:37.751 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-07-21T19:06:37.751 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000677321 s, 756 kB/s 2023-07-21T19:06:37.752 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T19:06:37.820 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2023-07-21T19:06:37.882 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 509 Links: 1 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-07-21 18:58:02.370276767 +0000 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-07-21 18:58:01.902287559 +0000 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-07-21 18:58:01.902287559 +0000 2023-07-21T19:06:37.883 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2023-07-21T19:06:37.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T19:06:37.954 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-07-21T19:06:37.954 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-07-21T19:06:37.955 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000568816 s, 900 kB/s 2023-07-21T19:06:37.956 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T19:06:38.024 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2023-07-21T19:06:38.086 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T19:06:38.086 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T19:06:38.086 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-07-21T19:06:38.087 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T19:06:38.087 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-07-21 18:58:03.150258779 +0000 2023-07-21T19:06:38.087 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-07-21 18:58:02.698269203 +0000 2023-07-21T19:06:38.088 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-07-21 18:58:02.698269203 +0000 2023-07-21T19:06:38.088 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2023-07-21T19:06:38.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T19:06:38.159 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-07-21T19:06:38.159 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-07-21T19:06:38.159 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00069876 s, 733 kB/s 2023-07-21T19:06:38.161 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T19:06:38.228 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:38.228 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T19:06:38.228 INFO:tasks.ceph:Generating config... 2023-07-21T19:06:38.230 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-21T19:06:38.230 INFO:tasks.ceph:[client] debug client = 20 2023-07-21T19:06:38.230 INFO:tasks.ceph:[client] debug ms = 1 2023-07-21T19:06:38.230 INFO:tasks.ceph:[client] pid file = 2023-07-21T19:06:38.230 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-21T19:06:38.231 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-21T19:06:38.231 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-21T19:06:38.231 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-21T19:06:38.231 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-21T19:06:38.231 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-21T19:06:38.232 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-21T19:06:38.232 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-21T19:06:38.232 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-21T19:06:38.232 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-21T19:06:38.232 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-21T19:06:38.233 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-21T19:06:38.233 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-21T19:06:38.233 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-21T19:06:38.233 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-21T19:06:38.233 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-21T19:06:38.234 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-21T19:06:38.234 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-21T19:06:38.234 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-21T19:06:38.234 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-21T19:06:38.234 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-21T19:06:38.235 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-21T19:06:38.235 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-21T19:06:38.235 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-21T19:06:38.235 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-21T19:06:38.235 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-21T19:06:38.236 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-21T19:06:38.236 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-21T19:06:38.236 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-21T19:06:38.236 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-21T19:06:38.236 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-21T19:06:38.237 INFO:tasks.ceph:Setting up mon.a... 2023-07-21T19:06:38.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-21T19:06:38.307 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2023-07-21T19:06:38.347 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-21T19:06:38.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T19:06:38.456 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.145'), ('mon.c', '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]')] 2023-07-21T19:06:38.457 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-21T19:06:38.458 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:38.459 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T19:06:38.515 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.145 --addv c '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:38.628 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:38.628 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid 786ff8a7-6b4c-4933-876c-0b96df73a43e 2023-07-21T19:06:38.628 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = pacific 2023-07-21T19:06:38.629 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2023-07-21T19:06:38.629 INFO:teuthology.orchestra.run.smithi123.stdout:fsid 786ff8a7-6b4c-4933-876c-0b96df73a43e 2023-07-21T19:06:38.629 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2023-07-21T19:06:38.618962+0000 2023-07-21T19:06:38.629 INFO:teuthology.orchestra.run.smithi123.stdout:created 2023-07-21T19:06:38.618962+0000 2023-07-21T19:06:38.630 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 16 (pacific) 2023-07-21T19:06:38.630 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2023-07-21T19:06:38.630 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2023-07-21T19:06:38.631 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2023-07-21T19:06:38.631 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] mon.c 2023-07-21T19:06:38.631 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-21T19:06:38.632 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T19:06:38.652 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 786ff8a7-6b4c-4933-876c-0b96df73a43e... 2023-07-21T19:06:38.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T19:06:38.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T19:06:38.775 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2023-07-21T19:06:38.776 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2023-07-21T19:06:38.776 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T19:06:38.776 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2023-07-21T19:06:38.777 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.777 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2023-07-21T19:06:38.777 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.777 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2023-07-21T19:06:38.777 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.777 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2023-07-21T19:06:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2023-07-21T19:06:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2023-07-21T19:06:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2023-07-21T19:06:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T19:06:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2023-07-21T19:06:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T19:06:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T19:06:38.780 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.780 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2023-07-21T19:06:38.780 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.780 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2023-07-21T19:06:38.780 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2023-07-21T19:06:38.780 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2023-07-21T19:06:38.781 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2023-07-21T19:06:38.781 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2023-07-21T19:06:38.781 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2023-07-21T19:06:38.781 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2023-07-21T19:06:38.781 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T19:06:38.782 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T19:06:38.782 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2023-07-21T19:06:38.782 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.782 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T19:06:38.782 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2023-07-21T19:06:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2023-07-21T19:06:38.784 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2023-07-21T19:06:38.784 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 786ff8a7-6b4c-4933-876c-0b96df73a43e 2023-07-21T19:06:38.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.784 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2023-07-21T19:06:38.784 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2023-07-21T19:06:38.785 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2023-07-21T19:06:38.786 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.786 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2023-07-21T19:06:38.786 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2023-07-21T19:06:38.786 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2023-07-21T19:06:38.786 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.786 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2023-07-21T19:06:38.787 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2023-07-21T19:06:38.787 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.787 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2023-07-21T19:06:38.787 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.788 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2023-07-21T19:06:38.788 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.788 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2023-07-21T19:06:38.788 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.789 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2023-07-21T19:06:38.789 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2023-07-21T19:06:38.789 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.789 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2023-07-21T19:06:38.790 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2023-07-21T19:06:38.790 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2023-07-21T19:06:38.790 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2023-07-21T19:06:38.791 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 20 2023-07-21T19:06:38.791 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 20 2023-07-21T19:06:38.791 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-21T19:06:38.791 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2023-07-21T19:06:38.792 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 10 2023-07-21T19:06:38.792 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T19:06:38.792 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2023-07-21T19:06:38.792 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2023-07-21T19:06:38.793 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2023-07-21T19:06:38.793 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2023-07-21T19:06:38.793 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-07-21T19:06:38.793 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.793 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2023-07-21T19:06:38.794 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-21T19:06:38.794 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2023-07-21T19:06:38.794 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-07-21T19:06:38.794 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-07-21T19:06:38.794 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-07-21T19:06:38.794 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-07-21T19:06:38.795 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.796 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.797 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2023-07-21T19:06:38.798 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2023-07-21T19:06:38.798 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.798 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2023-07-21T19:06:38.798 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2023-07-21T19:06:38.798 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:06:38.798 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2023-07-21T19:06:38.799 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-21T19:06:38.800 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2023-07-21T19:06:38.800 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-07-21T19:06:38.800 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-07-21T19:06:38.800 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2023-07-21T19:06:38.800 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2023-07-21T19:06:38.800 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2023-07-21T19:06:38.801 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-07-21T19:06:38.802 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-07-21T19:06:38.803 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2023-07-21T19:06:38.803 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2023-07-21T19:06:38.803 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.804 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2023-07-21T19:06:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2023-07-21T19:06:38.806 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T19:06:38.807 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2023-07-21T19:06:38.808 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.808 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T19:06:38.808 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.808 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2023-07-21T19:06:38.808 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.808 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.123,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 786ff8a7-6b4c-4933-876c-0b96df73a43e 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.809 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.810 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2023-07-21T19:06:38.811 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2023-07-21T19:06:38.811 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.811 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2023-07-21T19:06:38.811 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2023-07-21T19:06:38.811 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2023-07-21T19:06:38.812 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.812 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2023-07-21T19:06:38.812 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2023-07-21T19:06:38.812 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.813 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2023-07-21T19:06:38.813 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.813 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2023-07-21T19:06:38.813 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.813 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2023-07-21T19:06:38.814 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T19:06:38.815 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2023-07-21T19:06:38.816 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.817 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2023-07-21T19:06:38.818 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T19:06:38.819 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.820 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2023-07-21T19:06:38.821 INFO:teuthology.orchestra.run.smithi145.stdout: mon op complaint time = 120 2023-07-21T19:06:38.821 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T19:06:38.821 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2023-07-21T19:06:38.821 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2023-07-21T19:06:38.821 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2023-07-21T19:06:38.821 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 600 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = "" 2023-07-21T19:06:38.822 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2023-07-21T19:06:38.823 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2023-07-21T19:06:38.824 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2023-07-21T19:06:38.824 INFO:teuthology.orchestra.run.smithi145.stdout:[mds] 2023-07-21T19:06:38.824 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds = 20 2023-07-21T19:06:38.824 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds balancer = 20 2023-07-21T19:06:38.824 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-07-21T19:06:38.824 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug frag = True 2023-07-21T19:06:38.825 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug scatterstat = True 2023-07-21T19:06:38.825 INFO:teuthology.orchestra.run.smithi145.stdout: mds op complaint time = 180 2023-07-21T19:06:38.825 INFO:teuthology.orchestra.run.smithi145.stdout: mds verify scatter = True 2023-07-21T19:06:38.825 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2023-07-21T19:06:38.825 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2023-07-21T19:06:38.825 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2023-07-21T19:06:38.827 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-21T19:06:38.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-21T19:06:38.918 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-21T19:06:38.919 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:38.919 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-21T19:06:38.937 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:38.938 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-21T19:06:39.002 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:06:39.002 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:39.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T19:06:39.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T19:06:39.103 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:06:39.104 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:39.167 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:06:39.167 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:39.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T19:06:39.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T19:06:39.229 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:06:39.230 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:39.294 INFO:tasks.ceph:Setting up mon nodes... 2023-07-21T19:06:39.294 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-21T19:06:39.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T19:06:39.398 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T19:06:39.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T19:06:39.507 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T19:06:39.532 INFO:tasks.ceph:Setting up mds nodes... 2023-07-21T19:06:39.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T19:06:39.631 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T19:06:39.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-21T19:06:39.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T19:06:39.817 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T19:06:39.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-21T19:06:39.858 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T19:06:39.960 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T19:06:39.967 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-21T19:06:40.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T19:06:40.143 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T19:06:40.150 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-21T19:06:40.183 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-21T19:06:40.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-21T19:06:40.260 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-21T19:06:40.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-21T19:06:40.362 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-21T19:06:40.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-21T19:06:40.463 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-21T19:06:40.493 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-21T19:06:40.567 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-21T19:06:40.592 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-21T19:06:40.593 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T19:06:40.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-21T19:06:40.629 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:40.629 INFO:tasks.ceph:role: osd.0 2023-07-21T19:06:40.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:06:40.629 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T19:06:41.239 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:41.240 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:41.240 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:41.240 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-07-21T19:06:41.240 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:41.240 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:41.241 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:41.241 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:41.241 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:41.241 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:41.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-21T19:06:41.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-21T19:06:41.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-21T19:06:41.396 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:41.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:41.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-21T19:06:41.480 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:41.480 INFO:tasks.ceph:role: osd.1 2023-07-21T19:06:41.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:06:41.481 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T19:06:42.033 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:42.034 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:42.034 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:42.034 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-07-21T19:06:42.034 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:42.034 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:42.034 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:42.035 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:42.035 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:42.035 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:42.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-21T19:06:42.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-21T19:06:42.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-21T19:06:42.136 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:42.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:42.138 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-21T19:06:42.214 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:42.214 INFO:tasks.ceph:role: osd.2 2023-07-21T19:06:42.214 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:06:42.215 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T19:06:42.810 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:42.811 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:42.811 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:42.811 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-07-21T19:06:42.811 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:42.811 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:42.811 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:42.812 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:42.812 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:42.812 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:42.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-21T19:06:42.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-21T19:06:42.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-21T19:06:42.962 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:42.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:42.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-21T19:06:43.041 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:43.042 INFO:tasks.ceph:role: osd.3 2023-07-21T19:06:43.043 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:06:43.043 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T19:06:43.633 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:43.634 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:43.634 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:43.635 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2023-07-21T19:06:43.635 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:43.635 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:43.635 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:43.636 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:43.636 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:43.636 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:43.638 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-21T19:06:43.638 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-21T19:06:43.755 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-21T19:06:43.773 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:43.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:43.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:43.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:43.926+0000 7ff7d510d700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-21T19:06:43.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:43.926+0000 7ff7d510d700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-21T19:06:43.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:43.926+0000 7ff7d510d700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T19:06:43.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:43.926+0000 7ff7d510d700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T19:06:43.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:43.926+0000 7ff7d510d700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T19:06:43.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:43.930+0000 7ff7d510d700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-21T19:06:47.021 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-21T19:06:47.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:47.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:47.169+0000 7fe6fc2fd700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-21T19:06:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:47.169+0000 7fe6fc2fd700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-21T19:06:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:47.169+0000 7fe6fc2fd700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T19:06:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:47.169+0000 7fe6fc2fd700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T19:06:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:47.169+0000 7fe6fc2fd700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T19:06:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:47.173+0000 7fe6fc2fd700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-21T19:06:50.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-21T19:06:50.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:50.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:50.381+0000 7fdeaf365700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-21T19:06:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:50.381+0000 7fdeaf365700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-21T19:06:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:50.381+0000 7fdeaf365700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T19:06:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:50.381+0000 7fdeaf365700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T19:06:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:50.381+0000 7fdeaf365700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T19:06:50.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:50.381+0000 7fdeaf365700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-21T19:06:53.475 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-21T19:06:53.507 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:53.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:53.629+0000 7f57e6b01700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-21T19:06:53.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:53.629+0000 7f57e6b01700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-21T19:06:53.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:53.629+0000 7f57e6b01700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T19:06:53.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:53.629+0000 7f57e6b01700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T19:06:53.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:53.629+0000 7f57e6b01700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T19:06:53.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:06:53.633+0000 7f57e6b01700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-21T19:06:56.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-21T19:06:56.728 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-21T19:06:56.765 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:56.765 INFO:tasks.ceph:role: osd.4 2023-07-21T19:06:56.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:06:56.766 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T19:06:57.350 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:57.350 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:57.350 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:57.350 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2023-07-21T19:06:57.351 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:57.351 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:57.351 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:57.351 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:57.351 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:57.351 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:57.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-07-21T19:06:57.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-21T19:06:57.458 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-21T19:06:57.479 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:57.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:57.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-21T19:06:57.563 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:57.564 INFO:tasks.ceph:role: osd.5 2023-07-21T19:06:57.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:06:57.565 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T19:06:58.079 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:58.079 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:58.079 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:58.079 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2023-07-21T19:06:58.079 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:58.080 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:58.080 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:58.080 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:58.080 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:58.080 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:58.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-07-21T19:06:58.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-21T19:06:58.158 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-21T19:06:58.179 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:58.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:58.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-21T19:06:58.264 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:58.264 INFO:tasks.ceph:role: osd.6 2023-07-21T19:06:58.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:06:58.265 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T19:06:58.810 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:58.811 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:58.811 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:58.811 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2023-07-21T19:06:58.811 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:58.812 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:58.812 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:58.812 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:58.812 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:58.813 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:58.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-07-21T19:06:58.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-21T19:06:58.906 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-21T19:06:58.924 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:58.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:58.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-21T19:06:59.006 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T19:06:59.007 INFO:tasks.ceph:role: osd.7 2023-07-21T19:06:59.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:06:59.007 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T19:06:59.564 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T19:06:59.565 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T19:06:59.565 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T19:06:59.565 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2023-07-21T19:06:59.565 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T19:06:59.565 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-07-21T19:06:59.565 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T19:06:59.566 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T19:06:59.566 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T19:06:59.566 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T19:06:59.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-07-21T19:06:59.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-21T19:06:59.686 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-21T19:06:59.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:06:59.709 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T19:06:59.710 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:06:59.893 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:06:59.879+0000 7fea78ae2700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-21T19:06:59.896 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:06:59.883+0000 7fea78ae2700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-21T19:06:59.896 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:06:59.883+0000 7fea78ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T19:06:59.897 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:06:59.883+0000 7fea78ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T19:06:59.897 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:06:59.883+0000 7fea78ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T19:06:59.899 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:06:59.883+0000 7fea78ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-21T19:07:02.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-21T19:07:03.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:07:03.132 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:03.115+0000 7f7dd014d700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-21T19:07:03.133 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:03.119+0000 7f7dd014d700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-21T19:07:03.133 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:03.119+0000 7f7dd014d700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T19:07:03.133 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:03.119+0000 7f7dd014d700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T19:07:03.133 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:03.119+0000 7f7dd014d700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T19:07:03.135 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:03.119+0000 7f7dd014d700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-21T19:07:06.197 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-21T19:07:06.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:07:06.364 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:06.350+0000 7fbfd6e87700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-21T19:07:06.366 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:06.350+0000 7fbfd6e87700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-21T19:07:06.366 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:06.350+0000 7fbfd6e87700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T19:07:06.366 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:06.350+0000 7fbfd6e87700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T19:07:06.366 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:06.350+0000 7fbfd6e87700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T19:07:06.367 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:06.350+0000 7fbfd6e87700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-21T19:07:06.411 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:06.419 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:09.432 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-21T19:07:09.464 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:07:09.591 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:09.574+0000 7ff22d9bc700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-21T19:07:09.592 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:09.574+0000 7ff22d9bc700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-21T19:07:09.592 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:09.578+0000 7ff22d9bc700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T19:07:09.592 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:09.578+0000 7ff22d9bc700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T19:07:09.593 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:09.578+0000 7ff22d9bc700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T19:07:09.596 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:09.578+0000 7ff22d9bc700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-21T19:07:12.673 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-21T19:07:12.705 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-21T19:07:12.706 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:12.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-21T19:07:12.740 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:12.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-21T19:07:12.815 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:12.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-21T19:07:12.891 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:12.892 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-21T19:07:12.966 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:12.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-21T19:07:13.044 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:13.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-21T19:07:13.123 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:13.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-21T19:07:13.203 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-21T19:07:13.237 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.238 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-21T19:07:13.312 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-21T19:07:13.388 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.389 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-21T19:07:13.468 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.469 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-21T19:07:13.545 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-21T19:07:13.625 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.626 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-21T19:07:13.702 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:13.703 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-21T19:07:13.721 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:13.721 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-21T19:07:13.782 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.783 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-21T19:07:13.800 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:13.800 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-21T19:07:13.863 INFO:tasks.ceph:Adding keys to all mons... 2023-07-21T19:07:13.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T19:07:13.871 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T19:07:13.915 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2023-07-21T19:07:13.916 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA/17pkmAkwFxAAP6fw68BLkvkZvb3rdm8gyg== 2023-07-21T19:07:13.916 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-07-21T19:07:13.916 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA/17pkzA8VJRAAw09XXzND3lVX9IkScOLiXA== 2023-07-21T19:07:13.916 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-07-21T19:07:13.916 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA/17pk49gmMBAAdddgVbP3DcEq/ZOAjFcZrw== 2023-07-21T19:07:13.917 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2023-07-21T19:07:13.917 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBD17pka9uKNxAAaDPjvrIZWK7VWkM9FvEUdA== 2023-07-21T19:07:13.917 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2023-07-21T19:07:13.917 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBH17pkzSh+ChAA+6lF5wX5R0UV46/sQuVbLQ== 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBK17pkadbjFhAAPosOaNoaECIUrXSzNwpfdA== 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBN17pkG0ejJRAA9n8YEThkdIMO7jnKoKxQmg== 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA/17pkDrqIHRAALYOWJm1PpwK0ltE3phHunA== 2023-07-21T19:07:13.918 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-07-21T19:07:13.919 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA/17pkZjJ9OBAAXfUxoDyO3JuFinW0pl+KoQ== 2023-07-21T19:07:13.919 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2023-07-21T19:07:13.919 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBA17pkFnbPBxAAxyLpmIcj6hMgDNWUXFzkYg== 2023-07-21T19:07:13.919 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2023-07-21T19:07:13.919 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBT17pkg1h8NBAA11ldR/LqenYFGqOHLCWdXA== 2023-07-21T19:07:13.919 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBX17pkVaAkBxAAmpqYFxw1caext1yztHaklw== 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBa17pko/UDFRAAm6qfdDBIhm8DyvmQJfWzmQ== 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBd17pk97iBIhAAx79tBTrDqc22KR+0BZ5qFA== 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-07-21T19:07:13.920 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBA17pk2Nr+DhAAZaJDjV8t3ZvDwlb/0Xr4lQ== 2023-07-21T19:07:13.921 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2023-07-21T19:07:13.921 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBA17pk2oUSFRAAjX5SyVX1rkd8V3c53yhPZg== 2023-07-21T19:07:13.921 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2023-07-21T19:07:13.921 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBA17pkn3jiGhAArawyzbz/lY2crSl3QuhcIQ== 2023-07-21T19:07:13.921 INFO:teuthology.orchestra.run.smithi123.stdout:[client.3] 2023-07-21T19:07:13.921 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBA17pkQ4MRIRAAs/FqQg7cdATjre0EcEIfXA== 2023-07-21T19:07:13.938 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2023-07-21T19:07:13.938 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA/17pkmAkwFxAAP6fw68BLkvkZvb3rdm8gyg== 2023-07-21T19:07:13.938 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA/17pkzA8VJRAAw09XXzND3lVX9IkScOLiXA== 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA/17pk49gmMBAAdddgVbP3DcEq/ZOAjFcZrw== 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBD17pka9uKNxAAaDPjvrIZWK7VWkM9FvEUdA== 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2023-07-21T19:07:13.939 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBH17pkzSh+ChAA+6lF5wX5R0UV46/sQuVbLQ== 2023-07-21T19:07:13.940 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2023-07-21T19:07:13.940 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBK17pkadbjFhAAPosOaNoaECIUrXSzNwpfdA== 2023-07-21T19:07:13.940 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2023-07-21T19:07:13.940 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBN17pkG0ejJRAA9n8YEThkdIMO7jnKoKxQmg== 2023-07-21T19:07:13.940 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2023-07-21T19:07:13.940 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA/17pkDrqIHRAALYOWJm1PpwK0ltE3phHunA== 2023-07-21T19:07:13.941 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2023-07-21T19:07:13.941 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA/17pkZjJ9OBAAXfUxoDyO3JuFinW0pl+KoQ== 2023-07-21T19:07:13.941 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2023-07-21T19:07:13.941 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBA17pkFnbPBxAAxyLpmIcj6hMgDNWUXFzkYg== 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBT17pkg1h8NBAA11ldR/LqenYFGqOHLCWdXA== 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBX17pkVaAkBxAAmpqYFxw1caext1yztHaklw== 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBa17pko/UDFRAAm6qfdDBIhm8DyvmQJfWzmQ== 2023-07-21T19:07:13.942 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBd17pk97iBIhAAx79tBTrDqc22KR+0BZ5qFA== 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBA17pk2Nr+DhAAZaJDjV8t3ZvDwlb/0Xr4lQ== 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout:[client.2] 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBA17pk2oUSFRAAjX5SyVX1rkd8V3c53yhPZg== 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2023-07-21T19:07:13.943 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBA17pkn3jiGhAArawyzbz/lY2crSl3QuhcIQ== 2023-07-21T19:07:13.944 INFO:teuthology.orchestra.run.smithi145.stdout:[client.3] 2023-07-21T19:07:13.944 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBA17pkQ4MRIRAAs/FqQg7cdATjre0EcEIfXA== 2023-07-21T19:07:13.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T19:07:13.977 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T19:07:14.073 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.080 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.173 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.346 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.435 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.530 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T19:07:14.619 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T19:07:14.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.705 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.795 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T19:07:14.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.883 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:14.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:15.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:15.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:15.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:15.148 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T19:07:15.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.239 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.416 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T19:07:15.589 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-21T19:07:15.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-21T19:07:15.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T19:07:15.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-21T19:07:15.807 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-21T19:07:15.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T19:07:15.994 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-21T19:07:16.027 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-21T19:07:16.101 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T19:07:16.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-21T19:07:16.281 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:07:16.289 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T19:07:16.341 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-21T19:07:16.342 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-21T19:07:16.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-21T19:07:16.349 INFO:tasks.ceph.mon.a:Started 2023-07-21T19:07:16.350 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-21T19:07:16.350 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-21T19:07:16.394 INFO:tasks.ceph.mon.b:Started 2023-07-21T19:07:16.394 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-21T19:07:16.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-21T19:07:16.399 INFO:tasks.ceph.mon.c:Started 2023-07-21T19:07:16.399 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-21T19:07:16.399 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-21T19:07:16.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-21T19:07:16.409 INFO:tasks.ceph.mgr.y:Started 2023-07-21T19:07:16.409 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-21T19:07:16.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-21T19:07:16.417 INFO:tasks.ceph.mgr.x:Started 2023-07-21T19:07:16.417 INFO:tasks.ceph:Setting crush tunables to default 2023-07-21T19:07:16.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2023-07-21T19:07:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.569+0000 7f4993901700 1 Processor -- start 2023-07-21T19:07:16.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.569+0000 7f4993901700 1 -- start start 2023-07-21T19:07:16.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4993901700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:16.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4993901700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:16.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4993901700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:16.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4993901700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c0c9520 con 0x7f498c0c90a0 2023-07-21T19:07:16.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4993901700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c158970 con 0x7f498c0cdcb0 2023-07-21T19:07:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4993901700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0ce080 con 0x7f498c0b0680 2023-07-21T19:07:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40678/0 (socket says 172.21.15.123:40678) 2023-07-21T19:07:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 learned_addr learned my addr 172.21.15.123:0/958490997 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T19:07:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T19:07:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-21T19:07:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T19:07:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T19:07:16.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:16.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:16.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.573+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T19:07:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-21T19:07:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T19:07:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T19:07:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T19:07:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T19:07:16.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:16.777+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T19:07:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T19:07:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T19:07:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T19:07:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.181+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T19:07:17.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:17.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:17.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:17.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T19:07:17.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:17.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:17.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f499169d700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4990e9c700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T19:07:17.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T19:07:17.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:17.985+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T19:07:19.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 msgr2=0x7f498c0c8b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T19:07:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f498c0b0680 0x7f498c0c8b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 msgr2=0x7f498c071440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T19:07:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.145:3300/0 conn(0x7f498c0cdcb0 0x7f498c071440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 -- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 msgr2=0x7f498c15bf60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T19:07:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 --2- 172.21.15.123:0/958490997 >> v2:172.21.15.123:3300/0 conn(0x7f498c0c90a0 0x7f498c15bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 -- 172.21.15.123:0/958490997 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c158bf0 con 0x7f4978009580 2023-07-21T19:07:19.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:19.573+0000 7f4982ffd700 1 -- 172.21.15.123:0/958490997 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497800e2f0 con 0x7f4978005940 2023-07-21T19:07:21.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.757+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892980063 0 0) 0x7f498c158bf0 con 0x7f4978009580 2023-07-21T19:07:21.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.757+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49700035d0 con 0x7f4978009580 2023-07-21T19:07:21.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.757+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686230589 0 0) 0x7f497800e2f0 con 0x7f4978005940 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c158bf0 con 0x7f4978005940 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630465337 0 0) 0x7f49700035d0 con 0x7f4978009580 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 >> v1:172.21.15.145:6789/0 conn(0x7f4978005940 legacy=0x7f4978007d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497800f4f0 con 0x7f4978009580 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f497c00c570 con 0x7f4978009580 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 >> v1:172.21.15.123:6789/0 conn(0x7f4978009580 legacy=0x7f497800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 reap_dead start 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970003c30 0x7f4970004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970004870 0x7f4970004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970005470 0x7f497000ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497000c340 con 0x7f4970004870 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497000c4b0 con 0x7f4970003c30 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497000c670 con 0x7f4970005470 2023-07-21T19:07:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970005470 0x7f497000ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f499169d700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970003c30 0x7f4970004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970004870 0x7f4970004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970003c30 msgr2=0x7f4970004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:21.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970003c30 0x7f4970004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970004870 msgr2=0x7f4970004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:21.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970004870 0x7f4970004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 -- 172.21.15.123:0/958490997 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700035d0 con 0x7f4970005470 2023-07-21T19:07:21.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4990e9c700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970004870 0x7f4970004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:21.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.761+0000 7f4991e9e700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970005470 0x7f497000ba90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f498c06ab10 tx=0x7f49700058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d2629e8547f039 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:21.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984008980 con 0x7f4970005470 2023-07-21T19:07:21.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984010070 con 0x7f4970005470 2023-07-21T19:07:21.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4983fff700 1 -- 172.21.15.123:0/958490997 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984008ce0 con 0x7f4970005470 2023-07-21T19:07:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 -- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970005470 msgr2=0x7f497000ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970005470 0x7f497000ba90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f498c06ab10 tx=0x7f49700058a0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 -- 172.21.15.123:0/958490997 shutdown_connections 2023-07-21T19:07:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970005470 0x7f497000ba90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970004870 0x7f4970004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 --2- 172.21.15.123:0/958490997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970003c30 0x7f4970004000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 -- 172.21.15.123:0/958490997 >> 172.21.15.123:0/958490997 conn(0x7f498c0cad80 msgr2=0x7f498c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 -- 172.21.15.123:0/958490997 shutdown_connections 2023-07-21T19:07:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.765+0000 7f4993901700 1 -- 172.21.15.123:0/958490997 wait complete. 2023-07-21T19:07:21.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.769+0000 7f4993901700 1 Processor -- start 2023-07-21T19:07:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.769+0000 7f4993901700 1 -- start start 2023-07-21T19:07:21.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4993901700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970003c30 0x7f498c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:21.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4993901700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970004870 0x7f498c0b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:21.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4993901700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 0x7f498c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:21.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4993901700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c148d10 con 0x7f4970005470 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4993901700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0b21d0 con 0x7f4970004870 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4993901700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0b15c0 con 0x7f4970003c30 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 0x7f498c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 0x7f498c157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40760/0 (socket says 172.21.15.123:40760) 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 -- 172.21.15.123:0/1688683302 learned_addr learned my addr 172.21.15.123:0/1688683302 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f499169d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970003c30 0x7f498c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:21.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4990e9c700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970004870 0x7f498c0b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:21.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 -- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970003c30 msgr2=0x7f498c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:21.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970003c30 0x7f498c1487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 -- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970004870 msgr2=0x7f498c0b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:21.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970004870 0x7f498c0b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 -- 172.21.15.123:0/1688683302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0b18a0 con 0x7f4970005470 2023-07-21T19:07:21.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.773+0000 7f4991e9e700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 0x7f498c157420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4984002230 tx=0x7f4984004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:21.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984018a00 con 0x7f4970005470 2023-07-21T19:07:21.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984025070 con 0x7f4970005470 2023-07-21T19:07:21.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984018da0 con 0x7f4970005470 2023-07-21T19:07:21.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c0b1b80 con 0x7f4970005470 2023-07-21T19:07:21.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c0b1130 con 0x7f4970005470 2023-07-21T19:07:21.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c061060 con 0x7f4970005470 2023-07-21T19:07:21.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f498402c780 con 0x7f4970005470 2023-07-21T19:07:21.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.777+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4984027070 con 0x7f4970005470 2023-07-21T19:07:21.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.781+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f498401b020 con 0x7f4970005470 2023-07-21T19:07:21.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.853+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f498c0b1380 con 0x7f4970005470 2023-07-21T19:07:21.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.865+0000 7f4981ffb700 1 -- 172.21.15.123:0/1688683302 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f498c0b1380 con 0x7f4970005470 2023-07-21T19:07:21.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 msgr2=0x7f498c157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:21.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 0x7f498c157420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4984002230 tx=0x7f4984004af0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 shutdown_connections 2023-07-21T19:07:21.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4970004870 0x7f498c0b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4970005470 0x7f498c157420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 --2- 172.21.15.123:0/1688683302 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4970003c30 0x7f498c1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 >> 172.21.15.123:0/1688683302 conn(0x7f498c0cad80 msgr2=0x7f498c15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 shutdown_connections 2023-07-21T19:07:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:21.869+0000 7f4993901700 1 -- 172.21.15.123:0/1688683302 wait complete. 2023-07-21T19:07:21.881 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2023-07-21T19:07:21.899 INFO:tasks.ceph:check_enable_crimson: False 2023-07-21T19:07:21.899 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-21T19:07:21.900 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:21.900 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-21T19:07:21.931 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:21.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-21T19:07:22.008 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:22.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-21T19:07:22.010 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:21.997+0000 7f216b1ee2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T19:07:22.037 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:07:22.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-21T19:07:22.111 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:22.111 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-21T19:07:22.145 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:22.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-21T19:07:22.220 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:22.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-21T19:07:22.296 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:07:22.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-21T19:07:22.371 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new f667b60f-dcc9-4c58-b935-8f2debd82358 0 2023-07-21T19:07:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f143359e700 1 Processor -- start 2023-07-21T19:07:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f143359e700 1 -- start start 2023-07-21T19:07:22.578 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f143359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14341604f0 0x7f14340af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.578 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f143359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340d0930 con 0x7f143415fa10 2023-07-21T19:07:22.578 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f143359e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340b4ae0 con 0x7f14340af6f0 2023-07-21T19:07:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f143359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340ce560 con 0x7f14341604f0 2023-07-21T19:07:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f1432d9d700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f14340af6f0 0x7f14340afb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55788/0 (socket says 172.21.15.145:55788) 2023-07-21T19:07:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f1432d9d700 1 -- 172.21.15.145:0/2063973061 learned_addr learned my addr 172.21.15.145:0/2063973061 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-07-21T19:07:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f142bfff700 1 --2- 172.21.15.145:0/2063973061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14341604f0 0x7f14340af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f1431d9b700 1 -- 172.21.15.145:0/2063973061 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257128466 0 0) 0x7f142c001490 con 0x7f14340af6f0 2023-07-21T19:07:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f1431d9b700 1 -- 172.21.15.145:0/2063973061 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14200035d0 con 0x7f14340af6f0 2023-07-21T19:07:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f142bfff700 1 -- 172.21.15.145:0/2063973061 >> v1:172.21.15.145:6789/0 conn(0x7f14340af6f0 legacy=0x7f14340afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f142bfff700 1 -- 172.21.15.145:0/2063973061 >> v1:172.21.15.123:6789/0 conn(0x7f143415fa10 legacy=0x7f143415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.581 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.562+0000 7f142bfff700 1 -- 172.21.15.145:0/2063973061 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143415c300 con 0x7f14341604f0 2023-07-21T19:07:22.581 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f142bfff700 1 --2- 172.21.15.145:0/2063973061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14341604f0 0x7f14340af1b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f141c009880 tx=0x7f141c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e33e5f7f1ae952f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:22.581 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f1431d9b700 1 -- 172.21.15.145:0/2063973061 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c011830 con 0x7f14341604f0 2023-07-21T19:07:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f1431d9b700 1 -- 172.21.15.145:0/2063973061 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c011990 con 0x7f14341604f0 2023-07-21T19:07:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f1431d9b700 1 -- 172.21.15.145:0/2063973061 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c011d00 con 0x7f14341604f0 2023-07-21T19:07:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 -- 172.21.15.145:0/2063973061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14341604f0 msgr2=0x7f14340af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 --2- 172.21.15.145:0/2063973061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14341604f0 0x7f14340af1b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f141c009880 tx=0x7f141c009b90 comp rx=0 tx=0).stop 2023-07-21T19:07:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 -- 172.21.15.145:0/2063973061 shutdown_connections 2023-07-21T19:07:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 --2- 172.21.15.145:0/2063973061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14341604f0 0x7f14340af1b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 -- 172.21.15.145:0/2063973061 >> 172.21.15.145:0/2063973061 conn(0x7f143409b850 msgr2=0x7f14340d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 -- 172.21.15.145:0/2063973061 shutdown_connections 2023-07-21T19:07:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 -- 172.21.15.145:0/2063973061 wait complete. 2023-07-21T19:07:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 Processor -- start 2023-07-21T19:07:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.566+0000 7f143359e700 1 -- start start 2023-07-21T19:07:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14340af6f0 0x7f14340b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 0x7f1434151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341604f0 0x7f1434159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341f1620 con 0x7f14340af6f0 2023-07-21T19:07:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340c81a0 con 0x7f14341604f0 2023-07-21T19:07:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340c7590 con 0x7f143415fa10 2023-07-21T19:07:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 0x7f1434151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f1432d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341604f0 0x7f1434159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 0x7f1434151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:44264/0 (socket says 172.21.15.145:44264) 2023-07-21T19:07:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 -- 172.21.15.145:0/1300312522 learned_addr learned my addr 172.21.15.145:0/1300312522 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143259c700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14340af6f0 0x7f14340b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 -- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341604f0 msgr2=0x7f1434159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341604f0 0x7f1434159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 -- 172.21.15.145:0/1300312522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14340af6f0 msgr2=0x7f14340b7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14340af6f0 0x7f14340b7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 -- 172.21.15.145:0/1300312522 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0094b0 con 0x7f143415fa10 2023-07-21T19:07:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142bfff700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 0x7f1434151330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f141c013040 tx=0x7f141c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c004550 con 0x7f143415fa10 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0036c0 con 0x7f143415fa10 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14340c7870 con 0x7f143415fa10 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c003a30 con 0x7f143415fa10 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14340c7e30 con 0x7f143415fa10 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f141c025410 con 0x7f143415fa10 2023-07-21T19:07:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.570+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f141c01b400 con 0x7f143415fa10 2023-07-21T19:07:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.574+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340d3430 con 0x7f143415fa10 2023-07-21T19:07:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.578+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f141c02a020 con 0x7f143415fa10 2023-07-21T19:07:22.711 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:22.697+0000 7f216b1ee2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T19:07:22.718 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.702+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f667b60f-dcc9-4c58-b935-8f2debd82358", "id": 0} v 0) v1 -- 0x7f14340c8310 con 0x7f143415fa10 2023-07-21T19:07:22.729 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f142affd700 1 -- 172.21.15.145:0/1300312522 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f667b60f-dcc9-4c58-b935-8f2debd82358", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f141c025920 con 0x7f143415fa10 2023-07-21T19:07:22.729 INFO:teuthology.orchestra.run.smithi145.stdout:0 2023-07-21T19:07:22.733 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 msgr2=0x7f1434151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.733 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 0x7f1434151330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f141c013040 tx=0x7f141c004770 comp rx=0 tx=0).stop 2023-07-21T19:07:22.733 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 shutdown_connections 2023-07-21T19:07:22.733 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341604f0 0x7f1434159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.733 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f143415fa10 0x7f1434151330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.733 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 --2- 172.21.15.145:0/1300312522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14340af6f0 0x7f14340b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.734 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 >> 172.21.15.145:0/1300312522 conn(0x7f143409b850 msgr2=0x7f14340b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:22.734 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 shutdown_connections 2023-07-21T19:07:22.734 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.714+0000 7f143359e700 1 -- 172.21.15.145:0/1300312522 wait complete. 2023-07-21T19:07:22.751 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new f1458d7c-7efe-44ff-90b7-7f119ac4cf47 1 2023-07-21T19:07:22.793 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:22.781+0000 7f216b1ee2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T19:07:22.831 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:22.814+0000 7fdb5eed42c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T19:07:22.910 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.894+0000 7fc120cf5700 1 Processor -- start 2023-07-21T19:07:22.910 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.894+0000 7fc120cf5700 1 -- start start 2023-07-21T19:07:22.912 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.894+0000 7fc120cf5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc11c0cf710 0x7fc11c0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.912 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c071d10 con 0x7fc11c0b1c50 2023-07-21T19:07:22.912 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c15c420 con 0x7fc11c0d0210 2023-07-21T19:07:22.912 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c070840 con 0x7fc11c0cf710 2023-07-21T19:07:22.913 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc113fff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fc11c0d0210 0x7fc11c0cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55792/0 (socket says 172.21.15.145:55792) 2023-07-21T19:07:22.913 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc113fff700 1 -- 172.21.15.145:0/2488260582 learned_addr learned my addr 172.21.15.145:0/2488260582 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-07-21T19:07:22.913 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc11ad9d700 1 --2- 172.21.15.145:0/2488260582 >> v2:172.21.15.123:3300/0 conn(0x7fc11c0cf710 0x7fc11c0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc119d9b700 1 -- 172.21.15.145:0/2488260582 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495691235 0 0) 0x7fc11c15c420 con 0x7fc11c0d0210 2023-07-21T19:07:22.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc119d9b700 1 -- 172.21.15.145:0/2488260582 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1080035d0 con 0x7fc11c0d0210 2023-07-21T19:07:22.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc11ad9d700 1 -- 172.21.15.145:0/2488260582 >> v1:172.21.15.145:6789/0 conn(0x7fc11c0d0210 legacy=0x7fc11c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc11ad9d700 1 -- 172.21.15.145:0/2488260582 >> v1:172.21.15.123:6789/0 conn(0x7fc11c0b1c50 legacy=0x7fc11c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc11ad9d700 1 -- 172.21.15.145:0/2488260582 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c070b20 con 0x7fc11c0cf710 2023-07-21T19:07:22.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc11ad9d700 1 --2- 172.21.15.145:0/2488260582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c0d0640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc11400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcbcdf7db50ca23 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:22.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc119d9b700 1 -- 172.21.15.145:0/2488260582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11400e070 con 0x7fc11c0cf710 2023-07-21T19:07:22.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc119d9b700 1 -- 172.21.15.145:0/2488260582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11400bb20 con 0x7fc11c0cf710 2023-07-21T19:07:22.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc119d9b700 1 -- 172.21.15.145:0/2488260582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114012430 con 0x7fc11c0cf710 2023-07-21T19:07:22.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- 172.21.15.145:0/2488260582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 msgr2=0x7fc11c0d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 --2- 172.21.15.145:0/2488260582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c0d0640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc11400b330 comp rx=0 tx=0).stop 2023-07-21T19:07:22.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- 172.21.15.145:0/2488260582 shutdown_connections 2023-07-21T19:07:22.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 --2- 172.21.15.145:0/2488260582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c0d0640 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- 172.21.15.145:0/2488260582 >> 172.21.15.145:0/2488260582 conn(0x7fc11c09b9c0 msgr2=0x7fc11c0d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:22.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- 172.21.15.145:0/2488260582 shutdown_connections 2023-07-21T19:07:22.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.898+0000 7fc120cf5700 1 -- 172.21.15.145:0/2488260582 wait complete. 2023-07-21T19:07:22.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 Processor -- start 2023-07-21T19:07:22.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 -- start start 2023-07-21T19:07:22.918 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc11c0b1c50 0x7fc11c09ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c09c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 0x7fc11c14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:22.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09fb80 con 0x7fc11c0cf710 2023-07-21T19:07:22.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09ef00 con 0x7fc11c0d0210 2023-07-21T19:07:22.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc120cf5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09f1e0 con 0x7fc11c0b1c50 2023-07-21T19:07:22.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc11ad9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 0x7fc11c14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.921 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc11ad9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 0x7fc11c14ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:57180/0 (socket says 172.21.15.145:57180) 2023-07-21T19:07:22.921 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc11ad9d700 1 -- 172.21.15.145:0/405523058 learned_addr learned my addr 172.21.15.145:0/405523058 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:22.921 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc113fff700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c09c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.921 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.902+0000 7fc11a59c700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc11c0b1c50 0x7fc11c09ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:22.921 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc113fff700 1 -- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc11c0b1c50 msgr2=0x7fc11c09ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.921 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc113fff700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc11c0b1c50 0x7fc11c09ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc113fff700 1 -- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 msgr2=0x7fc11c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc113fff700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 0x7fc11c14ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc113fff700 1 -- 172.21.15.145:0/405523058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114009a70 con 0x7fc11c0cf710 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc11ad9d700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 0x7fc11c14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc113fff700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c09c330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c410 tx=0x7fc10400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104005d90 con 0x7fc11c0cf710 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10400ce20 con 0x7fc11c0cf710 2023-07-21T19:07:22.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c09f4c0 con 0x7fc11c0cf710 2023-07-21T19:07:22.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040072d0 con 0x7fc11c0cf710 2023-07-21T19:07:22.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c14bf40 con 0x7fc11c0cf710 2023-07-21T19:07:22.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc10401c440 con 0x7fc11c0cf710 2023-07-21T19:07:22.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc1040127b0 con 0x7fc11c0cf710 2023-07-21T19:07:22.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.906+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c09fcc0 con 0x7fc11c0cf710 2023-07-21T19:07:22.926 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.910+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc11c09fcc0 con 0x7fc11c0cf710 2023-07-21T19:07:22.968 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:22.957+0000 7f216b1ee2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T19:07:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.986+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f1458d7c-7efe-44ff-90b7-7f119ac4cf47", "id": 1} v 0) v1 -- 0x7fc11c04dcb0 con 0x7fc11c0cf710 2023-07-21T19:07:23.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.994+0000 7fc112ffd700 1 -- 172.21.15.145:0/405523058 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1458d7c-7efe-44ff-90b7-7f119ac4cf47", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc104017070 con 0x7fc11c0cf710 2023-07-21T19:07:23.013 INFO:teuthology.orchestra.run.smithi145.stdout:1 2023-07-21T19:07:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 msgr2=0x7fc11c09c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c09c330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c410 tx=0x7fc10400c720 comp rx=0 tx=0).stop 2023-07-21T19:07:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 shutdown_connections 2023-07-21T19:07:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc11c0d0210 0x7fc11c14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc11c0cf710 0x7fc11c09c330 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 --2- 172.21.15.145:0/405523058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc11c0b1c50 0x7fc11c09ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 >> 172.21.15.145:0/405523058 conn(0x7fc11c09b9c0 msgr2=0x7fc11c15bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 shutdown_connections 2023-07-21T19:07:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:22.998+0000 7fc120cf5700 1 -- 172.21.15.145:0/405523058 wait complete. 2023-07-21T19:07:23.035 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 4afb00a6-d01f-486b-acd1-276f46ba44ac 2 2023-07-21T19:07:23.204 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 Processor -- start 2023-07-21T19:07:23.204 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 -- start start 2023-07-21T19:07:23.206 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33100b0ee0 0x7f33100ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.206 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 0x7f33100d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.206 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33100cd4e0 con 0x7f33100d0610 2023-07-21T19:07:23.206 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33100d1a60 con 0x7f33100b0ee0 2023-07-21T19:07:23.206 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f3314ac4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100d1ef0 con 0x7f33100cd090 2023-07-21T19:07:23.207 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 0x7f33100d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 0x7f33100d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:44288/0 (socket says 172.21.15.145:44288) 2023-07-21T19:07:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 -- 172.21.15.145:0/2603793490 learned_addr learned my addr 172.21.15.145:0/2603793490 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330f7fe700 1 --2- 172.21.15.145:0/2603793490 >> v2:172.21.15.123:3300/0 conn(0x7f33100b0ee0 0x7f33100ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 -- 172.21.15.145:0/2603793490 >> v2:172.21.15.123:3300/0 conn(0x7f33100b0ee0 msgr2=0x7f33100ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 --2- 172.21.15.145:0/2603793490 >> v2:172.21.15.123:3300/0 conn(0x7f33100b0ee0 0x7f33100ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.209 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 -- 172.21.15.145:0/2603793490 >> v1:172.21.15.123:6789/0 conn(0x7f33100d0610 legacy=0x7f331015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:23.209 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 -- 172.21.15.145:0/2603793490 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100d0e50 con 0x7f33100cd090 2023-07-21T19:07:23.209 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.190+0000 7f330effd700 1 --2- 172.21.15.145:0/2603793490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 0x7f33100d00d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3304009940 tx=0x7f3304009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3316a1ebd96749ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:23.210 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f330e7fc700 1 -- 172.21.15.145:0/2603793490 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304004230 con 0x7f33100cd090 2023-07-21T19:07:23.210 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f330e7fc700 1 -- 172.21.15.145:0/2603793490 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304009e90 con 0x7f33100cd090 2023-07-21T19:07:23.210 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f330e7fc700 1 -- 172.21.15.145:0/2603793490 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040045b0 con 0x7f33100cd090 2023-07-21T19:07:23.210 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 -- 172.21.15.145:0/2603793490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 msgr2=0x7f33100d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.210 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2603793490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 0x7f33100d00d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3304009940 tx=0x7f3304009c50 comp rx=0 tx=0).stop 2023-07-21T19:07:23.210 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 -- 172.21.15.145:0/2603793490 shutdown_connections 2023-07-21T19:07:23.211 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2603793490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100cd090 0x7f33100d00d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.211 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2603793490 >> v2:172.21.15.123:3300/0 conn(0x7f33100b0ee0 0x7f33100ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.211 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 -- 172.21.15.145:0/2603793490 >> 172.21.15.145:0/2603793490 conn(0x7f3310060c40 msgr2=0x7f331009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.211 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 -- 172.21.15.145:0/2603793490 shutdown_connections 2023-07-21T19:07:23.211 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.194+0000 7f3314ac4700 1 -- 172.21.15.145:0/2603793490 wait complete. 2023-07-21T19:07:23.212 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 Processor -- start 2023-07-21T19:07:23.212 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 -- start start 2023-07-21T19:07:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33100b0ee0 0x7f3310158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 0x7f331015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100d0610 0x7f331015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3310159340 con 0x7f33100b0ee0 2023-07-21T19:07:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33100b2c50 con 0x7f33100cd090 2023-07-21T19:07:23.215 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f3314ac4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100b2f30 con 0x7f33100d0610 2023-07-21T19:07:23.215 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 0x7f331015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 0x7f331015a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:57186/0 (socket says 172.21.15.145:57186) 2023-07-21T19:07:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 -- 172.21.15.145:0/2925528823 learned_addr learned my addr 172.21.15.145:0/2925528823 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330ffff700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100d0610 0x7f331015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330f7fe700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33100b0ee0 0x7f3310158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 -- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100d0610 msgr2=0x7f331015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100d0610 0x7f331015a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 -- 172.21.15.145:0/2925528823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33100b0ee0 msgr2=0x7f3310158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33100b0ee0 0x7f3310158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 -- 172.21.15.145:0/2925528823 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304009570 con 0x7f33100cd090 2023-07-21T19:07:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330ffff700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100d0610 0x7f331015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.198+0000 7f330effd700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 0x7f331015a230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f33100d2030 tx=0x7f3304004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:23.218 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400ba60 con 0x7f33100cd090 2023-07-21T19:07:23.218 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330401f070 con 0x7f33100cd090 2023-07-21T19:07:23.218 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400be00 con 0x7f33100cd090 2023-07-21T19:07:23.218 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33100b3210 con 0x7f33100cd090 2023-07-21T19:07:23.218 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33100b37d0 con 0x7f33100cd090 2023-07-21T19:07:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3304021030 con 0x7f33100cd090 2023-07-21T19:07:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3304003de0 con 0x7f33100cd090 2023-07-21T19:07:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.202+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331004e500 con 0x7f33100cd090 2023-07-21T19:07:23.222 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:23.209+0000 7f216b1ee2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T19:07:23.223 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.206+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f33100cd4e0 con 0x7f33100cd090 2023-07-21T19:07:23.300 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:23.289+0000 7f216b1ee2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T19:07:23.303 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.286+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4afb00a6-d01f-486b-acd1-276f46ba44ac", "id": 2} v 0) v1 -- 0x7f33100d13e0 con 0x7f33100cd090 2023-07-21T19:07:23.314 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f32f7fff700 1 -- 172.21.15.145:0/2925528823 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4afb00a6-d01f-486b-acd1-276f46ba44ac", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3304003a90 con 0x7f33100cd090 2023-07-21T19:07:23.314 INFO:teuthology.orchestra.run.smithi145.stdout:2 2023-07-21T19:07:23.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 msgr2=0x7f331015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 0x7f331015a230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f33100d2030 tx=0x7f3304004770 comp rx=0 tx=0).stop 2023-07-21T19:07:23.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 shutdown_connections 2023-07-21T19:07:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33100cd090 0x7f331015a230 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33100d0610 0x7f331015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 --2- 172.21.15.145:0/2925528823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33100b0ee0 0x7f3310158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.298+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 >> 172.21.15.145:0/2925528823 conn(0x7f3310060c40 msgr2=0x7f33100cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.302+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 shutdown_connections 2023-07-21T19:07:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.302+0000 7f3314ac4700 1 -- 172.21.15.145:0/2925528823 wait complete. 2023-07-21T19:07:23.339 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new fa388f0a-64ed-4f6e-866f-2014cff8cf61 3 2023-07-21T19:07:23.508 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.490+0000 7fa3ddf2b700 1 Processor -- start 2023-07-21T19:07:23.508 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3ddf2b700 1 -- start start 2023-07-21T19:07:23.509 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3ddf2b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 0x7fa3d80c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.510 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3ddf2b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3d80705e0 0x7fa3d80cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.510 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3ddf2b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d8071560 con 0x7fa3d81597a0 2023-07-21T19:07:23.510 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3ddf2b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d80709f0 con 0x7fa3d80705e0 2023-07-21T19:07:23.510 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3ddf2b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8070cc0 con 0x7fa3d8159b70 2023-07-21T19:07:23.511 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 0x7fa3d80c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.511 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 0x7fa3d80c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:44314/0 (socket says 172.21.15.145:44314) 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 -- 172.21.15.145:0/3830442334 learned_addr learned my addr 172.21.15.145:0/3830442334 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3dd72a700 1 --2- 172.21.15.145:0/3830442334 >> v2:172.21.15.123:3300/0 conn(0x7fa3d80705e0 0x7fa3d80cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 -- 172.21.15.145:0/3830442334 >> v2:172.21.15.123:3300/0 conn(0x7fa3d80705e0 msgr2=0x7fa3d80cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 --2- 172.21.15.145:0/3830442334 >> v2:172.21.15.123:3300/0 conn(0x7fa3d80705e0 0x7fa3d80cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 -- 172.21.15.145:0/3830442334 >> v1:172.21.15.145:6789/0 conn(0x7fa3d81597a0 legacy=0x7fa3d80cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 -- 172.21.15.145:0/3830442334 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8070fa0 con 0x7fa3d8159b70 2023-07-21T19:07:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d7fff700 1 --2- 172.21.15.145:0/3830442334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 0x7fa3d80c87a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009910 tx=0x7fa3c4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ad48c386566d3e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:23.513 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d77fe700 1 -- 172.21.15.145:0/3830442334 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400ba60 con 0x7fa3d8159b70 2023-07-21T19:07:23.513 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d77fe700 1 -- 172.21.15.145:0/3830442334 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c400bbc0 con 0x7fa3d8159b70 2023-07-21T19:07:23.513 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.494+0000 7fa3d77fe700 1 -- 172.21.15.145:0/3830442334 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4009e60 con 0x7fa3d8159b70 2023-07-21T19:07:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/3830442334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 msgr2=0x7fa3d80c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/3830442334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 0x7fa3d80c87a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009910 tx=0x7fa3c4009c20 comp rx=0 tx=0).stop 2023-07-21T19:07:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/3830442334 shutdown_connections 2023-07-21T19:07:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/3830442334 >> v2:172.21.15.123:3300/0 conn(0x7fa3d80705e0 0x7fa3d80cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/3830442334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d8159b70 0x7fa3d80c87a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/3830442334 >> 172.21.15.145:0/3830442334 conn(0x7fa3d80afc60 msgr2=0x7fa3d80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/3830442334 shutdown_connections 2023-07-21T19:07:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/3830442334 wait complete. 2023-07-21T19:07:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 Processor -- start 2023-07-21T19:07:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.498+0000 7fa3ddf2b700 1 -- start start 2023-07-21T19:07:23.517 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3d80705e0 0x7fa3d81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.517 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d81597a0 0x7fa3d8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.517 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3d8159b70 0x7fa3d80c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.518 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81f1830 con 0x7fa3d8159b70 2023-07-21T19:07:23.518 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80c18e0 con 0x7fa3d80705e0 2023-07-21T19:07:23.518 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81567a0 con 0x7fa3d81597a0 2023-07-21T19:07:23.518 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3dcf29700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3d80705e0 0x7fa3d81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.519 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d81597a0 0x7fa3d8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.519 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3dcf29700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3d80705e0 0x7fa3d81560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:57188/0 (socket says 172.21.15.145:57188) 2023-07-21T19:07:23.519 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3dcf29700 1 -- 172.21.15.145:0/4099855083 learned_addr learned my addr 172.21.15.145:0/4099855083 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3dd72a700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3d8159b70 0x7fa3d80c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 -- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3d80705e0 msgr2=0x7fa3d81560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3d80705e0 0x7fa3d81560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 -- 172.21.15.145:0/4099855083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3d8159b70 msgr2=0x7fa3d80c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3d8159b70 0x7fa3d80c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 -- 172.21.15.145:0/4099855083 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009570 con 0x7fa3d81597a0 2023-07-21T19:07:23.520 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d7fff700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d81597a0 0x7fa3d8157d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4016000 tx=0x7fa3c4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:23.521 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4004510 con 0x7fa3d81597a0 2023-07-21T19:07:23.521 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d8158250 con 0x7fa3d81597a0 2023-07-21T19:07:23.521 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c401f070 con 0x7fa3d81597a0 2023-07-21T19:07:23.521 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4003900 con 0x7fa3d81597a0 2023-07-21T19:07:23.521 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.502+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d815d7d0 con 0x7fa3d81597a0 2023-07-21T19:07:23.522 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.506+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa3c4026480 con 0x7fa3d81597a0 2023-07-21T19:07:23.522 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.506+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa3c4021070 con 0x7fa3d81597a0 2023-07-21T19:07:23.522 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.506+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d80cefe0 con 0x7fa3d81597a0 2023-07-21T19:07:23.523 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.506+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fa3c4046b20 con 0x7fa3d81597a0 2023-07-21T19:07:23.536 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:23.525+0000 7f216b1ee2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T19:07:23.600 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:23.586+0000 7fdb5eed42c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T19:07:23.602 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.586+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fa388f0a-64ed-4f6e-866f-2014cff8cf61", "id": 3} v 0) v1 -- 0x7fa3d804e500 con 0x7fa3d81597a0 2023-07-21T19:07:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3d57fa700 1 -- 172.21.15.145:0/4099855083 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa388f0a-64ed-4f6e-866f-2014cff8cf61", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3c4035030 con 0x7fa3d81597a0 2023-07-21T19:07:23.614 INFO:teuthology.orchestra.run.smithi145.stdout:3 2023-07-21T19:07:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d81597a0 msgr2=0x7fa3d8157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d81597a0 0x7fa3d8157d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4016000 tx=0x7fa3c4004770 comp rx=0 tx=0).stop 2023-07-21T19:07:23.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 shutdown_connections 2023-07-21T19:07:23.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3d8159b70 0x7fa3d80c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3d81597a0 0x7fa3d8157d10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 --2- 172.21.15.145:0/4099855083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3d80705e0 0x7fa3d81560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 >> 172.21.15.145:0/4099855083 conn(0x7fa3d80afc60 msgr2=0x7fa3d815b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 shutdown_connections 2023-07-21T19:07:23.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.598+0000 7fa3ddf2b700 1 -- 172.21.15.145:0/4099855083 wait complete. 2023-07-21T19:07:23.619 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:23.609+0000 7f216b1ee2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T19:07:23.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new fb5f5b5d-c689-4d76-9d94-2a5746b45af8 4 2023-07-21T19:07:23.686 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:23.670+0000 7fdb5eed42c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T19:07:23.709 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:23.697+0000 7f216b1ee2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T19:07:23.796 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.778+0000 7f1b7a39e700 1 Processor -- start 2023-07-21T19:07:23.796 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7a39e700 1 -- start start 2023-07-21T19:07:23.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7a39e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b740b0ee0 0x7f1b740ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7a39e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740cd4e0 con 0x7f1b740cd090 2023-07-21T19:07:23.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7a39e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740d1a60 con 0x7f1b740d07e0 2023-07-21T19:07:23.799 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7a39e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740d0c60 con 0x7f1b740b0ee0 2023-07-21T19:07:23.800 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b79b9d700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1b740d07e0 0x7f1b740af0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55814/0 (socket says 172.21.15.145:55814) 2023-07-21T19:07:23.800 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b79b9d700 1 -- 172.21.15.145:0/405283980 learned_addr learned my addr 172.21.15.145:0/405283980 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-07-21T19:07:23.800 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7939c700 1 --2- 172.21.15.145:0/405283980 >> v2:172.21.15.145:3300/0 conn(0x7f1b740b0ee0 0x7f1b740ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.800 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090658184 0 0) 0x7f1b740d1a60 con 0x7f1b740d07e0 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b600035d0 con 0x7f1b740d07e0 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106481236 0 0) 0x7f1b64001110 con 0x7f1b740cd090 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b740d1a60 con 0x7f1b740cd090 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7939c700 1 -- 172.21.15.145:0/405283980 >> v1:172.21.15.145:6789/0 conn(0x7f1b740d07e0 legacy=0x7f1b740af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7939c700 1 -- 172.21.15.145:0/405283980 >> v1:172.21.15.123:6789/0 conn(0x7f1b740cd090 legacy=0x7f1b740d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.782+0000 7f1b7939c700 1 -- 172.21.15.145:0/405283980 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740d1ef0 con 0x7f1b740b0ee0 2023-07-21T19:07:23.801 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7939c700 1 --2- 172.21.15.145:0/405283980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740b0ee0 0x7f1b740ccb50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009850 tx=0x7f1b70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74c01e3a0f022ac4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:23.802 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70011830 con 0x7f1b740b0ee0 2023-07-21T19:07:23.802 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b70011990 con 0x7f1b740b0ee0 2023-07-21T19:07:23.803 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b6bfff700 1 -- 172.21.15.145:0/405283980 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70011d00 con 0x7f1b740b0ee0 2023-07-21T19:07:23.803 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 -- 172.21.15.145:0/405283980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740b0ee0 msgr2=0x7f1b740ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.803 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 --2- 172.21.15.145:0/405283980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740b0ee0 0x7f1b740ccb50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009850 tx=0x7f1b70009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:23.803 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 -- 172.21.15.145:0/405283980 shutdown_connections 2023-07-21T19:07:23.803 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 --2- 172.21.15.145:0/405283980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740b0ee0 0x7f1b740ccb50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.803 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 -- 172.21.15.145:0/405283980 >> 172.21.15.145:0/405283980 conn(0x7f1b74060c40 msgr2=0x7f1b7409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.804 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 -- 172.21.15.145:0/405283980 shutdown_connections 2023-07-21T19:07:23.804 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.786+0000 7f1b7a39e700 1 -- 172.21.15.145:0/405283980 wait complete. 2023-07-21T19:07:23.804 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 Processor -- start 2023-07-21T19:07:23.805 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 -- start start 2023-07-21T19:07:23.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b740b0ee0 0x7f1b7415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.808 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740cd090 0x7f1b7415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.808 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b740d07e0 0x7f1b740b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:23.808 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415d3d0 con 0x7f1b740b0ee0 2023-07-21T19:07:23.809 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415c7c0 con 0x7f1b740cd090 2023-07-21T19:07:23.809 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7a39e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415caa0 con 0x7f1b740d07e0 2023-07-21T19:07:23.809 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b78b9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740cd090 0x7f1b7415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.810 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b79b9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b740d07e0 0x7f1b740b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.810 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b78b9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740cd090 0x7f1b7415dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:57208/0 (socket says 172.21.15.145:57208) 2023-07-21T19:07:23.810 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b78b9b700 1 -- 172.21.15.145:0/1620820736 learned_addr learned my addr 172.21.15.145:0/1620820736 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:23.811 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b7939c700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b740b0ee0 0x7f1b7415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:23.811 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b79b9d700 1 -- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740cd090 msgr2=0x7f1b7415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.811 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b79b9d700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740cd090 0x7f1b7415dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.811 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b79b9d700 1 -- 172.21.15.145:0/1620820736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b740b0ee0 msgr2=0x7f1b7415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.812 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b79b9d700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b740b0ee0 0x7f1b7415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.812 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.790+0000 7f1b79b9d700 1 -- 172.21.15.145:0/1620820736 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700094b0 con 0x7f1b740d07e0 2023-07-21T19:07:23.814 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b79b9d700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b740d07e0 0x7f1b740b1af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00ca70 tx=0x7f1b6c00caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:23.814 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c007480 con 0x7f1b740d07e0 2023-07-21T19:07:23.814 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c0075e0 con 0x7f1b740d07e0 2023-07-21T19:07:23.814 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c007950 con 0x7f1b740d07e0 2023-07-21T19:07:23.815 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7415cd80 con 0x7f1b740d07e0 2023-07-21T19:07:23.815 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1b6c012400 con 0x7f1b740d07e0 2023-07-21T19:07:23.815 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7415e2e0 con 0x7f1b740d07e0 2023-07-21T19:07:23.815 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1b6c01b8c0 con 0x7f1b740d07e0 2023-07-21T19:07:23.816 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.794+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7404e500 con 0x7f1b740d07e0 2023-07-21T19:07:23.816 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.798+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f1b6c017070 con 0x7f1b740d07e0 2023-07-21T19:07:23.878 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:23.862+0000 7fdb5eed42c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T19:07:23.895 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.878+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb5f5b5d-c689-4d76-9d94-2a5746b45af8", "id": 4} v 0) v1 -- 0x7f1b740b18d0 con 0x7f1b740d07e0 2023-07-21T19:07:23.905 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b69ffb700 1 -- 172.21.15.145:0/1620820736 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb5f5b5d-c689-4d76-9d94-2a5746b45af8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1b6c01b480 con 0x7f1b740d07e0 2023-07-21T19:07:23.905 INFO:teuthology.orchestra.run.smithi145.stdout:4 2023-07-21T19:07:23.907 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b740d07e0 msgr2=0x7f1b740b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:23.907 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b740d07e0 0x7f1b740b1af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00ca70 tx=0x7f1b6c00caa0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.907 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 shutdown_connections 2023-07-21T19:07:23.907 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b740cd090 0x7f1b7415dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.907 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b740d07e0 0x7f1b740b1af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 --2- 172.21.15.145:0/1620820736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b740b0ee0 0x7f1b7415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 >> 172.21.15.145:0/1620820736 conn(0x7f1b74060c40 msgr2=0x7f1b740cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 shutdown_connections 2023-07-21T19:07:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:23.890+0000 7f1b7a39e700 1 -- 172.21.15.145:0/1620820736 wait complete. 2023-07-21T19:07:23.924 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15 5 2023-07-21T19:07:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.058+0000 7f5e627d5700 1 Processor -- start 2023-07-21T19:07:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e627d5700 1 -- start start 2023-07-21T19:07:24.078 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e627d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e5c0b1c50 0x7f5e5c071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.078 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e627d5700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5e5c0cf710 0x7f5e5c0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.078 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e627d5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c15c420 con 0x7f5e5c0d0210 2023-07-21T19:07:24.078 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e627d5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c070840 con 0x7f5e5c0b1c50 2023-07-21T19:07:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e627d5700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c070b20 con 0x7f5e5c0cf710 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e60d72700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5e5c0cf710 0x7f5e5c0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e5b7fe700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f5e5c0d0210 0x7f5e5c0cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55828/0 (socket says 172.21.15.145:55828) 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e5b7fe700 1 -- 172.21.15.145:0/470291396 learned_addr learned my addr 172.21.15.145:0/470291396 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e5bfff700 1 --2- 172.21.15.145:0/470291396 >> v2:172.21.15.123:3300/0 conn(0x7f5e5c0b1c50 0x7f5e5c071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e60d72700 1 -- 172.21.15.145:0/470291396 >> v2:172.21.15.123:3300/0 conn(0x7f5e5c0b1c50 msgr2=0x7f5e5c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e60d72700 1 --2- 172.21.15.145:0/470291396 >> v2:172.21.15.123:3300/0 conn(0x7f5e5c0b1c50 0x7f5e5c071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e60d72700 1 -- 172.21.15.145:0/470291396 >> v1:172.21.15.145:6789/0 conn(0x7f5e5c0d0210 legacy=0x7f5e5c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e60d72700 1 -- 172.21.15.145:0/470291396 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c070e00 con 0x7f5e5c0cf710 2023-07-21T19:07:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e5bfff700 1 --2- 172.21.15.145:0/470291396 >> v2:172.21.15.123:3300/0 conn(0x7f5e5c0b1c50 0x7f5e5c071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e60d72700 1 --2- 172.21.15.145:0/470291396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0cf710 0x7f5e5c0d0640 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c08cb80 tx=0x7f5e5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbc518842287700 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.062+0000 7f5e5affd700 1 -- 172.21.15.145:0/470291396 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400e070 con 0x7f5e5c0cf710 2023-07-21T19:07:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e5affd700 1 -- 172.21.15.145:0/470291396 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400bbd0 con 0x7f5e5c0cf710 2023-07-21T19:07:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e5affd700 1 -- 172.21.15.145:0/470291396 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54012430 con 0x7f5e5c0cf710 2023-07-21T19:07:24.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 -- 172.21.15.145:0/470291396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0cf710 msgr2=0x7f5e5c0d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 --2- 172.21.15.145:0/470291396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0cf710 0x7f5e5c0d0640 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c08cb80 tx=0x7f5e5400b330 comp rx=0 tx=0).stop 2023-07-21T19:07:24.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 -- 172.21.15.145:0/470291396 shutdown_connections 2023-07-21T19:07:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 --2- 172.21.15.145:0/470291396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0cf710 0x7f5e5c0d0640 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 --2- 172.21.15.145:0/470291396 >> v2:172.21.15.123:3300/0 conn(0x7f5e5c0b1c50 0x7f5e5c071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 -- 172.21.15.145:0/470291396 >> 172.21.15.145:0/470291396 conn(0x7f5e5c09b9c0 msgr2=0x7f5e5c0d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 -- 172.21.15.145:0/470291396 shutdown_connections 2023-07-21T19:07:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.066+0000 7f5e627d5700 1 -- 172.21.15.145:0/470291396 wait complete. 2023-07-21T19:07:24.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 Processor -- start 2023-07-21T19:07:24.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 -- start start 2023-07-21T19:07:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e5c0b1c50 0x7f5e5c09c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 0x7f5e5c0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0d0210 0x7f5e5c09cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c14ece0 con 0x7f5e5c0b1c50 2023-07-21T19:07:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c14f160 con 0x7f5e5c0d0210 2023-07-21T19:07:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e627d5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c1e3c80 con 0x7f5e5c0cf710 2023-07-21T19:07:24.088 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e60d72700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0d0210 0x7f5e5c09cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.088 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e5b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 0x7f5e5c0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.088 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e5bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e5c0b1c50 0x7f5e5c09c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.088 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e5b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 0x7f5e5c0b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:44344/0 (socket says 172.21.15.145:44344) 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.070+0000 7f5e5b7fe700 1 -- 172.21.15.145:0/2671638751 learned_addr learned my addr 172.21.15.145:0/2671638751 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e5b7fe700 1 -- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0d0210 msgr2=0x7f5e5c09cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e5b7fe700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0d0210 0x7f5e5c09cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e5b7fe700 1 -- 172.21.15.145:0/2671638751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e5c0b1c50 msgr2=0x7f5e5c09c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e5b7fe700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e5c0b1c50 0x7f5e5c09c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e5b7fe700 1 -- 172.21.15.145:0/2671638751 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009a70 con 0x7f5e5c0cf710 2023-07-21T19:07:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e5b7fe700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 0x7f5e5c0b56e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e50001eb0 tx=0x7f5e5000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50005d90 con 0x7f5e5c0cf710 2023-07-21T19:07:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e500070d0 con 0x7f5e5c0cf710 2023-07-21T19:07:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c1e3f60 con 0x7f5e5c0cf710 2023-07-21T19:07:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50007440 con 0x7f5e5c0cf710 2023-07-21T19:07:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c09ee50 con 0x7f5e5c0cf710 2023-07-21T19:07:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e5001c440 con 0x7f5e5c0cf710 2023-07-21T19:07:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5e5001cc70 con 0x7f5e5c0cf710 2023-07-21T19:07:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.074+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c1e4350 con 0x7f5e5c0cf710 2023-07-21T19:07:24.092 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.078+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5e50021060 con 0x7f5e5c0cf710 2023-07-21T19:07:24.147 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:24.130+0000 7fdb5eed42c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T19:07:24.172 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.158+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15", "id": 5} v 0) v1 -- 0x7f5e5c09bd90 con 0x7f5e5c0cf710 2023-07-21T19:07:24.182 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.166+0000 7f5e58ff9700 1 -- 172.21.15.145:0/2671638751 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e50017070 con 0x7f5e5c0cf710 2023-07-21T19:07:24.183 INFO:teuthology.orchestra.run.smithi145.stdout:5 2023-07-21T19:07:24.185 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.166+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 msgr2=0x7f5e5c0b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.185 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.166+0000 7f5e627d5700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 0x7f5e5c0b56e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e50001eb0 tx=0x7f5e5000c7b0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.185 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.166+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 shutdown_connections 2023-07-21T19:07:24.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.166+0000 7f5e627d5700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e5c0d0210 0x7f5e5c09cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.166+0000 7f5e627d5700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5c0cf710 0x7f5e5c0b56e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.170+0000 7f5e627d5700 1 --2- 172.21.15.145:0/2671638751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e5c0b1c50 0x7f5e5c09c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.170+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 >> 172.21.15.145:0/2671638751 conn(0x7f5e5c09b9c0 msgr2=0x7f5e5c0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:24.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.170+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 shutdown_connections 2023-07-21T19:07:24.187 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.170+0000 7f5e627d5700 1 -- 172.21.15.145:0/2671638751 wait complete. 2023-07-21T19:07:24.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new c794a195-8e96-441e-a326-56fc3bc0eac6 6 2023-07-21T19:07:24.224 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:24.210+0000 7fdb5eed42c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T19:07:24.235 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:24.221+0000 7f216b1ee2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T19:07:24.366 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.350+0000 7fcd949be700 1 Processor -- start 2023-07-21T19:07:24.367 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.350+0000 7fcd949be700 1 -- start start 2023-07-21T19:07:24.371 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd949be700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcd900b2d10 0x7fcd9006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.372 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd949be700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9006f810 con 0x7fcd9006f370 2023-07-21T19:07:24.372 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd949be700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9006fae0 con 0x7fcd90158cf0 2023-07-21T19:07:24.372 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd949be700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cbcd0 con 0x7fcd900b2d10 2023-07-21T19:07:24.373 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd8e59c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcd900b2d10 0x7fcd9006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.373 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd8e59c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcd900b2d10 0x7fcd9006aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:57240/0 (socket says 172.21.15.145:57240) 2023-07-21T19:07:24.373 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd8e59c700 1 -- 172.21.15.145:0/3497249164 learned_addr learned my addr 172.21.15.145:0/3497249164 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:24.373 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.354+0000 7fcd8e59c700 1 -- 172.21.15.145:0/3497249164 >> v1:172.21.15.145:6789/0 conn(0x7fcd90158cf0 legacy=0x7fcd900b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd8e59c700 1 -- 172.21.15.145:0/3497249164 >> v1:172.21.15.123:6789/0 conn(0x7fcd9006f370 legacy=0x7fcd900cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd8e59c700 1 -- 172.21.15.145:0/3497249164 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900cbfb0 con 0x7fcd900b2d10 2023-07-21T19:07:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd8e59c700 1 --2- 172.21.15.145:0/3497249164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd900b2d10 0x7fcd9006aa10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400bbb0 tx=0x7fcd8400bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530aefc219daefdb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd8dd9b700 1 -- 172.21.15.145:0/3497249164 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400dd90 con 0x7fcd900b2d10 2023-07-21T19:07:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd8dd9b700 1 -- 172.21.15.145:0/3497249164 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84010470 con 0x7fcd900b2d10 2023-07-21T19:07:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd8dd9b700 1 -- 172.21.15.145:0/3497249164 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84010820 con 0x7fcd900b2d10 2023-07-21T19:07:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 -- 172.21.15.145:0/3497249164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd900b2d10 msgr2=0x7fcd9006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 --2- 172.21.15.145:0/3497249164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd900b2d10 0x7fcd9006aa10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400bbb0 tx=0x7fcd8400bec0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 -- 172.21.15.145:0/3497249164 shutdown_connections 2023-07-21T19:07:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 --2- 172.21.15.145:0/3497249164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd900b2d10 0x7fcd9006aa10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 -- 172.21.15.145:0/3497249164 >> 172.21.15.145:0/3497249164 conn(0x7fcd900b05e0 msgr2=0x7fcd900b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 -- 172.21.15.145:0/3497249164 shutdown_connections 2023-07-21T19:07:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.358+0000 7fcd949be700 1 -- 172.21.15.145:0/3497249164 wait complete. 2023-07-21T19:07:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 Processor -- start 2023-07-21T19:07:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 -- start start 2023-07-21T19:07:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 0x7fcd90148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd900b2d10 0x7fcd9014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd90158cf0 0x7fcd90154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90148690 con 0x7fcd900b2d10 2023-07-21T19:07:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9014d7f0 con 0x7fcd9006f370 2023-07-21T19:07:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd949be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9014dad0 con 0x7fcd90158cf0 2023-07-21T19:07:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 0x7fcd90148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.380 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 0x7fcd90148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:57248/0 (socket says 172.21.15.145:57248) 2023-07-21T19:07:24.380 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8f59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd90158cf0 0x7fcd90154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.380 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 -- 172.21.15.145:0/3553633984 learned_addr learned my addr 172.21.15.145:0/3553633984 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:24.381 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8e59c700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd900b2d10 0x7fcd9014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.382 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 -- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd90158cf0 msgr2=0x7fcd90154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.382 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd90158cf0 0x7fcd90154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.382 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 -- 172.21.15.145:0/3553633984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd900b2d10 msgr2=0x7fcd9014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.382 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd900b2d10 0x7fcd9014ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.382 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 -- 172.21.15.145:0/3553633984 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8400b810 con 0x7fcd9006f370 2023-07-21T19:07:24.383 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8f59e700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd90158cf0 0x7fcd90154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:24.383 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd8ed9d700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 0x7fcd90148150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000c500 tx=0x7fcd8000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:24.383 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800052d0 con 0x7fcd9006f370 2023-07-21T19:07:24.384 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.362+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd80005430 con 0x7fcd9006f370 2023-07-21T19:07:24.384 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.366+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9014ddb0 con 0x7fcd9006f370 2023-07-21T19:07:24.384 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.366+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800055a0 con 0x7fcd9006f370 2023-07-21T19:07:24.384 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.366+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9014d4a0 con 0x7fcd9006f370 2023-07-21T19:07:24.385 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.366+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd80003be0 con 0x7fcd9006f370 2023-07-21T19:07:24.385 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.366+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcd80011d10 con 0x7fcd9006f370 2023-07-21T19:07:24.385 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.366+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9014e2d0 con 0x7fcd9006f370 2023-07-21T19:07:24.386 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.370+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fcd9014e2d0 con 0x7fcd9006f370 2023-07-21T19:07:24.401 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:24.389+0000 7f216b1ee2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T19:07:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.446+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c794a195-8e96-441e-a326-56fc3bc0eac6", "id": 6} v 0) v1 -- 0x7fcd9004e500 con 0x7fcd9006f370 2023-07-21T19:07:24.472 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.454+0000 7fcd777fe700 1 -- 172.21.15.145:0/3553633984 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c794a195-8e96-441e-a326-56fc3bc0eac6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd80017070 con 0x7fcd9006f370 2023-07-21T19:07:24.473 INFO:teuthology.orchestra.run.smithi145.stdout:6 2023-07-21T19:07:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 msgr2=0x7fcd90148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 0x7fcd90148150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000c500 tx=0x7fcd8000c810 comp rx=0 tx=0).stop 2023-07-21T19:07:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 shutdown_connections 2023-07-21T19:07:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd90158cf0 0x7fcd90154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd900b2d10 0x7fcd9014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 --2- 172.21.15.145:0/3553633984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd9006f370 0x7fcd90148150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 >> 172.21.15.145:0/3553633984 conn(0x7fcd900b05e0 msgr2=0x7fcd90151da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 shutdown_connections 2023-07-21T19:07:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.458+0000 7fcd949be700 1 -- 172.21.15.145:0/3553633984 wait complete. 2023-07-21T19:07:24.477 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:24.462+0000 7fdb5eed42c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T19:07:24.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new a49730d4-a3f9-4a85-85b3-3077b536c7b9 7 2023-07-21T19:07:24.559 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:24.542+0000 7fdb5eed42c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T19:07:24.649 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:24.634+0000 7fdb5eed42c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T19:07:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.678+0000 7f7ad8f86700 1 Processor -- start 2023-07-21T19:07:24.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.678+0000 7f7ad8f86700 1 -- start start 2023-07-21T19:07:24.697 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad8f86700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 0x7f7ad40d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.697 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad8f86700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ad415c1a0 0x7f7ad40b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.697 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad8f86700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b1130 0x7f7ad40af300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad8f86700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40d2530 con 0x7f7ad415c1a0 2023-07-21T19:07:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad8f86700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40b0ca0 con 0x7f7ad40b4130 2023-07-21T19:07:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad8f86700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40b03b0 con 0x7f7ad40b1130 2023-07-21T19:07:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad259c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 0x7f7ad40d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad259c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 0x7f7ad40d1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:39452/0 (socket says 172.21.15.145:39452) 2023-07-21T19:07:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad259c700 1 -- 172.21.15.145:0/65658067 learned_addr learned my addr 172.21.15.145:0/65658067 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/65658067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b1130 0x7f7ad40af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad1d9b700 1 --2- 172.21.15.145:0/65658067 >> v2:172.21.15.123:3300/0 conn(0x7f7ad415c1a0 0x7f7ad40b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 -- 172.21.15.145:0/65658067 >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 msgr2=0x7f7ad40d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/65658067 >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 0x7f7ad40d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 -- 172.21.15.145:0/65658067 >> v2:172.21.15.123:3300/0 conn(0x7f7ad415c1a0 msgr2=0x7f7ad40b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/65658067 >> v2:172.21.15.123:3300/0 conn(0x7f7ad415c1a0 0x7f7ad40b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 -- 172.21.15.145:0/65658067 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40b4a40 con 0x7f7ad40b1130 2023-07-21T19:07:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad259c700 1 --2- 172.21.15.145:0/65658067 >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 0x7f7ad40d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/65658067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b1130 0x7f7ad40af300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ad406e9d0 tx=0x7f7acc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b5767c8e161a1dd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad159a700 1 -- 172.21.15.145:0/65658067 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00e070 con 0x7f7ad40b1130 2023-07-21T19:07:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad159a700 1 -- 172.21.15.145:0/65658067 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00bb20 con 0x7f7ad40b1130 2023-07-21T19:07:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.682+0000 7f7ad159a700 1 -- 172.21.15.145:0/65658067 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc012430 con 0x7f7ad40b1130 2023-07-21T19:07:24.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 -- 172.21.15.145:0/65658067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b1130 msgr2=0x7f7ad40af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/65658067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b1130 0x7f7ad40af300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ad406e9d0 tx=0x7f7acc00b330 comp rx=0 tx=0).stop 2023-07-21T19:07:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 -- 172.21.15.145:0/65658067 shutdown_connections 2023-07-21T19:07:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/65658067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b1130 0x7f7ad40af300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/65658067 >> v2:172.21.15.123:3300/0 conn(0x7f7ad415c1a0 0x7f7ad40b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/65658067 >> v2:172.21.15.145:3300/0 conn(0x7f7ad40b4130 0x7f7ad40d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 -- 172.21.15.145:0/65658067 >> 172.21.15.145:0/65658067 conn(0x7f7ad409ba10 msgr2=0x7f7ad40d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:24.704 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 -- 172.21.15.145:0/65658067 shutdown_connections 2023-07-21T19:07:24.704 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.686+0000 7f7ad8f86700 1 -- 172.21.15.145:0/65658067 wait complete. 2023-07-21T19:07:24.704 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 Processor -- start 2023-07-21T19:07:24.705 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 -- start start 2023-07-21T19:07:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40b1130 0x7f7ad41557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 0x7f7ad40b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ad415c1a0 0x7f7ad40b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41560d0 con 0x7f7ad40b1130 2023-07-21T19:07:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c83b0 con 0x7f7ad415c1a0 2023-07-21T19:07:24.707 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad8f86700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c8690 con 0x7f7ad40b4130 2023-07-21T19:07:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad1d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 0x7f7ad40b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ad415c1a0 0x7f7ad40b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad1d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 0x7f7ad40b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:57388/0 (socket says 172.21.15.145:57388) 2023-07-21T19:07:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad1d9b700 1 -- 172.21.15.145:0/3085173536 learned_addr learned my addr 172.21.15.145:0/3085173536 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-07-21T19:07:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad259c700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40b1130 0x7f7ad41557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:24.709 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 -- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 msgr2=0x7f7ad40b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.709 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 0x7f7ad40b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.709 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 -- 172.21.15.145:0/3085173536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40b1130 msgr2=0x7f7ad41557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.709 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40b1130 0x7f7ad41557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.709 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 -- 172.21.15.145:0/3085173536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009510 con 0x7f7ad415c1a0 2023-07-21T19:07:24.709 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad1d9b700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 0x7f7ad40b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad259c700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40b1130 0x7f7ad41557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.690+0000 7f7ad2d9d700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ad415c1a0 0x7f7ad40b7a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7acc016000 tx=0x7f7acc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0048b0 con 0x7f7ad415c1a0 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc009a70 con 0x7f7ad415c1a0 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc020070 con 0x7f7ad415c1a0 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0276c0 con 0x7f7ad415c1a0 2023-07-21T19:07:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad40c8c50 con 0x7f7ad415c1a0 2023-07-21T19:07:24.711 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7acc027b20 con 0x7f7ad415c1a0 2023-07-21T19:07:24.711 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7acc022070 con 0x7f7ad415c1a0 2023-07-21T19:07:24.711 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.694+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad404dcb0 con 0x7f7ad415c1a0 2023-07-21T19:07:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.698+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7acc02c060 con 0x7f7ad415c1a0 2023-07-21T19:07:24.792 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:24.781+0000 7f216b1ee2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T19:07:24.793 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.778+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a49730d4-a3f9-4a85-85b3-3077b536c7b9", "id": 7} v 0) v1 -- 0x7f7ad415b8a0 con 0x7f7ad415c1a0 2023-07-21T19:07:24.804 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ac2ffd700 1 -- 172.21.15.145:0/3085173536 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a49730d4-a3f9-4a85-85b3-3077b536c7b9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7acc0360b0 con 0x7f7ad415c1a0 2023-07-21T19:07:24.805 INFO:teuthology.orchestra.run.smithi145.stdout:7 2023-07-21T19:07:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ad415c1a0 msgr2=0x7f7ad40b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ad415c1a0 0x7f7ad40b7a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7acc016000 tx=0x7f7acc004af0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 shutdown_connections 2023-07-21T19:07:24.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ad415c1a0 0x7f7ad40b7a30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ad40b4130 0x7f7ad40b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 --2- 172.21.15.145:0/3085173536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad40b1130 0x7f7ad41557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:24.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 >> 172.21.15.145:0/3085173536 conn(0x7f7ad409ba10 msgr2=0x7f7ad4157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:24.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 shutdown_connections 2023-07-21T19:07:24.807 INFO:teuthology.orchestra.run.smithi145.stderr:2023-07-21T19:07:24.790+0000 7f7ad8f86700 1 -- 172.21.15.145:0/3085173536 wait complete. 2023-07-21T19:07:24.828 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-21T19:07:24.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-21T19:07:24.837 INFO:tasks.ceph.osd.0:Started 2023-07-21T19:07:24.838 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-21T19:07:24.838 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-21T19:07:24.843 INFO:tasks.ceph.osd.1:Started 2023-07-21T19:07:24.844 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-21T19:07:24.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-21T19:07:24.849 INFO:tasks.ceph.osd.2:Started 2023-07-21T19:07:24.850 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-21T19:07:24.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-21T19:07:24.854 INFO:tasks.ceph.osd.3:Started 2023-07-21T19:07:24.855 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-21T19:07:24.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-21T19:07:24.878 INFO:tasks.ceph.osd.4:Started 2023-07-21T19:07:24.878 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-21T19:07:24.879 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-21T19:07:24.885 INFO:tasks.ceph.osd.5:Started 2023-07-21T19:07:24.885 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-21T19:07:24.886 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-21T19:07:24.890 INFO:tasks.ceph.osd.6:Started 2023-07-21T19:07:24.891 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-21T19:07:24.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-21T19:07:24.896 INFO:tasks.ceph.osd.7:Started 2023-07-21T19:07:24.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:25.066 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:25.053+0000 7f216b1ee2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T19:07:25.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.069+0000 7f0bb8a3a700 1 Processor -- start 2023-07-21T19:07:25.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.069+0000 7f0bb8a3a700 1 -- start start 2023-07-21T19:07:25.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.069+0000 7f0bb8a3a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0bb415bee0 0x7f0bb40ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.069+0000 7f0bb8a3a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 0x7f0bb40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.069+0000 7f0bb8a3a700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb415c2b0 con 0x7f0bb40cfde0 2023-07-21T19:07:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.069+0000 7f0bb8a3a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40cb9a0 con 0x7f0bb40ca890 2023-07-21T19:07:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40cad20 con 0x7f0bb415bee0 2023-07-21T19:07:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0baa59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 0x7f0bb40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb2d9d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0bb415bee0 0x7f0bb40ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0baa59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 0x7f0bb40cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58076/0 (socket says 172.21.15.123:58076) 2023-07-21T19:07:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0baa59c700 1 -- 172.21.15.123:0/396434396 learned_addr learned my addr 172.21.15.123:0/396434396 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:25.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb2d9d700 1 -- 172.21.15.123:0/396434396 >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 msgr2=0x7f0bb40cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb2d9d700 1 --2- 172.21.15.123:0/396434396 >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 0x7f0bb40cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb2d9d700 1 -- 172.21.15.123:0/396434396 >> v1:172.21.15.145:6789/0 conn(0x7f0bb40cfde0 legacy=0x7f0bb406fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb2d9d700 1 -- 172.21.15.123:0/396434396 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40cb000 con 0x7f0bb415bee0 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0baa59c700 1 --2- 172.21.15.123:0/396434396 >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 0x7f0bb40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb2d9d700 1 --2- 172.21.15.123:0/396434396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ace60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0bb406dac0 tx=0x7f0ba4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aed85ce54216c9bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb259c700 1 -- 172.21.15.123:0/396434396 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4005e50 con 0x7f0bb415bee0 2023-07-21T19:07:25.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb259c700 1 -- 172.21.15.123:0/396434396 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4006030 con 0x7f0bb415bee0 2023-07-21T19:07:25.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb259c700 1 -- 172.21.15.123:0/396434396 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40063c0 con 0x7f0bb415bee0 2023-07-21T19:07:25.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/396434396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb415bee0 msgr2=0x7f0bb40ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:25.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/396434396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ace60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0bb406dac0 tx=0x7f0ba4009b20 comp rx=0 tx=0).stop 2023-07-21T19:07:25.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/396434396 shutdown_connections 2023-07-21T19:07:25.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/396434396 >> v2:172.21.15.123:3300/0 conn(0x7f0bb40ca890 0x7f0bb40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/396434396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ace60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/396434396 >> 172.21.15.123:0/396434396 conn(0x7f0bb4099600 msgr2=0x7f0bb40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:25.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/396434396 shutdown_connections 2023-07-21T19:07:25.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.073+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/396434396 wait complete. 2023-07-21T19:07:25.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 Processor -- start 2023-07-21T19:07:25.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 -- start start 2023-07-21T19:07:25.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bb40ca890 0x7f0bb4153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:25.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb40cfde0 0x7f0bb40c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:25.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:25.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40c7310 con 0x7f0bb415bee0 2023-07-21T19:07:25.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40b52e0 con 0x7f0bb40cfde0 2023-07-21T19:07:25.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.077+0000 7f0bb8a3a700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40b5520 con 0x7f0bb40ca890 2023-07-21T19:07:25.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:25.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58092/0 (socket says 172.21.15.123:58092) 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 -- 172.21.15.123:0/2067425836 learned_addr learned my addr 172.21.15.123:0/2067425836 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0baa59c700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb40cfde0 0x7f0bb40c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb2d9d700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bb40ca890 0x7f0bb4153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 -- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bb40ca890 msgr2=0x7f0bb4153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bb40ca890 0x7f0bb4153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 -- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb40cfde0 msgr2=0x7f0bb40c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:25.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb40cfde0 0x7f0bb40c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 -- 172.21.15.123:0/2067425836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c009570 con 0x7f0bb415bee0 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb2d9d700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bb40ca890 0x7f0bb4153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb359e700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ccf70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00cbd0 tx=0x7f0bac00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac003c40 con 0x7f0bb415bee0 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac003da0 con 0x7f0bb415bee0 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba4009450 con 0x7f0bb415bee0 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00ab40 con 0x7f0bb415bee0 2023-07-21T19:07:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb40b5ae0 con 0x7f0bb415bee0 2023-07-21T19:07:25.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0bac0050d0 con 0x7f0bb415bee0 2023-07-21T19:07:25.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0bac012d20 con 0x7f0bb415bee0 2023-07-21T19:07:25.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.081+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb40c7480 con 0x7f0bb415bee0 2023-07-21T19:07:25.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.085+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0bb40c7480 con 0x7f0bb415bee0 2023-07-21T19:07:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.153+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb404e500 con 0x7f0bb415bee0 2023-07-21T19:07:25.167 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:25.153+0000 7f216b1ee2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T19:07:25.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0babfff700 1 -- 172.21.15.123:0/2067425836 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0bb415c2b0 con 0x7f0bb415bee0 2023-07-21T19:07:25.168 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:25.169 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:24.786122+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:25.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 msgr2=0x7f0bb40ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:25.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ccf70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00cbd0 tx=0x7f0bac00cee0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 shutdown_connections 2023-07-21T19:07:25.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bb40cfde0 0x7f0bb40c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bb415bee0 0x7f0bb40ccf70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 --2- 172.21.15.123:0/2067425836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bb40ca890 0x7f0bb4153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:25.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 >> 172.21.15.123:0/2067425836 conn(0x7f0bb4099600 msgr2=0x7f0bb40ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:25.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 shutdown_connections 2023-07-21T19:07:25.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:25.157+0000 7f0bb8a3a700 1 -- 172.21.15.123:0/2067425836 wait complete. 2023-07-21T19:07:25.186 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-21T19:07:25.187 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-21T19:07:25.193 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:25.178+0000 7fdb5eed42c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T19:07:25.251 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:25.237+0000 7f216b1ee2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T19:07:25.373 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:25.358+0000 7fdb5eed42c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T19:07:25.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:07:25.477+0000 7f1a62154700 -1 Falling back to public interface 2023-07-21T19:07:25.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:07:25.509+0000 7f5bb12e4700 -1 Falling back to public interface 2023-07-21T19:07:25.537 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:07:25.525+0000 7f9089c2a700 -1 Falling back to public interface 2023-07-21T19:07:25.546 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:07:25.530+0000 7f8606fdf700 -1 Falling back to public interface 2023-07-21T19:07:25.546 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:07:25.530+0000 7f181cbf1700 -1 Falling back to public interface 2023-07-21T19:07:25.547 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:07:25.530+0000 7f658b047700 -1 Falling back to public interface 2023-07-21T19:07:25.550 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:07:25.537+0000 7f05ff9e3700 -1 Falling back to public interface 2023-07-21T19:07:25.588 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:07:25.570+0000 7fbbdb9fd700 -1 Falling back to public interface 2023-07-21T19:07:25.763 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:25.746+0000 7fdb5eed42c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T19:07:25.992 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:25.994 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:25.978+0000 7fdb5eed42c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T19:07:26.084 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:26.066+0000 7fdb5eed42c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T19:07:26.119 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:26.105+0000 7f216b1ee2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T19:07:26.152 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 Processor -- start 2023-07-21T19:07:26.153 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 -- start start 2023-07-21T19:07:26.154 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc9540aff40 0x7fc9540b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:26.154 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 0x7fc9540b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:26.154 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9540cb7e0 con 0x7fc9540b0310 2023-07-21T19:07:26.155 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9540cd320 con 0x7fc9540aff40 2023-07-21T19:07:26.155 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.141+0000 7fc95bbc1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540ac280 con 0x7fc9540c9750 2023-07-21T19:07:26.157 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95995d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc9540aff40 0x7fc9540b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:26.157 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 0x7fc9540b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:26.157 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95915c700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fc9540b0310 0x7fc9540c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:51246/0 (socket says 172.21.15.123:51246) 2023-07-21T19:07:26.157 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 0x7fc9540b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:58602/0 (socket says 172.21.15.123:58602) 2023-07-21T19:07:26.157 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95995d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc9540aff40 0x7fc9540b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58100/0 (socket says 172.21.15.123:58100) 2023-07-21T19:07:26.157 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95915c700 1 -- 172.21.15.123:0/1314784007 learned_addr learned my addr 172.21.15.123:0/1314784007 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 -- 172.21.15.123:0/1314784007 >> v2:172.21.15.123:3300/0 conn(0x7fc9540aff40 msgr2=0x7fc9540b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 --2- 172.21.15.123:0/1314784007 >> v2:172.21.15.123:3300/0 conn(0x7fc9540aff40 0x7fc9540b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 -- 172.21.15.123:0/1314784007 >> v1:172.21.15.145:6789/0 conn(0x7fc9540b0310 legacy=0x7fc9540c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 -- 172.21.15.123:0/1314784007 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540ac560 con 0x7fc9540c9750 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95895b700 1 -- 172.21.15.123:0/1314784007 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283018705 0 0) 0x7fc9540cb7e0 con 0x7fc9540b0310 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95a15e700 1 --2- 172.21.15.123:0/1314784007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 0x7fc9540b20f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00bfa0 tx=0x7fc94c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34502201a09151e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:26.158 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95895b700 1 -- 172.21.15.123:0/1314784007 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c010070 con 0x7fc9540c9750 2023-07-21T19:07:26.159 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95895b700 1 -- 172.21.15.123:0/1314784007 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c00b2e0 con 0x7fc9540c9750 2023-07-21T19:07:26.159 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95895b700 1 -- 172.21.15.123:0/1314784007 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00dc40 con 0x7fc9540c9750 2023-07-21T19:07:26.159 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1314784007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 msgr2=0x7fc9540b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:26.159 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1314784007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 0x7fc9540b20f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00bfa0 tx=0x7fc94c00d330 comp rx=0 tx=0).stop 2023-07-21T19:07:26.160 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1314784007 shutdown_connections 2023-07-21T19:07:26.160 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1314784007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540c9750 0x7fc9540b20f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.160 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1314784007 >> v2:172.21.15.123:3300/0 conn(0x7fc9540aff40 0x7fc9540b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.160 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1314784007 >> 172.21.15.123:0/1314784007 conn(0x7fc9540cacd0 msgr2=0x7fc9540cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:26.161 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1314784007 shutdown_connections 2023-07-21T19:07:26.161 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.145+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1314784007 wait complete. 2023-07-21T19:07:26.161 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:26.146+0000 7fdb5eed42c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T19:07:26.162 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.149+0000 7fc95bbc1700 1 Processor -- start 2023-07-21T19:07:26.162 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.149+0000 7fc95bbc1700 1 -- start start 2023-07-21T19:07:26.162 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.149+0000 7fc95bbc1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540aff40 0x7fc95406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:26.163 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.149+0000 7fc95bbc1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9540b0310 0x7fc95406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:26.163 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 0x7fc954150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:26.164 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c1b20 con 0x7fc9540c9750 2023-07-21T19:07:26.164 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c9360 con 0x7fc9540b0310 2023-07-21T19:07:26.164 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540af480 con 0x7fc9540aff40 2023-07-21T19:07:26.165 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 0x7fc954150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:26.165 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 0x7fc954150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58112/0 (socket says 172.21.15.123:58112) 2023-07-21T19:07:26.166 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 -- 172.21.15.123:0/1438939892 learned_addr learned my addr 172.21.15.123:0/1438939892 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:26.166 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95995d700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540aff40 0x7fc95406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:26.166 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95915c700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9540b0310 0x7fc95406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:26.166 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 -- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540aff40 msgr2=0x7fc95406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540aff40 0x7fc95406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 -- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9540b0310 msgr2=0x7fc95406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9540b0310 0x7fc95406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 -- 172.21.15.123:0/1438939892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c00bc80 con 0x7fc9540c9750 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95a15e700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 0x7fc954150af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9540ac3c0 tx=0x7fc94c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004450 con 0x7fc9540c9750 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c0045b0 con 0x7fc9540c9750 2023-07-21T19:07:26.167 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004940 con 0x7fc9540c9750 2023-07-21T19:07:26.168 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9540c6540 con 0x7fc9540c9750 2023-07-21T19:07:26.168 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540c6b00 con 0x7fc9540c9750 2023-07-21T19:07:26.168 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc94c026750 con 0x7fc9540c9750 2023-07-21T19:07:26.168 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc94c01de10 con 0x7fc9540c9750 2023-07-21T19:07:26.169 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.153+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9540c6d20 con 0x7fc9540c9750 2023-07-21T19:07:26.170 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.157+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc94c044b20 con 0x7fc9540c9750 2023-07-21T19:07:26.207 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:26.197+0000 7f216b1ee2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T19:07:26.245 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.233+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc95404dcb0 con 0x7fc9540c9750 2023-07-21T19:07:26.246 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.233+0000 7fc94a7fc700 1 -- 172.21.15.123:0/1438939892 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc94c033030 con 0x7fc9540c9750 2023-07-21T19:07:26.247 INFO:teuthology.misc.health.smithi123.stdout: 2023-07-21T19:07:26.247 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:24.786122+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:26.248 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 msgr2=0x7fc954150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:26.249 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 0x7fc954150af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9540ac3c0 tx=0x7fc94c004af0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.249 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 shutdown_connections 2023-07-21T19:07:26.249 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9540b0310 0x7fc95406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.249 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9540c9750 0x7fc954150af0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.249 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 --2- 172.21.15.123:0/1438939892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9540aff40 0x7fc95406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:26.249 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 >> 172.21.15.123:0/1438939892 conn(0x7fc9540cacd0 msgr2=0x7fc9540cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:26.250 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 shutdown_connections 2023-07-21T19:07:26.250 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:26.237+0000 7fc95bbc1700 1 -- 172.21.15.123:0/1438939892 wait complete. 2023-07-21T19:07:26.266 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-21T19:07:26.395 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:26.381+0000 7f216b1ee2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T19:07:26.486 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:26.473+0000 7f216b1ee2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T19:07:26.588 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:26.577+0000 7f216b1ee2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T19:07:26.810 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:26.797+0000 7f216b1ee2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T19:07:27.081 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:27.069+0000 7f216b1ee2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T19:07:27.249 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:27.234+0000 7fdb5eed42c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T19:07:27.334 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:27.318+0000 7fdb5eed42c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T19:07:27.528 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:27.510+0000 7fdb5eed42c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T19:07:27.611 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:27.594+0000 7fdb5eed42c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T19:07:27.707 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:27.690+0000 7fdb5eed42c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T19:07:27.861 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:27.849+0000 7f216b1ee2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T19:07:27.910 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:27.894+0000 7fdb5eed42c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T19:07:28.167 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:28.150+0000 7fdb5eed42c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T19:07:28.942 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:28.928+0000 7f21524af700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-21T19:07:28.943 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T19:07:28.928+0000 7f21524af700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-21T19:07:29.148 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-07-21T19:07:29.130+0000 7fdb5eed42c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T19:07:29.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:07:29.412+0000 7f1a62154700 -1 osd.0 0 log_to_monitors true 2023-07-21T19:07:29.516 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:07:29.502+0000 7f658b047700 -1 osd.5 0 log_to_monitors true 2023-07-21T19:07:29.528 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:07:29.510+0000 7f8606fdf700 -1 osd.6 0 log_to_monitors true 2023-07-21T19:07:29.537 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:07:29.522+0000 7f181cbf1700 -1 osd.4 0 log_to_monitors true 2023-07-21T19:07:29.560 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:07:29.548+0000 7f5bb12e4700 -1 osd.1 0 log_to_monitors true 2023-07-21T19:07:29.577 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:07:29.564+0000 7f05ff9e3700 -1 osd.3 0 log_to_monitors true 2023-07-21T19:07:29.593 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:07:29.580+0000 7f9089c2a700 -1 osd.2 0 log_to_monitors true 2023-07-21T19:07:29.815 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:07:29.798+0000 7fbbdb9fd700 -1 osd.7 0 log_to_monitors true 2023-07-21T19:07:33.073 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:33.206 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:07:33.186+0000 7fbbd81c3700 -1 osd.7 0 waiting for initial osdmap 2023-07-21T19:07:33.210 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:07:33.194+0000 7fbbcf1f0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.307 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 Processor -- start 2023-07-21T19:07:33.307 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 -- start start 2023-07-21T19:07:33.308 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40157d90 0x7fda40071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:33.308 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda400ce6c0 0x7fda400cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:33.308 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda40071f90 con 0x7fda4015c5c0 2023-07-21T19:07:33.308 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda400cd450 con 0x7fda400ce6c0 2023-07-21T19:07:33.309 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda454c6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda400cce90 con 0x7fda40157d90 2023-07-21T19:07:33.309 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda3e7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fda4015c5c0 0x7fda400cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38286/0 (socket says 172.21.15.123:38286) 2023-07-21T19:07:33.309 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda3e7fc700 1 -- 172.21.15.123:0/4130584441 learned_addr learned my addr 172.21.15.123:0/4130584441 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:33.309 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda3ffff700 1 --2- 172.21.15.123:0/4130584441 >> v2:172.21.15.123:3300/0 conn(0x7fda400ce6c0 0x7fda400cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:33.313 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda3dffb700 1 -- 172.21.15.123:0/4130584441 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224973454 0 0) 0x7fda40071f90 con 0x7fda4015c5c0 2023-07-21T19:07:33.314 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.292+0000 7fda3dffb700 1 -- 172.21.15.123:0/4130584441 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda280035d0 con 0x7fda4015c5c0 2023-07-21T19:07:33.314 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3effd700 1 --2- 172.21.15.123:0/4130584441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40157d90 0x7fda40071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:33.314 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3ffff700 1 -- 172.21.15.123:0/4130584441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40157d90 msgr2=0x7fda40071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:33.314 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3ffff700 1 --2- 172.21.15.123:0/4130584441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40157d90 0x7fda40071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.314 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3ffff700 1 -- 172.21.15.123:0/4130584441 >> v1:172.21.15.123:6789/0 conn(0x7fda4015c5c0 legacy=0x7fda400cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:33.314 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3ffff700 1 -- 172.21.15.123:0/4130584441 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda400cd170 con 0x7fda400ce6c0 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3ffff700 1 --2- 172.21.15.123:0/4130584441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda400ce6c0 0x7fda400cf710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda3000bb00 tx=0x7fda3000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb60a39bbdab3e8d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3dffb700 1 -- 172.21.15.123:0/4130584441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000dc60 con 0x7fda400ce6c0 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda3dffb700 1 -- 172.21.15.123:0/4130584441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000ddc0 con 0x7fda400ce6c0 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda454c6700 1 -- 172.21.15.123:0/4130584441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda400ce6c0 msgr2=0x7fda400cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda454c6700 1 --2- 172.21.15.123:0/4130584441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda400ce6c0 0x7fda400cf710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda3000bb00 tx=0x7fda3000be10 comp rx=0 tx=0).stop 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda454c6700 1 -- 172.21.15.123:0/4130584441 shutdown_connections 2023-07-21T19:07:33.315 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda454c6700 1 --2- 172.21.15.123:0/4130584441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda400ce6c0 0x7fda400cf710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.316 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda454c6700 1 --2- 172.21.15.123:0/4130584441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40157d90 0x7fda40071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.316 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.296+0000 7fda454c6700 1 -- 172.21.15.123:0/4130584441 >> 172.21.15.123:0/4130584441 conn(0x7fda400b3580 msgr2=0x7fda400cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:33.316 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.300+0000 7fda454c6700 1 -- 172.21.15.123:0/4130584441 shutdown_connections 2023-07-21T19:07:33.316 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.300+0000 7fda454c6700 1 -- 172.21.15.123:0/4130584441 wait complete. 2023-07-21T19:07:33.316 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.300+0000 7fda454c6700 1 Processor -- start 2023-07-21T19:07:33.318 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.300+0000 7fda454c6700 1 -- start start 2023-07-21T19:07:33.318 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda454c6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda40157d90 0x7fda401514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:33.318 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda454c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda4015c5c0 0x7fda400cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:33.318 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda454c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 0x7fda400ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:33.318 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda454c6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda40158160 con 0x7fda4015c5c0 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda454c6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda400c7260 con 0x7fda40157d90 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda454c6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda400c83c0 con 0x7fda40151aa0 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 0x7fda400ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 0x7fda400ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:40620/0 (socket says 172.21.15.123:40620) 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 -- 172.21.15.123:0/2375887787 learned_addr learned my addr 172.21.15.123:0/2375887787 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3e7fc700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda4015c5c0 0x7fda400cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:33.319 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3effd700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda40157d90 0x7fda401514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 -- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda40157d90 msgr2=0x7fda401514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda40157d90 0x7fda401514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 -- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda4015c5c0 msgr2=0x7fda400cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda4015c5c0 0x7fda400cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 -- 172.21.15.123:0/2375887787 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3000b760 con 0x7fda40151aa0 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3effd700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda40157d90 0x7fda401514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:33.320 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3e7fc700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda4015c5c0 0x7fda400cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:33.321 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.304+0000 7fda3ffff700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 0x7fda400ce4f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda3000d5c0 tx=0x7fda30004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:33.321 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.308+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30006d10 con 0x7fda40151aa0 2023-07-21T19:07:33.321 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.308+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda30006e90 con 0x7fda40151aa0 2023-07-21T19:07:33.322 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.308+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30005c80 con 0x7fda40151aa0 2023-07-21T19:07:33.322 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.308+0000 7fda454c6700 1 -- 172.21.15.123:0/2375887787 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda400c6c10 con 0x7fda40151aa0 2023-07-21T19:07:33.322 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.308+0000 7fda454c6700 1 -- 172.21.15.123:0/2375887787 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda400c86a0 con 0x7fda40151aa0 2023-07-21T19:07:33.322 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.308+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda18005310 con 0x7fda40151aa0 2023-07-21T19:07:33.323 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.312+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fda3001b640 con 0x7fda40151aa0 2023-07-21T19:07:33.324 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.312+0000 7fda277fe700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fda2c0662b0 0x7fda2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:33.325 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.312+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fda30016030 con 0x7fda40151aa0 2023-07-21T19:07:33.326 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.312+0000 7fda3effd700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fda2c0662b0 0x7fda2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:33.327 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.316+0000 7fda3effd700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fda2c0662b0 0x7fda2c068760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda38007fa0 tx=0x7fda380074a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:33.333 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:07:33.316+0000 7f05fb822700 -1 osd.3 0 waiting for initial osdmap 2023-07-21T19:07:33.335 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.324+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fda300535e0 con 0x7fda40151aa0 2023-07-21T19:07:33.346 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:07:33.332+0000 7f05f31f0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.412 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:07:33.398+0000 7f1818a30700 -1 osd.4 0 waiting for initial osdmap 2023-07-21T19:07:33.419 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:07:33.402+0000 7f18103f0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:07:33.416+0000 7f5badaaa700 -1 osd.1 0 waiting for initial osdmap 2023-07-21T19:07:33.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:07:33.424+0000 7f5ba4bcb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.438 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:07:33.424+0000 7f90863f0700 -1 osd.2 0 waiting for initial osdmap 2023-07-21T19:07:33.450 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:07:33.436+0000 7f907d3f0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.517 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:07:33.502+0000 7f8602e1e700 -1 osd.6 0 waiting for initial osdmap 2023-07-21T19:07:33.525 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:07:33.510+0000 7f85fa7f0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.534 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:07:33.518+0000 7f6586e86700 -1 osd.5 0 waiting for initial osdmap 2023-07-21T19:07:33.543 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:07:33.526+0000 7f657e7f0700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:33.656 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.644+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda18005890 con 0x7fda40151aa0 2023-07-21T19:07:33.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.644+0000 7fda277fe700 1 -- 172.21.15.123:0/2375887787 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fda30053780 con 0x7fda40151aa0 2023-07-21T19:07:33.658 INFO:teuthology.misc.health.smithi123.stdout: 2023-07-21T19:07:33.658 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":12,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:30.938045+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:33.661 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fda2c0662b0 msgr2=0x7fda2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:33.661 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fda2c0662b0 0x7fda2c068760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda38007fa0 tx=0x7fda380074a0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 msgr2=0x7fda400ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 0x7fda400ce4f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda3000d5c0 tx=0x7fda30004770 comp rx=0 tx=0).stop 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 shutdown_connections 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fda2c0662b0 0x7fda2c068760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda40151aa0 0x7fda400ce4f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda4015c5c0 0x7fda400cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 --2- 172.21.15.123:0/2375887787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda40157d90 0x7fda401514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:33.663 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 >> 172.21.15.123:0/2375887787 conn(0x7fda400b3580 msgr2=0x7fda400c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:33.663 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 shutdown_connections 2023-07-21T19:07:33.663 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:33.648+0000 7fda257fa700 1 -- 172.21.15.123:0/2375887787 wait complete. 2023-07-21T19:07:33.679 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-21T19:07:33.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:07:33.708+0000 7f1a5e91a700 -1 osd.0 0 waiting for initial osdmap 2023-07-21T19:07:33.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:07:33.720+0000 7f1a559f0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T19:07:36.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:36.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:40.486 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:40.650 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.636+0000 7fa33e025700 1 Processor -- start 2023-07-21T19:07:40.651 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.636+0000 7fa33e025700 1 -- start start 2023-07-21T19:07:40.652 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa33e025700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:40.653 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa33e025700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3380ac180 0x7fa3380ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:40.653 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa33e025700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33815df70 con 0x7fa3380b0240 2023-07-21T19:07:40.653 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa33e025700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33815e250 con 0x7fa3380ac180 2023-07-21T19:07:40.653 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa33e025700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815e530 con 0x7fa33815da00 2023-07-21T19:07:40.654 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa337fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3380ac180 0x7fa3380ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:40.654 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa3377fe700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fa3380b0240 0x7fa3380b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:59072/0 (socket says 172.21.15.123:59072) 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa3377fe700 1 -- 172.21.15.123:0/1160840106 learned_addr learned my addr 172.21.15.123:0/1160840106 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa3367fc700 1 -- 172.21.15.123:0/1160840106 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119845271 0 0) 0x7fa33815df70 con 0x7fa3380b0240 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa3367fc700 1 -- 172.21.15.123:0/1160840106 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3200035d0 con 0x7fa3380b0240 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa337fff700 1 -- 172.21.15.123:0/1160840106 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 msgr2=0x7fa3380cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa337fff700 1 --2- 172.21.15.123:0/1160840106 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.655 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa337fff700 1 -- 172.21.15.123:0/1160840106 >> v1:172.21.15.145:6789/0 conn(0x7fa3380b0240 legacy=0x7fa3380b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:40.656 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa337fff700 1 -- 172.21.15.123:0/1160840106 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33815e810 con 0x7fa3380ac180 2023-07-21T19:07:40.656 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.640+0000 7fa336ffd700 1 --2- 172.21.15.123:0/1160840106 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:40.657 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa337fff700 1 --2- 172.21.15.123:0/1160840106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380ac180 0x7fa3380ccbb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa33000f370 tx=0x7fa33000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992a5f3774fb5532 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:40.657 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa3367fc700 1 -- 172.21.15.123:0/1160840106 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330012070 con 0x7fa3380ac180 2023-07-21T19:07:40.657 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa3367fc700 1 -- 172.21.15.123:0/1160840106 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000fe70 con 0x7fa3380ac180 2023-07-21T19:07:40.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa3367fc700 1 -- 172.21.15.123:0/1160840106 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000d2f0 con 0x7fa3380ac180 2023-07-21T19:07:40.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 -- 172.21.15.123:0/1160840106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380ac180 msgr2=0x7fa3380ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:40.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 --2- 172.21.15.123:0/1160840106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380ac180 0x7fa3380ccbb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa33000f370 tx=0x7fa33000f680 comp rx=0 tx=0).stop 2023-07-21T19:07:40.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 -- 172.21.15.123:0/1160840106 shutdown_connections 2023-07-21T19:07:40.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 --2- 172.21.15.123:0/1160840106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380ac180 0x7fa3380ccbb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.658 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 --2- 172.21.15.123:0/1160840106 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.659 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 -- 172.21.15.123:0/1160840106 >> 172.21.15.123:0/1160840106 conn(0x7fa3380cacd0 msgr2=0x7fa3380cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:40.659 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 -- 172.21.15.123:0/1160840106 shutdown_connections 2023-07-21T19:07:40.659 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.644+0000 7fa33e025700 1 -- 172.21.15.123:0/1160840106 wait complete. 2023-07-21T19:07:40.659 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 Processor -- start 2023-07-21T19:07:40.660 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 -- start start 2023-07-21T19:07:40.661 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3380ac180 0x7fa33814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:40.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 0x7fa33815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:40.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:40.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815c280 con 0x7fa3380b0240 2023-07-21T19:07:40.662 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815d2b0 con 0x7fa3380ac180 2023-07-21T19:07:40.663 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa33e025700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815c4f0 con 0x7fa33815da00 2023-07-21T19:07:40.664 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 0x7fa33815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:40.664 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 0x7fa33815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37536/0 (socket says 172.21.15.123:37536) 2023-07-21T19:07:40.664 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa336ffd700 1 -- 172.21.15.123:0/1334659001 learned_addr learned my addr 172.21.15.123:0/1334659001 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:40.664 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa337fff700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:40.665 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa3377fe700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3380ac180 0x7fa33814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:40.665 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.648+0000 7fa336ffd700 1 -- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 msgr2=0x7fa3380ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:40.665 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa336ffd700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.665 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa336ffd700 1 -- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3380ac180 msgr2=0x7fa33814ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:40.665 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa336ffd700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3380ac180 0x7fa33814ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.665 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa336ffd700 1 -- 172.21.15.123:0/1334659001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0094b0 con 0x7fa3380b0240 2023-07-21T19:07:40.666 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa336ffd700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 0x7fa33815a500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00ebe0 tx=0x7fa32c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:40.666 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00c8b0 con 0x7fa3380b0240 2023-07-21T19:07:40.666 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c00ca10 con 0x7fa3380b0240 2023-07-21T19:07:40.666 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33000f050 con 0x7fa3380b0240 2023-07-21T19:07:40.666 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00cda0 con 0x7fa3380b0240 2023-07-21T19:07:40.666 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33815cab0 con 0x7fa3380b0240 2023-07-21T19:07:40.667 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.652+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33804dcb0 con 0x7fa3380b0240 2023-07-21T19:07:40.667 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.656+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa32c013470 con 0x7fa3380b0240 2023-07-21T19:07:40.668 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.656+0000 7fa31ffff700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3240662f0 0x7fa3240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:40.669 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.656+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa32c083940 con 0x7fa3380b0240 2023-07-21T19:07:40.669 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.656+0000 7fa3377fe700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3240662f0 0x7fa3240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:40.670 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.656+0000 7fa3377fe700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3240662f0 0x7fa3240687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa328001230 tx=0x7fa328009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:40.674 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.660+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa32c051270 con 0x7fa3380b0240 2023-07-21T19:07:40.850 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.836+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3380c8470 con 0x7fa3380b0240 2023-07-21T19:07:40.851 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.840+0000 7fa31ffff700 1 -- 172.21.15.123:0/1334659001 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fa32c017090 con 0x7fa3380b0240 2023-07-21T19:07:40.852 INFO:teuthology.misc.health.smithi123.stdout: 2023-07-21T19:07:40.852 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":17,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:38.254195+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:40.856 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3240662f0 msgr2=0x7fa3240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:40.856 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3240662f0 0x7fa3240687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa328001230 tx=0x7fa328009040 comp rx=0 tx=0).stop 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 msgr2=0x7fa33815a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 0x7fa33815a500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00ebe0 tx=0x7fa32c009e30 comp rx=0 tx=0).stop 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 shutdown_connections 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3240662f0 0x7fa3240687a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa33815da00 0x7fa3380ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3380b0240 0x7fa33815a500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.857 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 --2- 172.21.15.123:0/1334659001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3380ac180 0x7fa33814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:40.858 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 >> 172.21.15.123:0/1334659001 conn(0x7fa3380cacd0 msgr2=0x7fa3380b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:40.858 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 shutdown_connections 2023-07-21T19:07:40.858 INFO:teuthology.misc.health.smithi123.stderr:2023-07-21T19:07:40.844+0000 7fa33e025700 1 -- 172.21.15.123:0/1334659001 wait complete. 2023-07-21T19:07:40.874 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-21T19:07:40.875 INFO:tasks.ceph:Creating RBD pool 2023-07-21T19:07:40.875 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-21T19:07:41.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.028+0000 7f737131f700 1 Processor -- start 2023-07-21T19:07:41.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.028+0000 7f737131f700 1 -- start start 2023-07-21T19:07:41.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f736c0b0ee0 0x7f736c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f736c0cd090 0x7f736c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0d0610 0x7f736c15f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0cd4e0 con 0x7f736c0cd090 2023-07-21T19:07:41.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0d1a60 con 0x7f736c0b0ee0 2023-07-21T19:07:41.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0d1ef0 con 0x7f736c0d0610 2023-07-21T19:07:41.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f736c0cd090 0x7f736c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f736c0cd090 0x7f736c0d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37546/0 (socket says 172.21.15.123:37546) 2023-07-21T19:07:41.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 -- 172.21.15.123:0/3942505098 learned_addr learned my addr 172.21.15.123:0/3942505098 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:41.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f7370b1e700 1 --2- 172.21.15.123:0/3942505098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0d0610 0x7f736c15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736bfff700 1 --2- 172.21.15.123:0/3942505098 >> v2:172.21.15.145:3300/0 conn(0x7f736c0b0ee0 0x7f736c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 -- 172.21.15.123:0/3942505098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0d0610 msgr2=0x7f736c15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 --2- 172.21.15.123:0/3942505098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0d0610 0x7f736c15f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 -- 172.21.15.123:0/3942505098 >> v2:172.21.15.145:3300/0 conn(0x7f736c0b0ee0 msgr2=0x7f736c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 --2- 172.21.15.123:0/3942505098 >> v2:172.21.15.145:3300/0 conn(0x7f736c0b0ee0 0x7f736c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 -- 172.21.15.123:0/3942505098 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0d0e50 con 0x7f736c0cd090 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736bfff700 1 --2- 172.21.15.123:0/3942505098 >> v2:172.21.15.145:3300/0 conn(0x7f736c0b0ee0 0x7f736c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736b7fe700 1 --2- 172.21.15.123:0/3942505098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0cd090 0x7f736c0d00d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f736c08b380 tx=0x7f7360009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d591d68f5fb22f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:41.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736affd700 1 -- 172.21.15.123:0/3942505098 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011830 con 0x7f736c0cd090 2023-07-21T19:07:41.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736affd700 1 -- 172.21.15.123:0/3942505098 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360011990 con 0x7f736c0cd090 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f736affd700 1 -- 172.21.15.123:0/3942505098 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011d20 con 0x7f736c0cd090 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 -- 172.21.15.123:0/3942505098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0cd090 msgr2=0x7f736c0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.032+0000 7f737131f700 1 --2- 172.21.15.123:0/3942505098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0cd090 0x7f736c0d00d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f736c08b380 tx=0x7f7360009bf0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 -- 172.21.15.123:0/3942505098 shutdown_connections 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 --2- 172.21.15.123:0/3942505098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0d0610 0x7f736c15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 --2- 172.21.15.123:0/3942505098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0cd090 0x7f736c0d00d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 --2- 172.21.15.123:0/3942505098 >> v2:172.21.15.145:3300/0 conn(0x7f736c0b0ee0 0x7f736c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 -- 172.21.15.123:0/3942505098 >> 172.21.15.123:0/3942505098 conn(0x7f736c060c40 msgr2=0x7f736c09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:41.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 -- 172.21.15.123:0/3942505098 shutdown_connections 2023-07-21T19:07:41.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 -- 172.21.15.123:0/3942505098 wait complete. 2023-07-21T19:07:41.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 Processor -- start 2023-07-21T19:07:41.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.036+0000 7f737131f700 1 -- start start 2023-07-21T19:07:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 0x7f736c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0cd090 0x7f736c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0d0610 0x7f736c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0c8f80 con 0x7f736c0d0610 2023-07-21T19:07:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c150390 con 0x7f736c0b0ee0 2023-07-21T19:07:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0c89c0 con 0x7f736c0cd090 2023-07-21T19:07:41.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f7370b1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0d0610 0x7f736c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 0x7f736c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 0x7f736c14fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:58018/0 (socket says 172.21.15.123:58018) 2023-07-21T19:07:41.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 -- 172.21.15.123:0/2400738896 learned_addr learned my addr 172.21.15.123:0/2400738896 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:41.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736b7fe700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0cd090 0x7f736c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 -- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0cd090 msgr2=0x7f736c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0cd090 0x7f736c0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 -- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0d0610 msgr2=0x7f736c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0d0610 0x7f736c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 -- 172.21.15.123:0/2400738896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360009570 con 0x7f736c0b0ee0 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736b7fe700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0cd090 0x7f736c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f736bfff700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 0x7f736c14fe50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f735c00d800 tx=0x7f735c00db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c004030 con 0x7f736c0b0ee0 2023-07-21T19:07:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c004190 con 0x7f736c0b0ee0 2023-07-21T19:07:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0c8ca0 con 0x7f736c0b0ee0 2023-07-21T19:07:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c004520 con 0x7f736c0b0ee0 2023-07-21T19:07:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.040+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c0cbc20 con 0x7f736c0b0ee0 2023-07-21T19:07:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.044+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c0cb7a0 con 0x7f736c0b0ee0 2023-07-21T19:07:41.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.044+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f735c0036c0 con 0x7f736c0b0ee0 2023-07-21T19:07:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.048+0000 7f7368ff9700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f73580662f0 0x7f73580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.048+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f735c083340 con 0x7f736c0b0ee0 2023-07-21T19:07:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.048+0000 7f736b7fe700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f73580662f0 0x7f73580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.048+0000 7f736b7fe700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f73580662f0 0x7f73580687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7360000c00 tx=0x7f7360008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.056+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f735c050d00 con 0x7f736c0b0ee0 2023-07-21T19:07:41.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.228+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f736c0cb7a0 con 0x7f736c0b0ee0 2023-07-21T19:07:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.352+0000 7f7368ff9700 1 -- 172.21.15.123:0/2400738896 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f736c0cb7a0 con 0x7f736c0b0ee0 2023-07-21T19:07:41.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f73580662f0 msgr2=0x7f73580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f73580662f0 0x7f73580687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7360000c00 tx=0x7f7360008030 comp rx=0 tx=0).stop 2023-07-21T19:07:41.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 msgr2=0x7f736c14fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 0x7f736c14fe50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f735c00d800 tx=0x7f735c00db10 comp rx=0 tx=0).stop 2023-07-21T19:07:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 shutdown_connections 2023-07-21T19:07:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f73580662f0 0x7f73580687a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736c0d0610 0x7f736c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f736c0cd090 0x7f736c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 --2- 172.21.15.123:0/2400738896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f736c0b0ee0 0x7f736c14fe50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 >> 172.21.15.123:0/2400738896 conn(0x7f736c060c40 msgr2=0x7f736c06fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 shutdown_connections 2023-07-21T19:07:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.356+0000 7f737131f700 1 -- 172.21.15.123:0/2400738896 wait complete. 2023-07-21T19:07:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'rbd' created 2023-07-21T19:07:41.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-21T19:07:41.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.552+0000 7fe1df59e700 1 Processor -- start 2023-07-21T19:07:41.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.552+0000 7fe1df59e700 1 -- start start 2023-07-21T19:07:41.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1df59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1d80ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1df59e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe1d80d07e0 0x7fe1d80af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1df59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d80cd4e0 con 0x7fe1d80cd090 2023-07-21T19:07:41.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1df59e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d80d0c60 con 0x7fe1d80d07e0 2023-07-21T19:07:41.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1df59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80d1a60 con 0x7fe1d80b0ee0 2023-07-21T19:07:41.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1ddd9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe1d80cd090 0x7fe1d80d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38290/0 (socket says 172.21.15.123:38290) 2023-07-21T19:07:41.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1ddd9b700 1 -- 172.21.15.123:0/314091212 learned_addr learned my addr 172.21.15.123:0/314091212 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:41.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1ded9d700 1 --2- 172.21.15.123:0/314091212 >> v2:172.21.15.145:3300/0 conn(0x7fe1d80d07e0 0x7fe1d80af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1de59c700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1d80ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032377542 0 0) 0x7fe1d0001110 con 0x7fe1d80cd090 2023-07-21T19:07:41.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.556+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c40035d0 con 0x7fe1d80cd090 2023-07-21T19:07:41.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 54712917 0 0) 0x7fe1c40035d0 con 0x7fe1d80cd090 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 msgr2=0x7fe1d80ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1d80ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 >> v2:172.21.15.145:3300/0 conn(0x7fe1d80d07e0 msgr2=0x7fe1d80af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 --2- 172.21.15.123:0/314091212 >> v2:172.21.15.145:3300/0 conn(0x7fe1d80d07e0 0x7fe1d80af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80d1ef0 con 0x7fe1d80cd090 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7fe1d0001800 con 0x7fe1d80cd090 2023-07-21T19:07:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 >> v1:172.21.15.123:6789/0 conn(0x7fe1d80cd090 legacy=0x7fe1d80d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1c4003a20 0x7fe1c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1c4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1c4004db0 0x7fe1c4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80d1a60 con 0x7fe1c4003a20 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c400ba30 con 0x7fe1c4004db0 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c400bb70 con 0x7fe1d80b0ee0 2023-07-21T19:07:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1ded9d700 1 --2- 172.21.15.123:0/314091212 >> v2:172.21.15.145:3300/0 conn(0x7fe1d80d07e0 0x7fe1d80af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1c4003a20 0x7fe1c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1ddd9b700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1c4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1ded9d700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1c4004db0 0x7fe1c4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 -- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 msgr2=0x7fe1c4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:41.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1c4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 -- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1c4004db0 msgr2=0x7fe1c4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:41.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1c4004db0 0x7fe1c4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 -- 172.21.15.123:0/314091212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40035d0 con 0x7fe1c4003a20 2023-07-21T19:07:41.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1ddd9b700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1d80b0ee0 0x7fe1c4004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:41.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1ded9d700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1c4004db0 0x7fe1c4005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:41.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1de59c700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1c4003a20 0x7fe1c4003e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009b70 tx=0x7fe1c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a30f680a04ca767 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:41.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00e660 con 0x7fe1c4003a20 2023-07-21T19:07:41.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc00e7c0 con 0x7fe1c4003a20 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1dd59a700 1 -- 172.21.15.123:0/314091212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00eb30 con 0x7fe1c4003a20 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1df59e700 1 -- 172.21.15.123:0/314091212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1c4003a20 msgr2=0x7fe1c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1df59e700 1 --2- 172.21.15.123:0/314091212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1c4003a20 0x7fe1c4003e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009b70 tx=0x7fe1c40058a0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1ded9d700 1 -- 172.21.15.123:0/314091212 reap_dead start 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1df59e700 1 -- 172.21.15.123:0/314091212 shutdown_connections 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1df59e700 1 -- 172.21.15.123:0/314091212 >> 172.21.15.123:0/314091212 conn(0x7fe1d8060c40 msgr2=0x7fe1d809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1df59e700 1 -- 172.21.15.123:0/314091212 shutdown_connections 2023-07-21T19:07:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.560+0000 7fe1df59e700 1 -- 172.21.15.123:0/314091212 wait complete. 2023-07-21T19:07:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.564+0000 7fe1df59e700 1 Processor -- start 2023-07-21T19:07:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.564+0000 7fe1df59e700 1 -- start start 2023-07-21T19:07:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1c4003a20 0x7fe1d815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 0x7fe1d815f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1d80af330 0x7fe1d81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d815f680 con 0x7fe1d8070b50 2023-07-21T19:07:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d815d1f0 con 0x7fe1d80af330 2023-07-21T19:07:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8071030 con 0x7fe1c4003a20 2023-07-21T19:07:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 0x7fe1d815f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 0x7fe1d815f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37578/0 (socket says 172.21.15.123:37578) 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 -- 172.21.15.123:0/1902316747 learned_addr learned my addr 172.21.15.123:0/1902316747 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ded9d700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1d80af330 0x7fe1d81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1de59c700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1c4003a20 0x7fe1d815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 -- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1c4003a20 msgr2=0x7fe1d815e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1c4003a20 0x7fe1d815e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 -- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1d80af330 msgr2=0x7fe1d81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1d80af330 0x7fe1d81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 -- 172.21.15.123:0/1902316747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d815d420 con 0x7fe1d8070b50 2023-07-21T19:07:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1ddd9b700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 0x7fe1d815f140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000db10 tx=0x7fe1d000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0004a90 con 0x7fe1d8070b50 2023-07-21T19:07:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0004bf0 con 0x7fe1d8070b50 2023-07-21T19:07:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d815d700 con 0x7fe1d8070b50 2023-07-21T19:07:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00070d0 con 0x7fe1d8070b50 2023-07-21T19:07:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.568+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d815dcc0 con 0x7fe1d8070b50 2023-07-21T19:07:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.572+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d804e500 con 0x7fe1d8070b50 2023-07-21T19:07:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.572+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1d0007230 con 0x7fe1d8070b50 2023-07-21T19:07:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.572+0000 7fe1caffd700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1bc066320 0x7fe1bc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.572+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fe1d0082e50 con 0x7fe1d8070b50 2023-07-21T19:07:41.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.572+0000 7fe1de59c700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1bc066320 0x7fe1bc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:41.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.576+0000 7fe1de59c700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1bc066320 0x7fe1bc0687d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0090b0 tx=0x7fe1cc01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:41.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.580+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe1d0050590 con 0x7fe1d8070b50 2023-07-21T19:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:41.752+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1d80cd4e0 con 0x7fe1d8070b50 2023-07-21T19:07:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.356+0000 7fe1caffd700 1 -- 172.21.15.123:0/1902316747 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe1d80cd4e0 con 0x7fe1d8070b50 2023-07-21T19:07:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1bc066320 msgr2=0x7fe1bc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1bc066320 0x7fe1bc0687d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0090b0 tx=0x7fe1cc01f040 comp rx=0 tx=0).stop 2023-07-21T19:07:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 msgr2=0x7fe1d815f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 0x7fe1d815f140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000db10 tx=0x7fe1d000de20 comp rx=0 tx=0).stop 2023-07-21T19:07:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 shutdown_connections 2023-07-21T19:07:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1bc066320 0x7fe1bc0687d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1d80af330 0x7fe1d81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1d8070b50 0x7fe1d815f140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 --2- 172.21.15.123:0/1902316747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1c4003a20 0x7fe1d815e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 >> 172.21.15.123:0/1902316747 conn(0x7fe1d8060c40 msgr2=0x7fe1d8071510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 shutdown_connections 2023-07-21T19:07:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.360+0000 7fe1df59e700 1 -- 172.21.15.123:0/1902316747 wait complete. 2023-07-21T19:07:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-21T19:07:42.394 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-21T19:07:42.395 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T19:07:42.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T19:07:42.402 INFO:tasks.ceph.mds.a:Started 2023-07-21T19:07:42.403 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T19:07:42.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T19:07:42.409 INFO:tasks.ceph.mds.c:Started 2023-07-21T19:07:42.409 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T19:07:42.409 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T19:07:42.417 INFO:tasks.ceph.mds.b:Started 2023-07-21T19:07:42.417 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T19:07:42.417 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T19:07:42.422 INFO:tasks.ceph.mds.d:Started 2023-07-21T19:07:42.422 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-21T19:07:42.422 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:42.517 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2023-07-21T19:07:42.526 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2023-07-21T19:07:42.538 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2023-07-21T19:07:42.539 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2023-07-21T19:07:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.576+0000 7f6330ee4700 1 Processor -- start 2023-07-21T19:07:42.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6330ee4700 1 -- start start 2023-07-21T19:07:42.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6330ee4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f632c15ffa0 0x7f632c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6330ee4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c0ca8a0 con 0x7f632c06dc50 2023-07-21T19:07:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6330ee4700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c0cbcd0 con 0x7f632c0cb180 2023-07-21T19:07:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6330ee4700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c0cbf70 con 0x7f632c15ffa0 2023-07-21T19:07:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6322ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f632c06dc50 0x7f632c0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36826/0 (socket says 172.21.15.123:36826) 2023-07-21T19:07:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.580+0000 7f6322ffd700 1 -- 172.21.15.123:0/1561224124 learned_addr learned my addr 172.21.15.123:0/1561224124 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1561224124 >> v2:172.21.15.145:3300/0 conn(0x7f632c15ffa0 0x7f632c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749807309 0 0) 0x7f6314001110 con 0x7f632c06dc50 2023-07-21T19:07:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63180035d0 con 0x7f632c06dc50 2023-07-21T19:07:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155092198 0 0) 0x7f63180035d0 con 0x7f632c06dc50 2023-07-21T19:07:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 >> v2:172.21.15.145:3300/0 conn(0x7f632c15ffa0 msgr2=0x7f632c06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 --2- 172.21.15.123:0/1561224124 >> v2:172.21.15.145:3300/0 conn(0x7f632c15ffa0 0x7f632c06d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 >> v1:172.21.15.145:6789/0 conn(0x7f632c0cb180 legacy=0x7f632c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0cc250 con 0x7f632c06dc50 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f6314001800 con 0x7f632c06dc50 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 >> v1:172.21.15.123:6789/0 conn(0x7f632c06dc50 legacy=0x7f632c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6318003a20 0x7f6318003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318004870 0x7f6318004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6318005220 0x7f631800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0cbf70 con 0x7f6318003a20 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631800c130 con 0x7f6318005220 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631800c2f0 con 0x7f6318004870 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6318003a20 0x7f6318003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f6322ffd700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318004870 0x7f6318004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632bfff700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6318005220 0x7f631800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 -- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318004870 msgr2=0x7f6318004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:42.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318004870 0x7f6318004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 -- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6318005220 msgr2=0x7f631800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:42.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6318005220 0x7f631800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 -- 172.21.15.123:0/1561224124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180035d0 con 0x7f6318003a20 2023-07-21T19:07:42.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632bfff700 1 -- 172.21.15.123:0/1561224124 reap_dead start 2023-07-21T19:07:42.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6318003a20 0x7f6318003e30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f631c009b70 tx=0x7f63180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52c75289ed05e3c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00e6c0 con 0x7f6318003a20 2023-07-21T19:07:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00e820 con 0x7f6318003a20 2023-07-21T19:07:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f632affd700 1 -- 172.21.15.123:0/1561224124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00eb90 con 0x7f6318003a20 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f6330ee4700 1 -- 172.21.15.123:0/1561224124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6318003a20 msgr2=0x7f6318003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6318003a20 0x7f6318003e30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f631c009b70 tx=0x7f63180058a0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f6330ee4700 1 -- 172.21.15.123:0/1561224124 shutdown_connections 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1561224124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6318003a20 0x7f6318003e30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.584+0000 7f6330ee4700 1 -- 172.21.15.123:0/1561224124 >> 172.21.15.123:0/1561224124 conn(0x7f632c06e960 msgr2=0x7f632c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.588+0000 7f6330ee4700 1 -- 172.21.15.123:0/1561224124 shutdown_connections 2023-07-21T19:07:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.588+0000 7f6330ee4700 1 -- 172.21.15.123:0/1561224124 wait complete. 2023-07-21T19:07:42.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.588+0000 7f6330ee4700 1 Processor -- start 2023-07-21T19:07:42.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.588+0000 7f6330ee4700 1 -- start start 2023-07-21T19:07:42.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318003a20 0x7f632c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 0x7f632c0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f632c0c5510 0x7f632c0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0c4510 con 0x7f632c0c3b80 2023-07-21T19:07:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0c0070 con 0x7f632c0c5510 2023-07-21T19:07:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0c0350 con 0x7f6318003a20 2023-07-21T19:07:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 0x7f632c0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f632b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318003a20 0x7f632c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 0x7f632c0c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33764/0 (socket says 172.21.15.123:33764) 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f632b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318003a20 0x7f632c151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:57608/0 (socket says 172.21.15.123:57608) 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 -- 172.21.15.123:0/1551487927 learned_addr learned my addr 172.21.15.123:0/1551487927 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f632bfff700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f632c0c5510 0x7f632c0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 -- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318003a20 msgr2=0x7f632c151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318003a20 0x7f632c151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 -- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f632c0c5510 msgr2=0x7f632c0c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f632c0c5510 0x7f632c0c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 -- 172.21.15.123:0/1551487927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0c0630 con 0x7f632c0c3b80 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6322ffd700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 0x7f632c0c3fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f631400e780 tx=0x7f631400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314010510 con 0x7f632c0c3b80 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314010690 con 0x7f632c0c3b80 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c0c0910 con 0x7f632c0c3b80 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314010a40 con 0x7f632c0c3b80 2023-07-21T19:07:42.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.592+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c0c5ec0 con 0x7f632c0c3b80 2023-07-21T19:07:42.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.596+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632c071620 con 0x7f632c0c3b80 2023-07-21T19:07:42.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.596+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6314010ba0 con 0x7f632c0c3b80 2023-07-21T19:07:42.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.596+0000 7f6328ff9700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f630c0662f0 0x7f630c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.596+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f63140830e0 con 0x7f632c0c3b80 2023-07-21T19:07:42.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.596+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f630c0662f0 0x7f630c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.600+0000 7f632b7fe700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f630c0662f0 0x7f630c0687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f631c0090b0 tx=0x7f631c01e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.604+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f63140507a0 con 0x7f632c0c3b80 2023-07-21T19:07:42.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.772+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f632c0ca8a0 con 0x7f632c0c3b80 2023-07-21T19:07:42.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.772+0000 7f6328ff9700 1 -- 172.21.15.123:0/1551487927 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14709 (secure 0 0 0) 0x7f632c0ca8a0 con 0x7f632c0c3b80 2023-07-21T19:07:42.785 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:42.785 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:42.348173+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f630c0662f0 msgr2=0x7f630c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f630c0662f0 0x7f630c0687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f631c0090b0 tx=0x7f631c01e040 comp rx=0 tx=0).stop 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 msgr2=0x7f632c0c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 0x7f632c0c3fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f631400e780 tx=0x7f631400ea90 comp rx=0 tx=0).stop 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 shutdown_connections 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f630c0662f0 0x7f630c0687a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f632c0c5510 0x7f632c0c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632c0c3b80 0x7f632c0c3fd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 --2- 172.21.15.123:0/1551487927 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6318003a20 0x7f632c151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 >> 172.21.15.123:0/1551487927 conn(0x7f632c06e960 msgr2=0x7f632c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 shutdown_connections 2023-07-21T19:07:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.776+0000 7f6330ee4700 1 -- 172.21.15.123:0/1551487927 wait complete. 2023-07-21T19:07:42.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T19:07:42.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:07:42.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e91f700 1 Processor -- start 2023-07-21T19:07:42.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e91f700 1 -- start start 2023-07-21T19:07:42.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e91f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f31580d07e0 0x7f31581669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e91f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580d1a60 con 0x7f31580cd260 2023-07-21T19:07:42.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e91f700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580d1ef0 con 0x7f31580b0ee0 2023-07-21T19:07:42.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e91f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580d0c60 con 0x7f31580d07e0 2023-07-21T19:07:42.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.960+0000 7f315e11e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f31580d07e0 0x7f31581669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315d11c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f31580cd260 0x7f31580d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36828/0 (socket says 172.21.15.123:36828) 2023-07-21T19:07:42.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315d11c700 1 -- 172.21.15.123:0/1207070200 learned_addr learned my addr 172.21.15.123:0/1207070200 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:42.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e11e700 1 -- 172.21.15.123:0/1207070200 >> v1:172.21.15.145:6789/0 conn(0x7f31580b0ee0 legacy=0x7f31580ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e11e700 1 -- 172.21.15.123:0/1207070200 >> v1:172.21.15.123:6789/0 conn(0x7f31580cd260 legacy=0x7f31580d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e11e700 1 -- 172.21.15.123:0/1207070200 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580d0e50 con 0x7f31580d07e0 2023-07-21T19:07:42.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e11e700 1 --2- 172.21.15.123:0/1207070200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31581669b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3150009d90 tx=0x7f315000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b1b0383c8ca26c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:42.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315c91b700 1 -- 172.21.15.123:0/1207070200 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000e070 con 0x7f31580d07e0 2023-07-21T19:07:42.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315c91b700 1 -- 172.21.15.123:0/1207070200 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000bbd0 con 0x7f31580d07e0 2023-07-21T19:07:42.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315c91b700 1 -- 172.21.15.123:0/1207070200 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150012430 con 0x7f31580d07e0 2023-07-21T19:07:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 -- 172.21.15.123:0/1207070200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 msgr2=0x7f31581669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 --2- 172.21.15.123:0/1207070200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31581669b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3150009d90 tx=0x7f315000b330 comp rx=0 tx=0).stop 2023-07-21T19:07:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 -- 172.21.15.123:0/1207070200 shutdown_connections 2023-07-21T19:07:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 --2- 172.21.15.123:0/1207070200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31581669b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 -- 172.21.15.123:0/1207070200 >> 172.21.15.123:0/1207070200 conn(0x7f3158060c40 msgr2=0x7f315809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 -- 172.21.15.123:0/1207070200 shutdown_connections 2023-07-21T19:07:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.964+0000 7f315e91f700 1 -- 172.21.15.123:0/1207070200 wait complete. 2023-07-21T19:07:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 Processor -- start 2023-07-21T19:07:42.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 -- start start 2023-07-21T19:07:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31580b0ee0 0x7f315815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31580cd260 0x7f31580c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31580cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315815c070 con 0x7f31580d07e0 2023-07-21T19:07:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580ca220 con 0x7f31580cd260 2023-07-21T19:07:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580c9ed0 con 0x7f31580b0ee0 2023-07-21T19:07:42.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31580cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31580cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33784/0 (socket says 172.21.15.123:33784) 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 -- 172.21.15.123:0/1775904511 learned_addr learned my addr 172.21.15.123:0/1775904511 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315d11c700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31580cd260 0x7f31580c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315d91d700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31580b0ee0 0x7f315815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 -- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31580b0ee0 msgr2=0x7f315815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31580b0ee0 0x7f315815bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 -- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31580cd260 msgr2=0x7f31580c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31580cd260 0x7f31580c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 -- 172.21.15.123:0/1775904511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009a70 con 0x7f31580d07e0 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315d91d700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31580b0ee0 0x7f315815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e11e700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31580cc2b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f315808adc0 tx=0x7f3150004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500098f0 con 0x7f31580d07e0 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150020070 con 0x7f31580d07e0 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150004260 con 0x7f31580d07e0 2023-07-21T19:07:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31580c84c0 con 0x7f31580d07e0 2023-07-21T19:07:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.968+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580cbef0 con 0x7f31580d07e0 2023-07-21T19:07:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.972+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31580cc0b0 con 0x7f31580d07e0 2023-07-21T19:07:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.972+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31500043c0 con 0x7f31580d07e0 2023-07-21T19:07:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.976+0000 7f314e7fc700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f313c0662f0 0x7f313c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.976+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3150022070 con 0x7f31580d07e0 2023-07-21T19:07:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.976+0000 7f315d91d700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f313c0662f0 0x7f313c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:42.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.976+0000 7f315d91d700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f313c0662f0 0x7f313c0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3154000f60 tx=0x7f3154009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:42.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:42.980+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3150053080 con 0x7f31580d07e0 2023-07-21T19:07:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.156+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f315804e500 con 0x7f31580d07e0 2023-07-21T19:07:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.156+0000 7f314e7fc700 1 -- 172.21.15.123:0/1775904511 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31500566a0 con 0x7f31580d07e0 2023-07-21T19:07:43.168 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:07:43.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.156+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f313c0662f0 msgr2=0x7f313c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.156+0000 7f315e91f700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f313c0662f0 0x7f313c0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3154000f60 tx=0x7f3154009040 comp rx=0 tx=0).stop 2023-07-21T19:07:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.156+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 msgr2=0x7f31580cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.156+0000 7f315e91f700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31580cc2b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f315808adc0 tx=0x7f3150004af0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 shutdown_connections 2023-07-21T19:07:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f313c0662f0 0x7f313c0687a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31580cd260 0x7f31580c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31580d07e0 0x7f31580cc2b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 --2- 172.21.15.123:0/1775904511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31580b0ee0 0x7f315815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 >> 172.21.15.123:0/1775904511 conn(0x7f3158060c40 msgr2=0x7f31580b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 shutdown_connections 2023-07-21T19:07:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.160+0000 7f315e91f700 1 -- 172.21.15.123:0/1775904511 wait complete. 2023-07-21T19:07:43.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:07:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.352+0000 7f4ae359e700 1 Processor -- start 2023-07-21T19:07:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.352+0000 7f4ae359e700 1 -- start start 2023-07-21T19:07:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4ae41604f0 0x7f4ae40af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae40afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40d0930 con 0x7f4ae415fa10 2023-07-21T19:07:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae40b4ae0 con 0x7f4ae41604f0 2023-07-21T19:07:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40ce560 con 0x7f4ae40af6f0 2023-07-21T19:07:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae1d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4ae41604f0 0x7f4ae40af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae259c700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f4ae415fa10 0x7f4ae415fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:51248/0 (socket says 172.21.15.123:51248) 2023-07-21T19:07:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae259c700 1 -- 172.21.15.123:0/924834961 learned_addr learned my addr 172.21.15.123:0/924834961 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae2d9d700 1 --2- 172.21.15.123:0/924834961 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae40afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/924834961 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 msgr2=0x7f4ae40afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae1d9b700 1 --2- 172.21.15.123:0/924834961 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae40afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/924834961 >> v1:172.21.15.145:6789/0 conn(0x7f4ae415fa10 legacy=0x7f4ae415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/924834961 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae415c300 con 0x7f4ae41604f0 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae1d9b700 1 --2- 172.21.15.123:0/924834961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae41604f0 0x7f4ae40af1b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009850 tx=0x7f4ad8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8569053750aaa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae159a700 1 -- 172.21.15.123:0/924834961 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8011830 con 0x7f4ae41604f0 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae159a700 1 -- 172.21.15.123:0/924834961 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad8011990 con 0x7f4ae41604f0 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae159a700 1 -- 172.21.15.123:0/924834961 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8011d20 con 0x7f4ae41604f0 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- 172.21.15.123:0/924834961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae41604f0 msgr2=0x7f4ae40af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 --2- 172.21.15.123:0/924834961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae41604f0 0x7f4ae40af1b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009850 tx=0x7f4ad8009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- 172.21.15.123:0/924834961 shutdown_connections 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 --2- 172.21.15.123:0/924834961 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae40afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 --2- 172.21.15.123:0/924834961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae41604f0 0x7f4ae40af1b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- 172.21.15.123:0/924834961 >> 172.21.15.123:0/924834961 conn(0x7f4ae409b850 msgr2=0x7f4ae40d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- 172.21.15.123:0/924834961 shutdown_connections 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.356+0000 7f4ae359e700 1 -- 172.21.15.123:0/924834961 wait complete. 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 Processor -- start 2023-07-21T19:07:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 -- start start 2023-07-21T19:07:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae41f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 0x7f4ae415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae41604f0 0x7f4ae4148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4148b20 con 0x7f4ae415fa10 2023-07-21T19:07:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4148820 con 0x7f4ae41604f0 2023-07-21T19:07:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41f2030 con 0x7f4ae40af6f0 2023-07-21T19:07:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 0x7f4ae415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 0x7f4ae415a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33794/0 (socket says 172.21.15.123:33794) 2023-07-21T19:07:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/1944781341 learned_addr learned my addr 172.21.15.123:0/1944781341 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae41f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.360+0000 7f4ae2d9d700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae41604f0 0x7f4ae4148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 msgr2=0x7f4ae41f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae1d9b700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae41f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae41604f0 msgr2=0x7f4ae4148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae1d9b700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae41604f0 0x7f4ae4148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae1d9b700 1 -- 172.21.15.123:0/1944781341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80094b0 con 0x7f4ae415fa10 2023-07-21T19:07:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae2d9d700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae41604f0 0x7f4ae4148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae1d9b700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 0x7f4ae415a5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009fd0 tx=0x7f4ad8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8004250 con 0x7f4ae415fa10 2023-07-21T19:07:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae41f2310 con 0x7f4ae415fa10 2023-07-21T19:07:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae41f25f0 con 0x7f4ae415fa10 2023-07-21T19:07:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad801f070 con 0x7f4ae415fa10 2023-07-21T19:07:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.364+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80045b0 con 0x7f4ae415fa10 2023-07-21T19:07:43.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.368+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac8005310 con 0x7f4ae415fa10 2023-07-21T19:07:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.368+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ad8021030 con 0x7f4ae415fa10 2023-07-21T19:07:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.368+0000 7f4ad2ffd700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4ac40662f0 0x7f4ac40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.368+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4ad8084d80 con 0x7f4ae415fa10 2023-07-21T19:07:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.368+0000 7f4ae259c700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4ac40662f0 0x7f4ac40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.368+0000 7f4ae259c700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4ac40662f0 0x7f4ac40687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4005980 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.376+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4ad8052450 con 0x7f4ae415fa10 2023-07-21T19:07:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.544+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ac8005b40 con 0x7f4ae415fa10 2023-07-21T19:07:43.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.544+0000 7f4ad2ffd700 1 -- 172.21.15.123:0/1944781341 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ad8055a70 con 0x7f4ae415fa10 2023-07-21T19:07:43.557 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:07:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.544+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4ac40662f0 msgr2=0x7f4ac40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4ac40662f0 0x7f4ac40687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4005980 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2023-07-21T19:07:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 msgr2=0x7f4ae415a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 0x7f4ae415a5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009fd0 tx=0x7f4ad8004770 comp rx=0 tx=0).stop 2023-07-21T19:07:43.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 shutdown_connections 2023-07-21T19:07:43.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4ac40662f0 0x7f4ac40687a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae41604f0 0x7f4ae4148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ae415fa10 0x7f4ae415a5c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 --2- 172.21.15.123:0/1944781341 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae40af6f0 0x7f4ae41f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 >> 172.21.15.123:0/1944781341 conn(0x7f4ae409b850 msgr2=0x7f4ae40b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:43.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 shutdown_connections 2023-07-21T19:07:43.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.548+0000 7f4ae359e700 1 -- 172.21.15.123:0/1944781341 wait complete. 2023-07-21T19:07:43.578 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:07:43.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.736+0000 7fc12f0a2700 1 Processor -- start 2023-07-21T19:07:43.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12f0a2700 1 -- start start 2023-07-21T19:07:43.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12f0a2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc12815bf20 0x7fc1280b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12f0a2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1280d1430 0x7fc1280b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12f0a2700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12815c2f0 con 0x7fc1280b1530 2023-07-21T19:07:43.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12f0a2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc128070830 con 0x7fc12815bf20 2023-07-21T19:07:43.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12f0a2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc128070b10 con 0x7fc1280d1430 2023-07-21T19:07:43.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12ce3e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc12815bf20 0x7fc1280b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12ce3e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc12815bf20 0x7fc1280b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33800/0 (socket says 172.21.15.123:33800) 2023-07-21T19:07:43.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12ce3e700 1 -- 172.21.15.123:0/86780956 learned_addr learned my addr 172.21.15.123:0/86780956 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:43.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.740+0000 7fc12d63f700 1 --2- 172.21.15.123:0/86780956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1280d1430 0x7fc1280b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12ce3e700 1 -- 172.21.15.123:0/86780956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1280d1430 msgr2=0x7fc1280b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:43.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12ce3e700 1 --2- 172.21.15.123:0/86780956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1280d1430 0x7fc1280b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12ce3e700 1 -- 172.21.15.123:0/86780956 >> v1:172.21.15.145:6789/0 conn(0x7fc1280b1530 legacy=0x7fc1280d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12ce3e700 1 -- 172.21.15.123:0/86780956 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280cccc0 con 0x7fc12815bf20 2023-07-21T19:07:43.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12ce3e700 1 --2- 172.21.15.123:0/86780956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc12815bf20 0x7fc1280b5420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009910 tx=0x7fc11c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be0d0e579e42ddd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:43.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc1277fe700 1 -- 172.21.15.123:0/86780956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00ba60 con 0x7fc12815bf20 2023-07-21T19:07:43.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc1277fe700 1 -- 172.21.15.123:0/86780956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00bbc0 con 0x7fc12815bf20 2023-07-21T19:07:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc1277fe700 1 -- 172.21.15.123:0/86780956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c009e60 con 0x7fc12815bf20 2023-07-21T19:07:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 -- 172.21.15.123:0/86780956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc12815bf20 msgr2=0x7fc1280b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/86780956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc12815bf20 0x7fc1280b5420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009910 tx=0x7fc11c009c20 comp rx=0 tx=0).stop 2023-07-21T19:07:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 -- 172.21.15.123:0/86780956 shutdown_connections 2023-07-21T19:07:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/86780956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1280d1430 0x7fc1280b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/86780956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc12815bf20 0x7fc1280b5420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 -- 172.21.15.123:0/86780956 >> 172.21.15.123:0/86780956 conn(0x7fc12806fc80 msgr2=0x7fc128070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:43.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 -- 172.21.15.123:0/86780956 shutdown_connections 2023-07-21T19:07:43.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.744+0000 7fc12f0a2700 1 -- 172.21.15.123:0/86780956 wait complete. 2023-07-21T19:07:43.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 Processor -- start 2023-07-21T19:07:43.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 -- start start 2023-07-21T19:07:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1280b1530 0x7fc12814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 0x7fc12814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc12815bf20 0x7fc1280c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280c60c0 con 0x7fc1280d1430 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280b4960 con 0x7fc1280b1530 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280b4c40 con 0x7fc12815bf20 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 0x7fc12814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 0x7fc12814f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33810/0 (socket says 172.21.15.123:33810) 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 -- 172.21.15.123:0/3570663543 learned_addr learned my addr 172.21.15.123:0/3570663543 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:43.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12ce3e700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1280b1530 0x7fc12814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12d63f700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc12815bf20 0x7fc1280c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 -- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc12815bf20 msgr2=0x7fc1280c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc12815bf20 0x7fc1280c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 -- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1280b1530 msgr2=0x7fc12814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1280b1530 0x7fc12814fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 -- 172.21.15.123:0/3570663543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c009570 con 0x7fc1280d1430 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc127fff700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 0x7fc12814f7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc11400c500 tx=0x7fc11400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140052d0 con 0x7fc1280d1430 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc114005430 con 0x7fc1280d1430 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1280c6380 con 0x7fc1280d1430 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.748+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140055a0 con 0x7fc1280d1430 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.752+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1280b4630 con 0x7fc1280d1430 2023-07-21T19:07:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.752+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12804dcb0 con 0x7fc1280d1430 2023-07-21T19:07:43.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.752+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1140038e0 con 0x7fc1280d1430 2023-07-21T19:07:43.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.756+0000 7fc1257fa700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc10c0662f0 0x7fc10c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:43.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.756+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc114082e00 con 0x7fc1280d1430 2023-07-21T19:07:43.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.756+0000 7fc12ce3e700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc10c0662f0 0x7fc10c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:43.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.756+0000 7fc12ce3e700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc10c0662f0 0x7fc10c0687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc11c000c00 tx=0x7fc11c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:43.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.760+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc114050530 con 0x7fc1280d1430 2023-07-21T19:07:43.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.964+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1280d1b20 con 0x7fc1280d1430 2023-07-21T19:07:43.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc1257fa700 1 -- 172.21.15.123:0/3570663543 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fc114017de0 con 0x7fc1280d1430 2023-07-21T19:07:43.980 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:43.980 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-21T19:07:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc10c0662f0 msgr2=0x7fc10c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc10c0662f0 0x7fc10c0687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc11c000c00 tx=0x7fc11c008030 comp rx=0 tx=0).stop 2023-07-21T19:07:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 msgr2=0x7fc12814f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 0x7fc12814f7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc11400c500 tx=0x7fc11400c810 comp rx=0 tx=0).stop 2023-07-21T19:07:43.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 shutdown_connections 2023-07-21T19:07:43.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc10c0662f0 0x7fc10c0687a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc12815bf20 0x7fc1280c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1280d1430 0x7fc12814f7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 --2- 172.21.15.123:0/3570663543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1280b1530 0x7fc12814fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:43.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 >> 172.21.15.123:0/3570663543 conn(0x7fc12806fc80 msgr2=0x7fc1280cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:43.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 shutdown_connections 2023-07-21T19:07:43.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:43.968+0000 7fc12f0a2700 1 -- 172.21.15.123:0/3570663543 wait complete. 2023-07-21T19:07:43.985 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2023-07-21T19:07:44.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 Processor -- start 2023-07-21T19:07:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 -- start start 2023-07-21T19:07:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3ac40c9d90 0x7f3ac40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3ac415d7f0 0x7f3ac415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40b0ef0 con 0x7f3ac4159f20 2023-07-21T19:07:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40ce9c0 con 0x7f3ac415d7f0 2023-07-21T19:07:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.164+0000 7f3ac94d6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40cee50 con 0x7f3ac40c9d90 2023-07-21T19:07:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3ac415d7f0 0x7f3ac415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac2ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3ac40c9d90 0x7f3ac40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac2ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3ac40c9d90 0x7f3ac40ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:43570/0 (socket says 172.21.15.123:43570) 2023-07-21T19:07:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac2ffd700 1 -- 172.21.15.123:0/2537799428 learned_addr learned my addr 172.21.15.123:0/2537799428 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac27fc700 1 --1- 172.21.15.123:0/2537799428 >> v1:172.21.15.145:6789/0 conn(0x7f3ac4159f20 0x7f3ac40caa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:51260/0 (socket says 172.21.15.123:51260) 2023-07-21T19:07:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac37fe700 1 -- 172.21.15.123:0/2537799428 >> v2:172.21.15.145:3300/0 conn(0x7f3ac40c9d90 msgr2=0x7f3ac40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac37fe700 1 --2- 172.21.15.123:0/2537799428 >> v2:172.21.15.145:3300/0 conn(0x7f3ac40c9d90 0x7f3ac40ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac37fe700 1 -- 172.21.15.123:0/2537799428 >> v1:172.21.15.145:6789/0 conn(0x7f3ac4159f20 legacy=0x7f3ac40caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac37fe700 1 -- 172.21.15.123:0/2537799428 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40ca6a0 con 0x7f3ac415d7f0 2023-07-21T19:07:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac1ffb700 1 -- 172.21.15.123:0/2537799428 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888284592 0 0) 0x7f3ac40b0ef0 con 0x7f3ac4159f20 2023-07-21T19:07:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac37fe700 1 --2- 172.21.15.123:0/2537799428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac415d7f0 0x7f3ac415dbf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40cdf30 tx=0x7f3abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c744e0a1d9671c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac1ffb700 1 -- 172.21.15.123:0/2537799428 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00e070 con 0x7f3ac415d7f0 2023-07-21T19:07:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac1ffb700 1 -- 172.21.15.123:0/2537799428 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00bb20 con 0x7f3ac415d7f0 2023-07-21T19:07:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac1ffb700 1 -- 172.21.15.123:0/2537799428 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc012430 con 0x7f3ac415d7f0 2023-07-21T19:07:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 -- 172.21.15.123:0/2537799428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac415d7f0 msgr2=0x7f3ac415dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/2537799428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac415d7f0 0x7f3ac415dbf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40cdf30 tx=0x7f3abc00b330 comp rx=0 tx=0).stop 2023-07-21T19:07:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 -- 172.21.15.123:0/2537799428 shutdown_connections 2023-07-21T19:07:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/2537799428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac415d7f0 0x7f3ac415dbf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/2537799428 >> v2:172.21.15.145:3300/0 conn(0x7f3ac40c9d90 0x7f3ac40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 -- 172.21.15.123:0/2537799428 >> 172.21.15.123:0/2537799428 conn(0x7f3ac406e960 msgr2=0x7f3ac406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:44.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 -- 172.21.15.123:0/2537799428 shutdown_connections 2023-07-21T19:07:44.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.168+0000 7f3ac94d6700 1 -- 172.21.15.123:0/2537799428 wait complete. 2023-07-21T19:07:44.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 Processor -- start 2023-07-21T19:07:44.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 -- start start 2023-07-21T19:07:44.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac40c9d90 0x7f3ac40c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac4159f20 0x7f3ac4152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac415d7f0 0x7f3ac40b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40b3600 con 0x7f3ac4159f20 2023-07-21T19:07:44.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac41527c0 con 0x7f3ac415d7f0 2023-07-21T19:07:44.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac94d6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4154570 con 0x7f3ac40c9d90 2023-07-21T19:07:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac4159f20 0x7f3ac4152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac2ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac40c9d90 0x7f3ac40c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac4159f20 0x7f3ac4152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33840/0 (socket says 172.21.15.123:33840) 2023-07-21T19:07:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac27fc700 1 -- 172.21.15.123:0/415527494 learned_addr learned my addr 172.21.15.123:0/415527494 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.172+0000 7f3ac37fe700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac415d7f0 0x7f3ac40b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac2ffd700 1 -- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac415d7f0 msgr2=0x7f3ac40b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac2ffd700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac415d7f0 0x7f3ac40b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac2ffd700 1 -- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac4159f20 msgr2=0x7f3ac4152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac2ffd700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac4159f20 0x7f3ac4152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac2ffd700 1 -- 172.21.15.123:0/415527494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009a70 con 0x7f3ac40c9d90 2023-07-21T19:07:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac2ffd700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac40c9d90 0x7f3ac40c1b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400e870 tx=0x7f3ab400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4013680 con 0x7f3ac40c9d90 2023-07-21T19:07:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac4154850 con 0x7f3ac40c9d90 2023-07-21T19:07:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab40137e0 con 0x7f3ac40c9d90 2023-07-21T19:07:44.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4013b50 con 0x7f3ac40c9d90 2023-07-21T19:07:44.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac4154e10 con 0x7f3ac40c9d90 2023-07-21T19:07:44.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.176+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac4154fd0 con 0x7f3ac40c9d90 2023-07-21T19:07:44.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.180+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ab4013cb0 con 0x7f3ac40c9d90 2023-07-21T19:07:44.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.180+0000 7f3aab7fe700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3ab00662f0 0x7f3ab00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.180+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3ab4084510 con 0x7f3ac40c9d90 2023-07-21T19:07:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.180+0000 7f3ac27fc700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3ab00662f0 0x7f3ab00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.180+0000 7f3ac27fc700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3ab00662f0 0x7f3ab00687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8001360 tx=0x7f3ab80012f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.188+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3ab4051c40 con 0x7f3ac40c9d90 2023-07-21T19:07:44.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.360+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ac404e500 con 0x7f3ac40c9d90 2023-07-21T19:07:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.364+0000 7f3aab7fe700 1 -- 172.21.15.123:0/415527494 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14696 (secure 0 0 0) 0x7f3ab4055260 con 0x7f3ac40c9d90 2023-07-21T19:07:44.376 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:44.377 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:43.352051+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3ab00662f0 msgr2=0x7f3ab00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3ab00662f0 0x7f3ab00687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8001360 tx=0x7f3ab80012f0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac40c9d90 msgr2=0x7f3ac40c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac40c9d90 0x7f3ac40c1b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400e870 tx=0x7f3ab400eb80 comp rx=0 tx=0).stop 2023-07-21T19:07:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 shutdown_connections 2023-07-21T19:07:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3ab00662f0 0x7f3ab00687a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac415d7f0 0x7f3ac40b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ac4159f20 0x7f3ac4152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 --2- 172.21.15.123:0/415527494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac40c9d90 0x7f3ac40c1b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 >> 172.21.15.123:0/415527494 conn(0x7f3ac406e960 msgr2=0x7f3ac40ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 shutdown_connections 2023-07-21T19:07:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.368+0000 7f3ac94d6700 1 -- 172.21.15.123:0/415527494 wait complete. 2023-07-21T19:07:44.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T19:07:44.403 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:07:44.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.568+0000 7f78fc857700 1 Processor -- start 2023-07-21T19:07:44.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.568+0000 7f78fc857700 1 -- start start 2023-07-21T19:07:44.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78fc857700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78fc857700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f78f80cab00 0x7f78f80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78fc857700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80cb4c0 con 0x7f78f80b0770 2023-07-21T19:07:44.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78fc857700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f80714f0 con 0x7f78f80cab00 2023-07-21T19:07:44.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78fc857700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f806da00 con 0x7f78f8159c60 2023-07-21T19:07:44.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f659c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f78f80b0770 0x7f78f8070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36834/0 (socket says 172.21.15.123:36834) 2023-07-21T19:07:44.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f659c700 1 -- 172.21.15.123:0/113611556 learned_addr learned my addr 172.21.15.123:0/113611556 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f6d9d700 1 --2- 172.21.15.123:0/113611556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f759e700 1 --2- 172.21.15.123:0/113611556 >> v2:172.21.15.145:3300/0 conn(0x7f78f80cab00 0x7f78f80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f6d9d700 1 -- 172.21.15.123:0/113611556 >> v2:172.21.15.145:3300/0 conn(0x7f78f80cab00 msgr2=0x7f78f80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f6d9d700 1 --2- 172.21.15.123:0/113611556 >> v2:172.21.15.145:3300/0 conn(0x7f78f80cab00 0x7f78f80caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f6d9d700 1 -- 172.21.15.123:0/113611556 >> v1:172.21.15.123:6789/0 conn(0x7f78f80b0770 legacy=0x7f78f8070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f6d9d700 1 -- 172.21.15.123:0/113611556 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f806dce0 con 0x7f78f8159c60 2023-07-21T19:07:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f5d9b700 1 -- 172.21.15.123:0/113611556 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472147322 0 0) 0x7f78f80cb4c0 con 0x7f78f80b0770 2023-07-21T19:07:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.572+0000 7f78f6d9d700 1 --2- 172.21.15.123:0/113611556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f806d3b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009850 tx=0x7f78e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a58c8c50c6d9de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78f5d9b700 1 -- 172.21.15.123:0/113611556 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8011830 con 0x7f78f8159c60 2023-07-21T19:07:44.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78f5d9b700 1 -- 172.21.15.123:0/113611556 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e8011990 con 0x7f78f8159c60 2023-07-21T19:07:44.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78f5d9b700 1 -- 172.21.15.123:0/113611556 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8011d40 con 0x7f78f8159c60 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 -- 172.21.15.123:0/113611556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 msgr2=0x7f78f806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 --2- 172.21.15.123:0/113611556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f806d3b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009850 tx=0x7f78e8009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 -- 172.21.15.123:0/113611556 shutdown_connections 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 --2- 172.21.15.123:0/113611556 >> v2:172.21.15.145:3300/0 conn(0x7f78f80cab00 0x7f78f80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 --2- 172.21.15.123:0/113611556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f806d3b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 -- 172.21.15.123:0/113611556 >> 172.21.15.123:0/113611556 conn(0x7f78f80afc60 msgr2=0x7f78f80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 -- 172.21.15.123:0/113611556 shutdown_connections 2023-07-21T19:07:44.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.576+0000 7f78fc857700 1 -- 172.21.15.123:0/113611556 wait complete. 2023-07-21T19:07:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 Processor -- start 2023-07-21T19:07:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 -- start start 2023-07-21T19:07:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 0x7f78f81f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78f80cab00 0x7f78f80aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f80ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80af650 con 0x7f78f80b0770 2023-07-21T19:07:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80aead0 con 0x7f78f80cab00 2023-07-21T19:07:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.580+0000 7f78fc857700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80aedb0 con 0x7f78f8159c60 2023-07-21T19:07:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 0x7f78f81f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 0x7f78f81f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33846/0 (socket says 172.21.15.123:33846) 2023-07-21T19:07:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 -- 172.21.15.123:0/1188825199 learned_addr learned my addr 172.21.15.123:0/1188825199 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f659c700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78f80cab00 0x7f78f80aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f759e700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f80ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 -- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 msgr2=0x7f78f80ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f80ab3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 -- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78f80cab00 msgr2=0x7f78f80aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78f80cab00 0x7f78f80aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 -- 172.21.15.123:0/1188825199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80094b0 con 0x7f78f80b0770 2023-07-21T19:07:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f659c700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78f80cab00 0x7f78f80aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78f6d9d700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 0x7f78f81f0d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78e80090b0 tx=0x7f78e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e801ab00 con 0x7f78f80b0770 2023-07-21T19:07:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f80af090 con 0x7f78f80b0770 2023-07-21T19:07:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e801f070 con 0x7f78f80b0770 2023-07-21T19:07:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e801b430 con 0x7f78f80b0770 2023-07-21T19:07:44.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f8153210 con 0x7f78f80b0770 2023-07-21T19:07:44.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.584+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f8142ef0 con 0x7f78f80b0770 2023-07-21T19:07:44.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.588+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78e801b590 con 0x7f78f80b0770 2023-07-21T19:07:44.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.588+0000 7f78df7fe700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78e40662f0 0x7f78e40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.588+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f78e8084b50 con 0x7f78f80b0770 2023-07-21T19:07:44.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.588+0000 7f78f659c700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78e40662f0 0x7f78e40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.592+0000 7f78f659c700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78e40662f0 0x7f78e40687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78f80b3e70 tx=0x7f78ec007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.596+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f78f8142ef0 con 0x7f78f80b0770 2023-07-21T19:07:44.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.764+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78f8142ef0 con 0x7f78f80b0770 2023-07-21T19:07:44.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.764+0000 7f78df7fe700 1 -- 172.21.15.123:0/1188825199 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78f8142ef0 con 0x7f78f80b0770 2023-07-21T19:07:44.779 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:07:44.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78e40662f0 msgr2=0x7f78e40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78e40662f0 0x7f78e40687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78f80b3e70 tx=0x7f78ec007d50 comp rx=0 tx=0).stop 2023-07-21T19:07:44.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 msgr2=0x7f78f81f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 0x7f78f81f0d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78e80090b0 tx=0x7f78e8004770 comp rx=0 tx=0).stop 2023-07-21T19:07:44.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 shutdown_connections 2023-07-21T19:07:44.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78e40662f0 0x7f78e40687a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78f80cab00 0x7f78f80aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78f8159c60 0x7f78f80ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 --2- 172.21.15.123:0/1188825199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f80b0770 0x7f78f81f0d50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 >> 172.21.15.123:0/1188825199 conn(0x7f78f80afc60 msgr2=0x7f78f80b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:44.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 shutdown_connections 2023-07-21T19:07:44.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.768+0000 7f78fc857700 1 -- 172.21.15.123:0/1188825199 wait complete. 2023-07-21T19:07:44.802 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:07:44.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.964+0000 7f0d38a05700 1 Processor -- start 2023-07-21T19:07:44.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.964+0000 7f0d38a05700 1 -- start start 2023-07-21T19:07:44.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d38a05700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d341603d0 0x7f0d3406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d38a05700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0d340cd7f0 0x7f0d340c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d38a05700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340cdfb0 con 0x7f0d34160000 2023-07-21T19:07:44.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d38a05700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d34070e40 con 0x7f0d341603d0 2023-07-21T19:07:44.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d38a05700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340cdcd0 con 0x7f0d340cd7f0 2023-07-21T19:07:44.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d337fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0d34160000 0x7f0d340c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36844/0 (socket says 172.21.15.123:36844) 2023-07-21T19:07:44.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d337fe700 1 -- 172.21.15.123:0/941947285 learned_addr learned my addr 172.21.15.123:0/941947285 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:44.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d32ffd700 1 --2- 172.21.15.123:0/941947285 >> v2:172.21.15.123:3300/0 conn(0x7f0d341603d0 0x7f0d3406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d33fff700 1 --2- 172.21.15.123:0/941947285 >> v2:172.21.15.145:3300/0 conn(0x7f0d340cd7f0 0x7f0d340c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d32ffd700 1 -- 172.21.15.123:0/941947285 >> v2:172.21.15.145:3300/0 conn(0x7f0d340cd7f0 msgr2=0x7f0d340c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:44.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d32ffd700 1 --2- 172.21.15.123:0/941947285 >> v2:172.21.15.145:3300/0 conn(0x7f0d340cd7f0 0x7f0d340c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d327fc700 1 -- 172.21.15.123:0/941947285 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420217367 0 0) 0x7f0d24001110 con 0x7f0d34160000 2023-07-21T19:07:44.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d32ffd700 1 -- 172.21.15.123:0/941947285 >> v1:172.21.15.123:6789/0 conn(0x7f0d34160000 legacy=0x7f0d340c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d32ffd700 1 -- 172.21.15.123:0/941947285 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34070780 con 0x7f0d341603d0 2023-07-21T19:07:44.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d32ffd700 1 --2- 172.21.15.123:0/941947285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d341603d0 0x7f0d3406dd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d34163c20 tx=0x7f0d28009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632013b0115a6ecc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d327fc700 1 -- 172.21.15.123:0/941947285 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28011830 con 0x7f0d341603d0 2023-07-21T19:07:44.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d327fc700 1 -- 172.21.15.123:0/941947285 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d28011990 con 0x7f0d341603d0 2023-07-21T19:07:44.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.968+0000 7f0d327fc700 1 -- 172.21.15.123:0/941947285 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28011d40 con 0x7f0d341603d0 2023-07-21T19:07:44.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 -- 172.21.15.123:0/941947285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d341603d0 msgr2=0x7f0d3406dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 --2- 172.21.15.123:0/941947285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d341603d0 0x7f0d3406dd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d34163c20 tx=0x7f0d28009b30 comp rx=0 tx=0).stop 2023-07-21T19:07:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 -- 172.21.15.123:0/941947285 shutdown_connections 2023-07-21T19:07:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 --2- 172.21.15.123:0/941947285 >> v2:172.21.15.145:3300/0 conn(0x7f0d340cd7f0 0x7f0d340c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 --2- 172.21.15.123:0/941947285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d341603d0 0x7f0d3406dd10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 -- 172.21.15.123:0/941947285 >> 172.21.15.123:0/941947285 conn(0x7f0d340afc60 msgr2=0x7f0d340b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:44.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 -- 172.21.15.123:0/941947285 shutdown_connections 2023-07-21T19:07:44.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 -- 172.21.15.123:0/941947285 wait complete. 2023-07-21T19:07:44.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.972+0000 7f0d38a05700 1 Processor -- start 2023-07-21T19:07:44.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 -- start start 2023-07-21T19:07:44.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 0x7f0d34154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d34160000 0x7f0d34162860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d341603d0 0x7f0d340b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:44.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34154960 con 0x7f0d340cd7f0 2023-07-21T19:07:44.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34161b10 con 0x7f0d341603d0 2023-07-21T19:07:44.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d38a05700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34161d80 con 0x7f0d34160000 2023-07-21T19:07:44.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 0x7f0d34154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 0x7f0d34154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33860/0 (socket says 172.21.15.123:33860) 2023-07-21T19:07:44.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 -- 172.21.15.123:0/562535800 learned_addr learned my addr 172.21.15.123:0/562535800 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:44.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d32ffd700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d34160000 0x7f0d34162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d33fff700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d341603d0 0x7f0d340b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:44.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 -- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d34160000 msgr2=0x7f0d34162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d34160000 0x7f0d34162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 -- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d341603d0 msgr2=0x7f0d340b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:44.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d341603d0 0x7f0d340b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:44.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 -- 172.21.15.123:0/562535800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d280094b0 con 0x7f0d340cd7f0 2023-07-21T19:07:44.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d33fff700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d341603d0 0x7f0d340b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:44.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.976+0000 7f0d337fe700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 0x7f0d34154420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c750 tx=0x7f0d2400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:44.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004ca0 con 0x7f0d340cd7f0 2023-07-21T19:07:44.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24004e20 con 0x7f0d340cd7f0 2023-07-21T19:07:44.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d34162060 con 0x7f0d340cd7f0 2023-07-21T19:07:44.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24007310 con 0x7f0d340cd7f0 2023-07-21T19:07:44.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d341f9b50 con 0x7f0d340cd7f0 2023-07-21T19:07:44.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d34071240 con 0x7f0d340cd7f0 2023-07-21T19:07:44.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.980+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d24007470 con 0x7f0d340cd7f0 2023-07-21T19:07:44.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.984+0000 7f0d1bfff700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0d200662f0 0x7f0d200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.984+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d240829c0 con 0x7f0d340cd7f0 2023-07-21T19:07:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.984+0000 7f0d32ffd700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0d200662f0 0x7f0d200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.984+0000 7f0d32ffd700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0d200662f0 0x7f0d200687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d280090b0 tx=0x7f0d2801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:44.988+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0d34071240 con 0x7f0d340cd7f0 2023-07-21T19:07:45.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.156+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d340cdfb0 con 0x7f0d340cd7f0 2023-07-21T19:07:45.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.160+0000 7f0d1bfff700 1 -- 172.21.15.123:0/562535800 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d340cdfb0 con 0x7f0d340cd7f0 2023-07-21T19:07:45.171 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:07:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.160+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0d200662f0 msgr2=0x7f0d200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.160+0000 7f0d38a05700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0d200662f0 0x7f0d200687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d280090b0 tx=0x7f0d2801c040 comp rx=0 tx=0).stop 2023-07-21T19:07:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.160+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 msgr2=0x7f0d34154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.160+0000 7f0d38a05700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 0x7f0d34154420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c750 tx=0x7f0d2400cb10 comp rx=0 tx=0).stop 2023-07-21T19:07:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 shutdown_connections 2023-07-21T19:07:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0d200662f0 0x7f0d200687a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d341603d0 0x7f0d340b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d34160000 0x7f0d34162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 --2- 172.21.15.123:0/562535800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d340cd7f0 0x7f0d34154420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 >> 172.21.15.123:0/562535800 conn(0x7f0d340afc60 msgr2=0x7f0d3406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:45.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 shutdown_connections 2023-07-21T19:07:45.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.164+0000 7f0d38a05700 1 -- 172.21.15.123:0/562535800 wait complete. 2023-07-21T19:07:45.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T19:07:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.352+0000 7f849bd8d700 1 Processor -- start 2023-07-21T19:07:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.352+0000 7f849bd8d700 1 -- start start 2023-07-21T19:07:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f849bd8d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f8494070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f849bd8d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940c8900 con 0x7f8494070ea0 2023-07-21T19:07:45.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f849bd8d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940caae0 con 0x7f8494160640 2023-07-21T19:07:45.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f849bd8d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84940c8fc0 con 0x7f84940cddb0 2023-07-21T19:07:45.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f849a32a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8494070ea0 0x7f84940afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36856/0 (socket says 172.21.15.123:36856) 2023-07-21T19:07:45.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f849a32a700 1 -- 172.21.15.123:0/345306267 learned_addr learned my addr 172.21.15.123:0/345306267 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:45.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f8499328700 1 --2- 172.21.15.123:0/345306267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f8494070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f8499328700 1 -- 172.21.15.123:0/345306267 >> v1:172.21.15.145:6789/0 conn(0x7f8494160640 legacy=0x7f8494164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f8499328700 1 -- 172.21.15.123:0/345306267 >> v1:172.21.15.123:6789/0 conn(0x7f8494070ea0 legacy=0x7f84940afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f8499328700 1 -- 172.21.15.123:0/345306267 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940ca520 con 0x7f84940cddb0 2023-07-21T19:07:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f8498b27700 1 -- 172.21.15.123:0/345306267 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928822536 0 0) 0x7f84940c8900 con 0x7f8494070ea0 2023-07-21T19:07:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.356+0000 7f8499328700 1 --2- 172.21.15.123:0/345306267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f8494070960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8484009880 tx=0x7f8484009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd82745ec945b42a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f8498b27700 1 -- 172.21.15.123:0/345306267 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484011830 con 0x7f84940cddb0 2023-07-21T19:07:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f8498b27700 1 -- 172.21.15.123:0/345306267 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484011990 con 0x7f84940cddb0 2023-07-21T19:07:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f8498b27700 1 -- 172.21.15.123:0/345306267 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484011d20 con 0x7f84940cddb0 2023-07-21T19:07:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 -- 172.21.15.123:0/345306267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 msgr2=0x7f8494070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 --2- 172.21.15.123:0/345306267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f8494070960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8484009880 tx=0x7f8484009b90 comp rx=0 tx=0).stop 2023-07-21T19:07:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 -- 172.21.15.123:0/345306267 shutdown_connections 2023-07-21T19:07:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 --2- 172.21.15.123:0/345306267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f8494070960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 -- 172.21.15.123:0/345306267 >> 172.21.15.123:0/345306267 conn(0x7f84940cad30 msgr2=0x7f84940cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 -- 172.21.15.123:0/345306267 shutdown_connections 2023-07-21T19:07:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.360+0000 7f849bd8d700 1 -- 172.21.15.123:0/345306267 wait complete. 2023-07-21T19:07:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 Processor -- start 2023-07-21T19:07:45.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 -- start start 2023-07-21T19:07:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8494070ea0 0x7f8494154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f84940c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 0x7f84941575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494070540 con 0x7f8494160640 2023-07-21T19:07:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940c6da0 con 0x7f8494070ea0 2023-07-21T19:07:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849bd8d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8494154f80 con 0x7f84940cddb0 2023-07-21T19:07:45.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849a32a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 0x7f84941575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f8499328700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f84940c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849a32a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 0x7f84941575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33876/0 (socket says 172.21.15.123:33876) 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f849a32a700 1 -- 172.21.15.123:0/1237908261 learned_addr learned my addr 172.21.15.123:0/1237908261 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.364+0000 7f8499b29700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8494070ea0 0x7f8494154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849a32a700 1 -- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 msgr2=0x7f84940c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849a32a700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f84940c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849a32a700 1 -- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8494070ea0 msgr2=0x7f8494154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849a32a700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8494070ea0 0x7f8494154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849a32a700 1 -- 172.21.15.123:0/1237908261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84840094b0 con 0x7f8494160640 2023-07-21T19:07:45.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849a32a700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 0x7f84941575b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f848c00cbd0 tx=0x7f848c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00aa60 con 0x7f8494160640 2023-07-21T19:07:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c00abe0 con 0x7f8494160640 2023-07-21T19:07:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84940c67e0 con 0x7f8494160640 2023-07-21T19:07:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c0070d0 con 0x7f8494160640 2023-07-21T19:07:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8494155650 con 0x7f8494160640 2023-07-21T19:07:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.368+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84941554b0 con 0x7f8494160640 2023-07-21T19:07:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.372+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f848c007230 con 0x7f8494160640 2023-07-21T19:07:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.372+0000 7f848a7fc700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f84780662f0 0x7f84780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.372+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f848c0836d0 con 0x7f8494160640 2023-07-21T19:07:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.372+0000 7f8499b29700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f84780662f0 0x7f84780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.376+0000 7f8499b29700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f84780662f0 0x7f84780687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8490000f60 tx=0x7f8490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.380+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f84941554b0 con 0x7f8494160640 2023-07-21T19:07:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.556+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84941554b0 con 0x7f8494160640 2023-07-21T19:07:45.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.556+0000 7f848a7fc700 1 -- 172.21.15.123:0/1237908261 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f84941554b0 con 0x7f8494160640 2023-07-21T19:07:45.569 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:45.569 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2023-07-21T19:07:45.569 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:07:45.569 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2023-07-21T19:07:45.569 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2023-07-21T19:07:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:07:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:07:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 2, 2023-07-21T19:07:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": "rbd" 2023-07-21T19:07:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:07:45.570 INFO:teuthology.orchestra.run.smithi123.stdout:] 2023-07-21T19:07:45.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f84780662f0 msgr2=0x7f84780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f84780662f0 0x7f84780687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8490000f60 tx=0x7f8490009040 comp rx=0 tx=0).stop 2023-07-21T19:07:45.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 msgr2=0x7f84941575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 0x7f84941575b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f848c00cbd0 tx=0x7f848c00cee0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 shutdown_connections 2023-07-21T19:07:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f84780662f0 0x7f84780687a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8494160640 0x7f84941575b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84940cddb0 0x7f84940c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 --2- 172.21.15.123:0/1237908261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8494070ea0 0x7f8494154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 >> 172.21.15.123:0/1237908261 conn(0x7f84940cad30 msgr2=0x7f84940b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:45.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 shutdown_connections 2023-07-21T19:07:45.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.560+0000 7f849bd8d700 1 -- 172.21.15.123:0/1237908261 wait complete. 2023-07-21T19:07:45.591 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T19:07:45.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T19:07:45.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.760+0000 7f714a781700 1 Processor -- start 2023-07-21T19:07:45.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.760+0000 7f714a781700 1 -- start start 2023-07-21T19:07:45.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.760+0000 7f714a781700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f71440ce300 0x7f714406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.760+0000 7f714a781700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7144071310 con 0x7f71440d02d0 2023-07-21T19:07:45.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.760+0000 7f714a781700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440715f0 con 0x7f71440b40f0 2023-07-21T19:07:45.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.760+0000 7f714a781700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7144071bb0 con 0x7f71440ce300 2023-07-21T19:07:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7143fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f71440d02d0 0x7f71440d06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36870/0 (socket says 172.21.15.123:36870) 2023-07-21T19:07:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7143fff700 1 -- 172.21.15.123:0/1784439290 learned_addr learned my addr 172.21.15.123:0/1784439290 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f71437fe700 1 --2- 172.21.15.123:0/1784439290 >> v2:172.21.15.145:3300/0 conn(0x7f71440ce300 0x7f714406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7142ffd700 1 -- 172.21.15.123:0/1784439290 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584547982 0 0) 0x7f7144071310 con 0x7f71440d02d0 2023-07-21T19:07:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7142ffd700 1 -- 172.21.15.123:0/1784439290 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c0035d0 con 0x7f71440d02d0 2023-07-21T19:07:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f71437fe700 1 -- 172.21.15.123:0/1784439290 >> v1:172.21.15.145:6789/0 conn(0x7f71440b40f0 legacy=0x7f7144070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f71437fe700 1 -- 172.21.15.123:0/1784439290 >> v1:172.21.15.123:6789/0 conn(0x7f71440d02d0 legacy=0x7f71440d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f71437fe700 1 -- 172.21.15.123:0/1784439290 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440718d0 con 0x7f71440ce300 2023-07-21T19:07:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f71437fe700 1 --2- 172.21.15.123:0/1784439290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440ce300 0x7f714406fd20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7138009850 tx=0x7f7138009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e99f61aa18ab91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7142ffd700 1 -- 172.21.15.123:0/1784439290 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138011830 con 0x7f71440ce300 2023-07-21T19:07:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7142ffd700 1 -- 172.21.15.123:0/1784439290 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138011990 con 0x7f71440ce300 2023-07-21T19:07:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.764+0000 7f7142ffd700 1 -- 172.21.15.123:0/1784439290 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138011d40 con 0x7f71440ce300 2023-07-21T19:07:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 -- 172.21.15.123:0/1784439290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440ce300 msgr2=0x7f714406fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 --2- 172.21.15.123:0/1784439290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440ce300 0x7f714406fd20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7138009850 tx=0x7f7138009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 -- 172.21.15.123:0/1784439290 shutdown_connections 2023-07-21T19:07:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 --2- 172.21.15.123:0/1784439290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440ce300 0x7f714406fd20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 -- 172.21.15.123:0/1784439290 >> 172.21.15.123:0/1784439290 conn(0x7f714409b9e0 msgr2=0x7f71440d2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 -- 172.21.15.123:0/1784439290 shutdown_connections 2023-07-21T19:07:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 -- 172.21.15.123:0/1784439290 wait complete. 2023-07-21T19:07:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 Processor -- start 2023-07-21T19:07:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.768+0000 7f714a781700 1 -- start start 2023-07-21T19:07:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440b40f0 0x7f71441f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71440ce300 0x7f71441f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 0x7f714406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71440b0a00 con 0x7f71440d02d0 2023-07-21T19:07:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71440afb50 con 0x7f71440b40f0 2023-07-21T19:07:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71441f5920 con 0x7f71440ce300 2023-07-21T19:07:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 0x7f714406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f71437fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71440ce300 0x7f71441f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7143fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440b40f0 0x7f71441f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 0x7f714406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33888/0 (socket says 172.21.15.123:33888) 2023-07-21T19:07:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 -- 172.21.15.123:0/1149677519 learned_addr learned my addr 172.21.15.123:0/1149677519 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:45.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 -- 172.21.15.123:0/1149677519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71440ce300 msgr2=0x7f71441f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71440ce300 0x7f71441f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 -- 172.21.15.123:0/1149677519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440b40f0 msgr2=0x7f71441f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:45.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440b40f0 0x7f71441f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 -- 172.21.15.123:0/1149677519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71380094b0 con 0x7f71440d02d0 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7148d1e700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 0x7f714406fd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f713c00cb50 tx=0x7f713c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c003c20 con 0x7f71440d02d0 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71440afdf0 con 0x7f71440d02d0 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c003d80 con 0x7f71440d02d0 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00aa20 con 0x7f71440d02d0 2023-07-21T19:07:45.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.772+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71440b03b0 con 0x7f71440d02d0 2023-07-21T19:07:45.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.776+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71440b0b70 con 0x7f71440d02d0 2023-07-21T19:07:45.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.776+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f713c00ab80 con 0x7f71440d02d0 2023-07-21T19:07:45.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.780+0000 7f7140ff9700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71300662f0 0x7f71300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:45.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.780+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f713c083a10 con 0x7f71440d02d0 2023-07-21T19:07:45.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.780+0000 7f7143fff700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71300662f0 0x7f71300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:45.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.780+0000 7f7143fff700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71300662f0 0x7f71300687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7134007fd0 tx=0x7f7134007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:45.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.784+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f713c051140 con 0x7f71440d02d0 2023-07-21T19:07:45.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:45.956+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f714404dcb0 con 0x7f71440d02d0 2023-07-21T19:07:46.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.388+0000 7f7140ff9700 1 -- 172.21.15.123:0/1149677519 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f713c054760 con 0x7f71440d02d0 2023-07-21T19:07:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71300662f0 msgr2=0x7f71300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71300662f0 0x7f71300687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7134007fd0 tx=0x7f7134007de0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 msgr2=0x7f714406fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 0x7f714406fd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f713c00cb50 tx=0x7f713c00ce60 comp rx=0 tx=0).stop 2023-07-21T19:07:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 shutdown_connections 2023-07-21T19:07:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71300662f0 0x7f71300687a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71440d02d0 0x7f714406fd20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71440ce300 0x7f71441f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 --2- 172.21.15.123:0/1149677519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71440b40f0 0x7f71441f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 >> 172.21.15.123:0/1149677519 conn(0x7f714409b9e0 msgr2=0x7f71440cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.396+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 shutdown_connections 2023-07-21T19:07:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.400+0000 7f714a781700 1 -- 172.21.15.123:0/1149677519 wait complete. 2023-07-21T19:07:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2023-07-21T19:07:46.431 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-21T19:07:46.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.600+0000 7f12ea373700 1 Processor -- start 2023-07-21T19:07:46.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.600+0000 7f12ea373700 1 -- start start 2023-07-21T19:07:46.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12ea373700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12e4158ac0 0x7f12e406a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12ea373700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e40cda10 0x7f12e406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12ea373700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f12e406d490 0x7f12e415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12ea373700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e406d8b0 con 0x7f12e4158ac0 2023-07-21T19:07:46.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12ea373700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e406b8f0 con 0x7f12e406d490 2023-07-21T19:07:46.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12ea373700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e406a850 con 0x7f12e40cda10 2023-07-21T19:07:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12e9371700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12e4158ac0 0x7f12e406a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12e9371700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12e4158ac0 0x7f12e406a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33890/0 (socket says 172.21.15.123:33890) 2023-07-21T19:07:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12e9371700 1 -- 172.21.15.123:0/1619890345 learned_addr learned my addr 172.21.15.123:0/1619890345 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12e9b72700 1 --2- 172.21.15.123:0/1619890345 >> v2:172.21.15.145:3300/0 conn(0x7f12e406d490 0x7f12e415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.604+0000 7f12e8b70700 1 --2- 172.21.15.123:0/1619890345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e40cda10 0x7f12e406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12e9371700 1 -- 172.21.15.123:0/1619890345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e40cda10 msgr2=0x7f12e406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12e9371700 1 --2- 172.21.15.123:0/1619890345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e40cda10 0x7f12e406cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12e9371700 1 -- 172.21.15.123:0/1619890345 >> v2:172.21.15.145:3300/0 conn(0x7f12e406d490 msgr2=0x7f12e415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12e9371700 1 --2- 172.21.15.123:0/1619890345 >> v2:172.21.15.145:3300/0 conn(0x7f12e406d490 0x7f12e415c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12e9371700 1 -- 172.21.15.123:0/1619890345 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e406ab30 con 0x7f12e4158ac0 2023-07-21T19:07:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12e9371700 1 --2- 172.21.15.123:0/1619890345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e406a150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12e406cee0 tx=0x7f12e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271c500a4b24ec4e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12dbfff700 1 -- 172.21.15.123:0/1619890345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0011830 con 0x7f12e4158ac0 2023-07-21T19:07:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12dbfff700 1 -- 172.21.15.123:0/1619890345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0011990 con 0x7f12e4158ac0 2023-07-21T19:07:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12dbfff700 1 -- 172.21.15.123:0/1619890345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0011d20 con 0x7f12e4158ac0 2023-07-21T19:07:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 -- 172.21.15.123:0/1619890345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 msgr2=0x7f12e406a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:46.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 --2- 172.21.15.123:0/1619890345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e406a150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12e406cee0 tx=0x7f12e0009bf0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 -- 172.21.15.123:0/1619890345 shutdown_connections 2023-07-21T19:07:46.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 --2- 172.21.15.123:0/1619890345 >> v2:172.21.15.145:3300/0 conn(0x7f12e406d490 0x7f12e415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 --2- 172.21.15.123:0/1619890345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e40cda10 0x7f12e406cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 --2- 172.21.15.123:0/1619890345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e406a150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.608+0000 7f12ea373700 1 -- 172.21.15.123:0/1619890345 >> 172.21.15.123:0/1619890345 conn(0x7f12e406fe60 msgr2=0x7f12e4070260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:46.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.612+0000 7f12ea373700 1 -- 172.21.15.123:0/1619890345 shutdown_connections 2023-07-21T19:07:46.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.612+0000 7f12ea373700 1 -- 172.21.15.123:0/1619890345 wait complete. 2023-07-21T19:07:46.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.612+0000 7f12ea373700 1 Processor -- start 2023-07-21T19:07:46.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.612+0000 7f12ea373700 1 -- start start 2023-07-21T19:07:46.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12ea373700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e406d490 0x7f12e41ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12ea373700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12e40cda10 0x7f12e415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12ea373700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12ea373700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e40c8920 con 0x7f12e4158ac0 2023-07-21T19:07:46.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12ea373700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e41538a0 con 0x7f12e40cda10 2023-07-21T19:07:46.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12ea373700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e40c7da0 con 0x7f12e406d490 2023-07-21T19:07:46.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e4157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33898/0 (socket says 172.21.15.123:33898) 2023-07-21T19:07:46.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 -- 172.21.15.123:0/2789029811 learned_addr learned my addr 172.21.15.123:0/2789029811 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9371700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e406d490 0x7f12e41ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e8b70700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12e40cda10 0x7f12e415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 -- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e406d490 msgr2=0x7f12e41ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e406d490 0x7f12e41ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 -- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12e40cda10 msgr2=0x7f12e415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12e40cda10 0x7f12e415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 -- 172.21.15.123:0/2789029811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e0009570 con 0x7f12e4158ac0 2023-07-21T19:07:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.616+0000 7f12e9b72700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e4157a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00efc0 tx=0x7f12dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:46.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.620+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc009ea0 con 0x7f12e4158ac0 2023-07-21T19:07:46.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.620+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00f040 con 0x7f12e4158ac0 2023-07-21T19:07:46.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.620+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00ced0 con 0x7f12e4158ac0 2023-07-21T19:07:46.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.620+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e40c8080 con 0x7f12e4158ac0 2023-07-21T19:07:46.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.620+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e40c8640 con 0x7f12e4158ac0 2023-07-21T19:07:46.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.620+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e4154880 con 0x7f12e4158ac0 2023-07-21T19:07:46.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.624+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12dc014480 con 0x7f12e4158ac0 2023-07-21T19:07:46.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.624+0000 7f12d9ffb700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12c806a730 0x7f12c806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:46.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.624+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f12dc084940 con 0x7f12e4158ac0 2023-07-21T19:07:46.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.624+0000 7f12e9371700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12c806a730 0x7f12c806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:46.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.628+0000 7f12e9371700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12c806a730 0x7f12c806cbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:46.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.628+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12dc051f80 con 0x7f12e4158ac0 2023-07-21T19:07:46.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:46.804+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f12e4154880 con 0x7f12e4158ac0 2023-07-21T19:07:47.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.396+0000 7f12d9ffb700 1 -- 172.21.15.123:0/2789029811 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f12e4154880 con 0x7f12e4158ac0 2023-07-21T19:07:47.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12c806a730 msgr2=0x7f12c806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12c806a730 0x7f12c806cbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e0008030 comp rx=0 tx=0).stop 2023-07-21T19:07:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 msgr2=0x7f12e4157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e4157a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00efc0 tx=0x7f12dc00c3a0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 shutdown_connections 2023-07-21T19:07:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12c806a730 0x7f12c806cbe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12e40cda10 0x7f12e415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12e4158ac0 0x7f12e4157a70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 --2- 172.21.15.123:0/2789029811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12e406d490 0x7f12e41ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.412+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 >> 172.21.15.123:0/2789029811 conn(0x7f12e406fe60 msgr2=0x7f12e40b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:47.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.416+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 shutdown_connections 2023-07-21T19:07:47.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.420+0000 7f12ea373700 1 -- 172.21.15.123:0/2789029811 wait complete. 2023-07-21T19:07:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2023-07-21T19:07:47.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T19:07:47.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.620+0000 7f40bb59e700 1 Processor -- start 2023-07-21T19:07:47.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.620+0000 7f40bb59e700 1 -- start start 2023-07-21T19:07:47.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bb59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0cb210 0x7f40bc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bb59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0714f0 con 0x7f40bc0b0770 2023-07-21T19:07:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bb59e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc06da00 con 0x7f40bc159c60 2023-07-21T19:07:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bb59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc06dce0 con 0x7f40bc0cb210 2023-07-21T19:07:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b9d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f40bc0b0770 0x7f40bc0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36878/0 (socket says 172.21.15.123:36878) 2023-07-21T19:07:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b9d9b700 1 -- 172.21.15.123:0/142212007 learned_addr learned my addr 172.21.15.123:0/142212007 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bad9d700 1 --2- 172.21.15.123:0/142212007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0cb210 0x7f40bc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315236579 0 0) 0x7f40bc0714f0 con 0x7f40bc0b0770 2023-07-21T19:07:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a40035d0 con 0x7f40bc0b0770 2023-07-21T19:07:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108541773 0 0) 0x7f40bc06da00 con 0x7f40bc159c60 2023-07-21T19:07:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc0714f0 con 0x7f40bc159c60 2023-07-21T19:07:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bad9d700 1 -- 172.21.15.123:0/142212007 >> v1:172.21.15.145:6789/0 conn(0x7f40bc159c60 legacy=0x7f40bc070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bad9d700 1 -- 172.21.15.123:0/142212007 >> v1:172.21.15.123:6789/0 conn(0x7f40bc0b0770 legacy=0x7f40bc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bad9d700 1 -- 172.21.15.123:0/142212007 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc06dfc0 con 0x7f40bc0cb210 2023-07-21T19:07:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bad9d700 1 --2- 172.21.15.123:0/142212007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0cb210 0x7f40bc06d3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009dc0 tx=0x7f40b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a32ca20301e826d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400e070 con 0x7f40bc0cb210 2023-07-21T19:07:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b400bb20 con 0x7f40bc0cb210 2023-07-21T19:07:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40b959a700 1 -- 172.21.15.123:0/142212007 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4012430 con 0x7f40bc0cb210 2023-07-21T19:07:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bb59e700 1 -- 172.21.15.123:0/142212007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0cb210 msgr2=0x7f40bc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.624+0000 7f40bb59e700 1 --2- 172.21.15.123:0/142212007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0cb210 0x7f40bc06d3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009dc0 tx=0x7f40b400b330 comp rx=0 tx=0).stop 2023-07-21T19:07:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.628+0000 7f40bb59e700 1 -- 172.21.15.123:0/142212007 shutdown_connections 2023-07-21T19:07:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.628+0000 7f40bb59e700 1 --2- 172.21.15.123:0/142212007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0cb210 0x7f40bc06d3b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.628+0000 7f40bb59e700 1 -- 172.21.15.123:0/142212007 >> 172.21.15.123:0/142212007 conn(0x7f40bc0afc60 msgr2=0x7f40bc0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.628+0000 7f40bb59e700 1 -- 172.21.15.123:0/142212007 shutdown_connections 2023-07-21T19:07:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.628+0000 7f40bb59e700 1 -- 172.21.15.123:0/142212007 wait complete. 2023-07-21T19:07:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.628+0000 7f40bb59e700 1 Processor -- start 2023-07-21T19:07:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 -- start start 2023-07-21T19:07:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0b0770 0x7f40bc0cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 0x7f40bc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40bc159c60 0x7f40bc0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0ccf10 con 0x7f40bc0cb210 2023-07-21T19:07:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15b860 con 0x7f40bc159c60 2023-07-21T19:07:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bb59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15ba90 con 0x7f40bc0b0770 2023-07-21T19:07:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 0x7f40bc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 0x7f40bc15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33904/0 (socket says 172.21.15.123:33904) 2023-07-21T19:07:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 -- 172.21.15.123:0/3941932555 learned_addr learned my addr 172.21.15.123:0/3941932555 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40ba59c700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0b0770 0x7f40bc0cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40bad9d700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40bc159c60 0x7f40bc0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 -- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0b0770 msgr2=0x7f40bc0cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0b0770 0x7f40bc0cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 -- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40bc159c60 msgr2=0x7f40bc0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40bc159c60 0x7f40bc0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.632+0000 7f40b9d9b700 1 -- 172.21.15.123:0/3941932555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4009a70 con 0x7f40bc0cb210 2023-07-21T19:07:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40b9d9b700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 0x7f40bc15b320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c500 tx=0x7f40b000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0005d90 con 0x7f40bc0cb210 2023-07-21T19:07:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b00070d0 con 0x7f40bc0cb210 2023-07-21T19:07:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0007480 con 0x7f40bc0cb210 2023-07-21T19:07:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc15bd70 con 0x7f40bc0cb210 2023-07-21T19:07:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc15c330 con 0x7f40bc0cb210 2023-07-21T19:07:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.636+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc0b4100 con 0x7f40bc0cb210 2023-07-21T19:07:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.640+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40b00075e0 con 0x7f40bc0cb210 2023-07-21T19:07:47.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.640+0000 7f40aaffd700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f409c0662f0 0x7f409c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:47.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.640+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f40b0083160 con 0x7f40bc0cb210 2023-07-21T19:07:47.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.640+0000 7f40ba59c700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f409c0662f0 0x7f409c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.640+0000 7f40ba59c700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f409c0662f0 0x7f409c0687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0011e0 tx=0x7f40ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:47.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.648+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f40b00505a0 con 0x7f40bc0cb210 2023-07-21T19:07:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:47.860+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f40bc04e500 con 0x7f40bc0cb210 2023-07-21T19:07:48.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.464+0000 7f40aaffd700 1 -- 172.21.15.123:0/3941932555 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f40b0053bc0 con 0x7f40bc0cb210 2023-07-21T19:07:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f409c0662f0 msgr2=0x7f409c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:48.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f409c0662f0 0x7f409c0687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0011e0 tx=0x7f40ac009040 comp rx=0 tx=0).stop 2023-07-21T19:07:48.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 msgr2=0x7f40bc15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:48.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 0x7f40bc15b320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c500 tx=0x7f40b000c810 comp rx=0 tx=0).stop 2023-07-21T19:07:48.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 shutdown_connections 2023-07-21T19:07:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f409c0662f0 0x7f409c0687a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40bc159c60 0x7f40bc0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40bc0cb210 0x7f40bc15b320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 --2- 172.21.15.123:0/3941932555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40bc0b0770 0x7f40bc0cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 >> 172.21.15.123:0/3941932555 conn(0x7f40bc0afc60 msgr2=0x7f40bc0ada90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.472+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 shutdown_connections 2023-07-21T19:07:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.476+0000 7f40bb59e700 1 -- 172.21.15.123:0/3941932555 wait complete. 2023-07-21T19:07:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 3 and data pool 4 2023-07-21T19:07:48.506 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-21T19:07:48.507 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-21T19:07:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 Processor -- start 2023-07-21T19:07:48.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 -- start start 2023-07-21T19:07:48.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7200b0ee0 0x7fe7200ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe7200cd090 0x7fe7200d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7200cd4e0 con 0x7fe7200d0610 2023-07-21T19:07:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7200d1a60 con 0x7fe7200b0ee0 2023-07-21T19:07:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7267be700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7200d1ef0 con 0x7fe7200cd090 2023-07-21T19:07:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7257bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7200b0ee0 0x7fe7200ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7257bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7200b0ee0 0x7fe7200ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33906/0 (socket says 172.21.15.123:33906) 2023-07-21T19:07:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7257bc700 1 -- 172.21.15.123:0/2318907150 learned_addr learned my addr 172.21.15.123:0/2318907150 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7257bc700 1 -- 172.21.15.123:0/2318907150 >> v2:172.21.15.145:3300/0 conn(0x7fe7200cd090 msgr2=0x7fe7200d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe724fbb700 1 --2- 172.21.15.123:0/2318907150 >> v2:172.21.15.145:3300/0 conn(0x7fe7200cd090 0x7fe7200d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.672+0000 7fe7257bc700 1 --2- 172.21.15.123:0/2318907150 >> v2:172.21.15.145:3300/0 conn(0x7fe7200cd090 0x7fe7200d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7257bc700 1 -- 172.21.15.123:0/2318907150 >> v1:172.21.15.145:6789/0 conn(0x7fe7200d0610 legacy=0x7fe72015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7257bc700 1 -- 172.21.15.123:0/2318907150 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7200d0e50 con 0x7fe7200b0ee0 2023-07-21T19:07:48.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe724fbb700 1 --2- 172.21.15.123:0/2318907150 >> v2:172.21.15.145:3300/0 conn(0x7fe7200cd090 0x7fe7200d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:48.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7257bc700 1 --2- 172.21.15.123:0/2318907150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200b0ee0 0x7fe7200ccb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe7200b5090 tx=0x7fe71c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779fc5b4565c46a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:48.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe717fff700 1 -- 172.21.15.123:0/2318907150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00e070 con 0x7fe7200b0ee0 2023-07-21T19:07:48.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe717fff700 1 -- 172.21.15.123:0/2318907150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c003a40 con 0x7fe7200b0ee0 2023-07-21T19:07:48.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe717fff700 1 -- 172.21.15.123:0/2318907150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c003df0 con 0x7fe7200b0ee0 2023-07-21T19:07:48.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 -- 172.21.15.123:0/2318907150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200b0ee0 msgr2=0x7fe7200ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:48.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 --2- 172.21.15.123:0/2318907150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200b0ee0 0x7fe7200ccb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe7200b5090 tx=0x7fe71c00b330 comp rx=0 tx=0).stop 2023-07-21T19:07:48.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 -- 172.21.15.123:0/2318907150 shutdown_connections 2023-07-21T19:07:48.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 --2- 172.21.15.123:0/2318907150 >> v2:172.21.15.145:3300/0 conn(0x7fe7200cd090 0x7fe7200d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 --2- 172.21.15.123:0/2318907150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200b0ee0 0x7fe7200ccb50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 -- 172.21.15.123:0/2318907150 >> 172.21.15.123:0/2318907150 conn(0x7fe720060c40 msgr2=0x7fe72009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 -- 172.21.15.123:0/2318907150 shutdown_connections 2023-07-21T19:07:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.676+0000 7fe7267be700 1 -- 172.21.15.123:0/2318907150 wait complete. 2023-07-21T19:07:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 Processor -- start 2023-07-21T19:07:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 -- start start 2023-07-21T19:07:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7200b0ee0 0x7fe72014c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7200cd090 0x7fe7200b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 0x7fe72015e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:48.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200b3a20 con 0x7fe7200d0610 2023-07-21T19:07:48.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200b2da0 con 0x7fe7200cd090 2023-07-21T19:07:48.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7267be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200b3080 con 0x7fe7200b0ee0 2023-07-21T19:07:48.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe725fbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 0x7fe72015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe725fbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 0x7fe72015e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33920/0 (socket says 172.21.15.123:33920) 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe725fbd700 1 -- 172.21.15.123:0/1465623904 learned_addr learned my addr 172.21.15.123:0/1465623904 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe7257bc700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7200b0ee0 0x7fe72014c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe724fbb700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7200cd090 0x7fe7200b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe725fbd700 1 -- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7200b0ee0 msgr2=0x7fe72014c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.680+0000 7fe725fbd700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7200b0ee0 0x7fe72014c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe725fbd700 1 -- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7200cd090 msgr2=0x7fe7200b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe725fbd700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7200cd090 0x7fe7200b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe725fbd700 1 -- 172.21.15.123:0/1465623904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c009b30 con 0x7fe7200d0610 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe725fbd700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 0x7fe72015e940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c470 tx=0x7fe71800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718011790 con 0x7fe7200d0610 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180118f0 con 0x7fe7200d0610 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7200b3360 con 0x7fe7200d0610 2023-07-21T19:07:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718011ca0 con 0x7fe7200d0610 2023-07-21T19:07:48.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7200b4380 con 0x7fe7200d0610 2023-07-21T19:07:48.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.684+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7200b3b60 con 0x7fe7200d0610 2023-07-21T19:07:48.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.688+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe71801c460 con 0x7fe7200d0610 2023-07-21T19:07:48.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.688+0000 7fe715ffb700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7040662f0 0x7fe7040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:48.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.688+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe718083a50 con 0x7fe7200d0610 2023-07-21T19:07:48.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.688+0000 7fe7257bc700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7040662f0 0x7fe7040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:48.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.688+0000 7fe7257bc700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7040662f0 0x7fe7040687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe71c015040 tx=0x7fe71c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:48.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.696+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe7200b3b60 con 0x7fe7200d0610 2023-07-21T19:07:48.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:48.880+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe7200b3b60 con 0x7fe7200d0610 2023-07-21T19:07:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.468+0000 7fe715ffb700 1 -- 172.21.15.123:0/1465623904 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe7200b3b60 con 0x7fe7200d0610 2023-07-21T19:07:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7040662f0 msgr2=0x7fe7040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7040662f0 0x7fe7040687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe71c015040 tx=0x7fe71c009000 comp rx=0 tx=0).stop 2023-07-21T19:07:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 msgr2=0x7fe72015e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 0x7fe72015e940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c470 tx=0x7fe71800c780 comp rx=0 tx=0).stop 2023-07-21T19:07:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 shutdown_connections 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7040662f0 0x7fe7040687a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7200cd090 0x7fe7200b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7200d0610 0x7fe72015e940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 --2- 172.21.15.123:0/1465623904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7200b0ee0 0x7fe72014c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 >> 172.21.15.123:0/1465623904 conn(0x7fe720060c40 msgr2=0x7fe72009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 shutdown_connections 2023-07-21T19:07:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.472+0000 7fe7267be700 1 -- 172.21.15.123:0/1465623904 wait complete. 2023-07-21T19:07:49.507 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T19:07:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.676+0000 7f74dcb30700 1 Processor -- start 2023-07-21T19:07:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.676+0000 7f74dcb30700 1 -- start start 2023-07-21T19:07:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74dcb30700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f74d80d0210 0x7f74d80d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74dcb30700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80b15d0 0x7f74d80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74dcb30700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d80b2860 con 0x7f74d815c1c0 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74dcb30700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d80d0b20 con 0x7f74d80d0210 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74dcb30700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80b1c50 con 0x7f74d80b15d0 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d6ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f74d815c1c0 0x7f74d80b0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36894/0 (socket says 172.21.15.123:36894) 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d6ffd700 1 -- 172.21.15.123:0/1076036647 learned_addr learned my addr 172.21.15.123:0/1076036647 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d77fe700 1 --2- 172.21.15.123:0/1076036647 >> v2:172.21.15.145:3300/0 conn(0x7f74d80d0210 0x7f74d80d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d7fff700 1 --2- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80b15d0 0x7f74d80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d67fc700 1 -- 172.21.15.123:0/1076036647 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110518862 0 0) 0x7f74d80b2860 con 0x7f74d815c1c0 2023-07-21T19:07:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d67fc700 1 -- 172.21.15.123:0/1076036647 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c00035d0 con 0x7f74d815c1c0 2023-07-21T19:07:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d77fe700 1 -- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80b15d0 msgr2=0x7f74d80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d77fe700 1 --2- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80b15d0 0x7f74d80b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d77fe700 1 -- 172.21.15.123:0/1076036647 >> v1:172.21.15.123:6789/0 conn(0x7f74d815c1c0 legacy=0x7f74d80b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d67fc700 1 -- 172.21.15.123:0/1076036647 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4017818671 0 0) 0x7f74c00035d0 con 0x7f74d815c1c0 2023-07-21T19:07:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d77fe700 1 -- 172.21.15.123:0/1076036647 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80b1f30 con 0x7f74d80d0210 2023-07-21T19:07:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d77fe700 1 --2- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d80d0210 0x7f74d80d05e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009850 tx=0x7f74c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b268251d5d1b9738 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d67fc700 1 -- 172.21.15.123:0/1076036647 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8011830 con 0x7f74d80d0210 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d67fc700 1 -- 172.21.15.123:0/1076036647 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8011990 con 0x7f74d80d0210 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.680+0000 7f74d67fc700 1 -- 172.21.15.123:0/1076036647 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8011d40 con 0x7f74d80d0210 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 -- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d80d0210 msgr2=0x7f74d80d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 --2- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d80d0210 0x7f74d80d05e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009850 tx=0x7f74c8009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 -- 172.21.15.123:0/1076036647 shutdown_connections 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 --2- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80b15d0 0x7f74d80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 --2- 172.21.15.123:0/1076036647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d80d0210 0x7f74d80d05e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 -- 172.21.15.123:0/1076036647 >> 172.21.15.123:0/1076036647 conn(0x7f74d809b910 msgr2=0x7f74d80d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 -- 172.21.15.123:0/1076036647 shutdown_connections 2023-07-21T19:07:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 -- 172.21.15.123:0/1076036647 wait complete. 2023-07-21T19:07:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.684+0000 7f74dcb30700 1 Processor -- start 2023-07-21T19:07:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 -- start start 2023-07-21T19:07:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 0x7f74d80b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80d0210 0x7f74d80ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d815c1c0 0x7f74d81f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80cdbe0 con 0x7f74d80b15d0 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80ccf60 con 0x7f74d815c1c0 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80cd240 con 0x7f74d80d0210 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 0x7f74d80b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 0x7f74d80b7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33924/0 (socket says 172.21.15.123:33924) 2023-07-21T19:07:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 -- 172.21.15.123:0/34399259 learned_addr learned my addr 172.21.15.123:0/34399259 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d6ffd700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80d0210 0x7f74d80ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d7fff700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d815c1c0 0x7f74d81f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 -- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80d0210 msgr2=0x7f74d80ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80d0210 0x7f74d80ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 -- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d815c1c0 msgr2=0x7f74d81f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d815c1c0 0x7f74d81f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 -- 172.21.15.123:0/34399259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80094b0 con 0x7f74d80b15d0 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d6ffd700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80d0210 0x7f74d80ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74d77fe700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 0x7f74d80b7b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f74d806e730 tx=0x7f74c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c801aac0 con 0x7f74d80b15d0 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c801f070 con 0x7f74d80b15d0 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c801ae60 con 0x7f74d80b15d0 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.688+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d80cd520 con 0x7f74d80b15d0 2023-07-21T19:07:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.692+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d80ccc70 con 0x7f74d80b15d0 2023-07-21T19:07:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.692+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d80673f0 con 0x7f74d80b15d0 2023-07-21T19:07:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.692+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74c801b430 con 0x7f74d80b15d0 2023-07-21T19:07:49.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.696+0000 7f74bffff700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74c40662f0 0x7f74c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:49.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.696+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f74c8084f20 con 0x7f74d80b15d0 2023-07-21T19:07:49.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.696+0000 7f74d6ffd700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74c40662f0 0x7f74c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:49.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.696+0000 7f74d6ffd700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74c40662f0 0x7f74c40687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74cc007b30 tx=0x7f74cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:49.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.700+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f74c80522d0 con 0x7f74d80b15d0 2023-07-21T19:07:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:49.872+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f74d804e500 con 0x7f74d80b15d0 2023-07-21T19:07:51.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.484+0000 7f74bffff700 1 -- 172.21.15.123:0/34399259 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f74c8015020 con 0x7f74d80b15d0 2023-07-21T19:07:51.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74c40662f0 msgr2=0x7f74c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74c40662f0 0x7f74c40687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74cc007b30 tx=0x7f74cc009040 comp rx=0 tx=0).stop 2023-07-21T19:07:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 msgr2=0x7f74d80b7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 0x7f74d80b7b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f74d806e730 tx=0x7f74c8004770 comp rx=0 tx=0).stop 2023-07-21T19:07:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 shutdown_connections 2023-07-21T19:07:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74c40662f0 0x7f74c40687a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74d815c1c0 0x7f74d81f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74d80d0210 0x7f74d80ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 --2- 172.21.15.123:0/34399259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d80b15d0 0x7f74d80b7b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 >> 172.21.15.123:0/34399259 conn(0x7f74d809b910 msgr2=0x7f74d80b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 shutdown_connections 2023-07-21T19:07:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.492+0000 7f74dcb30700 1 -- 172.21.15.123:0/34399259 wait complete. 2023-07-21T19:07:51.512 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data_ec' created 2023-07-21T19:07:51.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-21T19:07:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.700+0000 7f2794fdc700 1 Processor -- start 2023-07-21T19:07:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.700+0000 7f2794fdc700 1 -- start start 2023-07-21T19:07:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f2794fdc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f279015c180 0x7f27900cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f2794fdc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f2794fdc700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279015c550 con 0x7f279006ffb0 2023-07-21T19:07:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f2794fdc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2790070430 con 0x7f279015c180 2023-07-21T19:07:51.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f2794fdc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900b3870 con 0x7f27900b10f0 2023-07-21T19:07:51.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f279015c180 0x7f27900cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:51.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f279015c180 0x7f27900cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33928/0 (socket says 172.21.15.123:33928) 2023-07-21T19:07:51.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 -- 172.21.15.123:0/2012817703 learned_addr learned my addr 172.21.15.123:0/2012817703 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:51.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278effd700 1 --2- 172.21.15.123:0/2012817703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:51.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 -- 172.21.15.123:0/2012817703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 msgr2=0x7f279006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:51.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 --2- 172.21.15.123:0/2012817703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279006fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 -- 172.21.15.123:0/2012817703 >> v1:172.21.15.145:6789/0 conn(0x7f279006ffb0 legacy=0x7f27900cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:51.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 -- 172.21.15.123:0/2012817703 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900b1940 con 0x7f279015c180 2023-07-21T19:07:51.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278e7fc700 1 -- 172.21.15.123:0/2012817703 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069065962 0 0) 0x7f2788001490 con 0x7f279006ffb0 2023-07-21T19:07:51.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278f7fe700 1 --2- 172.21.15.123:0/2012817703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279015c180 0x7f27900cfae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2780009900 tx=0x7f2780009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb32645ac605a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278e7fc700 1 -- 172.21.15.123:0/2012817703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011830 con 0x7f279015c180 2023-07-21T19:07:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278e7fc700 1 -- 172.21.15.123:0/2012817703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2780011990 con 0x7f279015c180 2023-07-21T19:07:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.704+0000 7f278e7fc700 1 -- 172.21.15.123:0/2012817703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011d40 con 0x7f279015c180 2023-07-21T19:07:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 -- 172.21.15.123:0/2012817703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279015c180 msgr2=0x7f27900cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 --2- 172.21.15.123:0/2012817703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279015c180 0x7f27900cfae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2780009900 tx=0x7f2780009c10 comp rx=0 tx=0).stop 2023-07-21T19:07:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 -- 172.21.15.123:0/2012817703 shutdown_connections 2023-07-21T19:07:51.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 --2- 172.21.15.123:0/2012817703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279006fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 --2- 172.21.15.123:0/2012817703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279015c180 0x7f27900cfae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 -- 172.21.15.123:0/2012817703 >> 172.21.15.123:0/2012817703 conn(0x7f2790099600 msgr2=0x7f27900d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:51.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 -- 172.21.15.123:0/2012817703 shutdown_connections 2023-07-21T19:07:51.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 -- 172.21.15.123:0/2012817703 wait complete. 2023-07-21T19:07:51.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.708+0000 7f2794fdc700 1 Processor -- start 2023-07-21T19:07:51.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 -- start start 2023-07-21T19:07:51.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 0x7f279015e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:51.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:51.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f279015c180 0x7f279015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:51.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279015dce0 con 0x7f279006ffb0 2023-07-21T19:07:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279014fea0 con 0x7f279015c180 2023-07-21T19:07:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279015d060 con 0x7f27900b10f0 2023-07-21T19:07:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 0x7f279015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 0x7f279015e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33938/0 (socket says 172.21.15.123:33938) 2023-07-21T19:07:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 -- 172.21.15.123:0/1039319938 learned_addr learned my addr 172.21.15.123:0/1039319938 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278ffff700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f279015c180 0x7f279015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278effd700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 -- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 msgr2=0x7f279014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279014f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 -- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f279015c180 msgr2=0x7f279015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f279015c180 0x7f279015c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 -- 172.21.15.123:0/1039319938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780009510 con 0x7f279006ffb0 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278ffff700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f279015c180 0x7f279015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278effd700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f278f7fe700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 0x7f279015e100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f279006f400 tx=0x7f2780004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780004500 con 0x7f279006ffb0 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27800036c0 con 0x7f279006ffb0 2023-07-21T19:07:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279015d340 con 0x7f279006ffb0 2023-07-21T19:07:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780003a30 con 0x7f279006ffb0 2023-07-21T19:07:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.712+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279015d900 con 0x7f279006ffb0 2023-07-21T19:07:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.716+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279015da90 con 0x7f279006ffb0 2023-07-21T19:07:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.716+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2780003b90 con 0x7f279006ffb0 2023-07-21T19:07:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.720+0000 7f2777fff700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f277c066320 0x7f277c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.720+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f2780021030 con 0x7f279006ffb0 2023-07-21T19:07:51.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.720+0000 7f278effd700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f277c066320 0x7f277c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:51.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.720+0000 7f278effd700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f277c066320 0x7f277c0687d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f27900cda80 tx=0x7f2784008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:51.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.724+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f27800525c0 con 0x7f279006ffb0 2023-07-21T19:07:51.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:51.888+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f279004e500 con 0x7f279006ffb0 2023-07-21T19:07:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.492+0000 7f2777fff700 1 -- 172.21.15.123:0/1039319938 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2780055be0 con 0x7f279006ffb0 2023-07-21T19:07:52.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.504+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f277c066320 msgr2=0x7f277c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.504+0000 7f2794fdc700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f277c066320 0x7f277c0687d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f27900cda80 tx=0x7f2784008040 comp rx=0 tx=0).stop 2023-07-21T19:07:52.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.504+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 msgr2=0x7f279015e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.504+0000 7f2794fdc700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 0x7f279015e100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f279006f400 tx=0x7f2780004770 comp rx=0 tx=0).stop 2023-07-21T19:07:52.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.508+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 shutdown_connections 2023-07-21T19:07:52.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.508+0000 7f2794fdc700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f277c066320 0x7f277c0687d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:52.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.508+0000 7f2794fdc700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f279015c180 0x7f279015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:52.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.508+0000 7f2794fdc700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27900b10f0 0x7f279014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:52.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.508+0000 7f2794fdc700 1 --2- 172.21.15.123:0/1039319938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279006ffb0 0x7f279015e100 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f279006f400 tx=0x7f2780004770 comp rx=0 tx=0).stop 2023-07-21T19:07:52.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.508+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 >> 172.21.15.123:0/1039319938 conn(0x7f2790099600 msgr2=0x7f279015ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:52.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.516+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 shutdown_connections 2023-07-21T19:07:52.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.516+0000 7f2794fdc700 1 -- 172.21.15.123:0/1039319938 wait complete. 2023-07-21T19:07:52.531 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 5 allow_ec_overwrites to true 2023-07-21T19:07:52.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-21T19:07:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.716+0000 7fa789ad6700 1 Processor -- start 2023-07-21T19:07:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.716+0000 7fa789ad6700 1 -- start start 2023-07-21T19:07:52.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa789ad6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa7840cd080 0x7fa784069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:52.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa789ad6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78406a8f0 con 0x7fa7840b0f30 2023-07-21T19:07:52.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa789ad6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78406a050 con 0x7fa7840ce170 2023-07-21T19:07:52.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa789ad6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78406a330 con 0x7fa7840cd080 2023-07-21T19:07:52.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa782ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa7840cd080 0x7fa784069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:52.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa783fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7840b0f30 0x7fa78406d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50072/0 (socket says 172.21.15.123:50072) 2023-07-21T19:07:52.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa783fff700 1 -- 172.21.15.123:0/450953678 learned_addr learned my addr 172.21.15.123:0/450953678 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:52.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa7837fe700 1 --1- 172.21.15.123:0/450953678 >> v1:172.21.15.145:6789/0 conn(0x7fa7840ce170 0x7fa7840ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:33610/0 (socket says 172.21.15.123:33610) 2023-07-21T19:07:52.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371869990 0 0) 0x7fa78406a050 con 0x7fa7840ce170 2023-07-21T19:07:52.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa76c0057e0 con 0x7fa7840ce170 2023-07-21T19:07:52.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947042482 0 0) 0x7fa78406a8f0 con 0x7fa7840b0f30 2023-07-21T19:07:52.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78406a050 con 0x7fa7840b0f30 2023-07-21T19:07:52.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa782ffd700 1 -- 172.21.15.123:0/450953678 >> v1:172.21.15.145:6789/0 conn(0x7fa7840ce170 legacy=0x7fa7840ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa782ffd700 1 -- 172.21.15.123:0/450953678 >> v1:172.21.15.123:6789/0 conn(0x7fa7840b0f30 legacy=0x7fa78406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.720+0000 7fa782ffd700 1 -- 172.21.15.123:0/450953678 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78406a610 con 0x7fa7840cd080 2023-07-21T19:07:52.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa782ffd700 1 --2- 172.21.15.123:0/450953678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa784069800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa778009850 tx=0x7fa778009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c464e11ce45e01ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:52.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778011830 con 0x7fa7840cd080 2023-07-21T19:07:52.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa778011990 con 0x7fa7840cd080 2023-07-21T19:07:52.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa7827fc700 1 -- 172.21.15.123:0/450953678 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778011d40 con 0x7fa7840cd080 2023-07-21T19:07:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 -- 172.21.15.123:0/450953678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 msgr2=0x7fa784069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 --2- 172.21.15.123:0/450953678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa784069800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa778009850 tx=0x7fa778009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 -- 172.21.15.123:0/450953678 shutdown_connections 2023-07-21T19:07:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 --2- 172.21.15.123:0/450953678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa784069800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 -- 172.21.15.123:0/450953678 >> 172.21.15.123:0/450953678 conn(0x7fa7840706b0 msgr2=0x7fa7840cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 -- 172.21.15.123:0/450953678 shutdown_connections 2023-07-21T19:07:52.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.724+0000 7fa789ad6700 1 -- 172.21.15.123:0/450953678 wait complete. 2023-07-21T19:07:52.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 Processor -- start 2023-07-21T19:07:52.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 -- start start 2023-07-21T19:07:52.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 0x7fa7840c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:52.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa7840c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:52.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7840ce170 0x7fa7840c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:52.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b40c0 con 0x7fa7840b0f30 2023-07-21T19:07:52.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840c3060 con 0x7fa7840cd080 2023-07-21T19:07:52.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa789ad6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b2d90 con 0x7fa7840ce170 2023-07-21T19:07:52.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa7837fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 0x7fa7840c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:52.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa7837fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 0x7fa7840c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42922/0 (socket says 172.21.15.123:42922) 2023-07-21T19:07:52.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa7837fe700 1 -- 172.21.15.123:0/2871950320 learned_addr learned my addr 172.21.15.123:0/2871950320 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:52.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa782ffd700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa7840c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:52.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa783fff700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7840ce170 0x7fa7840c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:52.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa7837fe700 1 -- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7840ce170 msgr2=0x7fa7840c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.728+0000 7fa7837fe700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7840ce170 0x7fa7840c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa7837fe700 1 -- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 msgr2=0x7fa7840c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa7837fe700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa7840c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa7837fe700 1 -- 172.21.15.123:0/2871950320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094b0 con 0x7fa7840b0f30 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa782ffd700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa7840c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa7837fe700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 0x7fa7840c5a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c700 tx=0x7fa77400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:52.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774005cd0 con 0x7fa7840b0f30 2023-07-21T19:07:52.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774005e30 con 0x7fa7840b0f30 2023-07-21T19:07:52.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7840b3070 con 0x7fa7840b0f30 2023-07-21T19:07:52.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774007310 con 0x7fa7840b0f30 2023-07-21T19:07:52.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7840b3630 con 0x7fa7840b0f30 2023-07-21T19:07:52.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78404dcb0 con 0x7fa7840b0f30 2023-07-21T19:07:52.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.732+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa774007470 con 0x7fa7840b0f30 2023-07-21T19:07:52.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.736+0000 7fa76bfff700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa770066320 0x7fa7700687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:52.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.736+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa774083650 con 0x7fa7840b0f30 2023-07-21T19:07:52.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.736+0000 7fa782ffd700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa770066320 0x7fa7700687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:52.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.736+0000 7fa782ffd700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa770066320 0x7fa7700687d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7780090b0 tx=0x7fa77801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.740+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa774054200 con 0x7fa7840b0f30 2023-07-21T19:07:52.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:52.936+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa7840cc780 con 0x7fa7840b0f30 2023-07-21T19:07:53.548 INFO:tasks.ceph.mds.d.smithi145.stderr:2023-07-21T19:07:53.534+0000 7f883c7cd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T19:07:53.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.536+0000 7fa76bfff700 1 -- 172.21.15.123:0/2871950320 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa774053d90 con 0x7fa7840b0f30 2023-07-21T19:07:53.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa770066320 msgr2=0x7fa7700687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa770066320 0x7fa7700687d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7780090b0 tx=0x7fa77801c040 comp rx=0 tx=0).stop 2023-07-21T19:07:53.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 msgr2=0x7fa7840c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 0x7fa7840c5a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c700 tx=0x7fa77400cac0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 shutdown_connections 2023-07-21T19:07:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa770066320 0x7fa7700687d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7840cd080 0x7fa7840c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7840ce170 0x7fa7840c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 --2- 172.21.15.123:0/2871950320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7840b0f30 0x7fa7840c5a80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 >> 172.21.15.123:0/2871950320 conn(0x7fa7840706b0 msgr2=0x7fa784156be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 shutdown_connections 2023-07-21T19:07:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.540+0000 7fa789ad6700 1 -- 172.21.15.123:0/2871950320 wait complete. 2023-07-21T19:07:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:added data pool 5 to fsmap 2023-07-21T19:07:53.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:07:53.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 Processor -- start 2023-07-21T19:07:53.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 -- start start 2023-07-21T19:07:53.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbce00cfe10 0x7fbce006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:53.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:53.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce00cd5e0 con 0x7fbce00b23b0 2023-07-21T19:07:53.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00d01e0 con 0x7fbce00cfe10 2023-07-21T19:07:53.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbce5ebc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00b2850 con 0x7fbce00b2a80 2023-07-21T19:07:53.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbcdffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbce00b23b0 0x7fbce015d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50084/0 (socket says 172.21.15.123:50084) 2023-07-21T19:07:53.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbcdffff700 1 -- 172.21.15.123:0/493449941 learned_addr learned my addr 172.21.15.123:0/493449941 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:53.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbcdeffd700 1 --2- 172.21.15.123:0/493449941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:53.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.744+0000 7fbcdf7fe700 1 --2- 172.21.15.123:0/493449941 >> v2:172.21.15.145:3300/0 conn(0x7fbce00cfe10 0x7fbce006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:53.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcde7fc700 1 -- 172.21.15.123:0/493449941 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611362823 0 0) 0x7fbce00cd5e0 con 0x7fbce00b23b0 2023-07-21T19:07:53.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcde7fc700 1 -- 172.21.15.123:0/493449941 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc80035d0 con 0x7fbce00b23b0 2023-07-21T19:07:53.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcdeffd700 1 -- 172.21.15.123:0/493449941 >> v2:172.21.15.145:3300/0 conn(0x7fbce00cfe10 msgr2=0x7fbce006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:53.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcdeffd700 1 --2- 172.21.15.123:0/493449941 >> v2:172.21.15.145:3300/0 conn(0x7fbce00cfe10 0x7fbce006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcdeffd700 1 -- 172.21.15.123:0/493449941 >> v1:172.21.15.123:6789/0 conn(0x7fbce00b23b0 legacy=0x7fbce015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcdeffd700 1 -- 172.21.15.123:0/493449941 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce015a1d0 con 0x7fbce00b2a80 2023-07-21T19:07:53.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcdeffd700 1 --2- 172.21.15.123:0/493449941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00b1e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009850 tx=0x7fbcd4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb22a80ed410cd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcde7fc700 1 -- 172.21.15.123:0/493449941 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011830 con 0x7fbce00b2a80 2023-07-21T19:07:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcde7fc700 1 -- 172.21.15.123:0/493449941 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4011990 con 0x7fbce00b2a80 2023-07-21T19:07:53.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbcde7fc700 1 -- 172.21.15.123:0/493449941 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011d40 con 0x7fbce00b2a80 2023-07-21T19:07:53.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 -- 172.21.15.123:0/493449941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 msgr2=0x7fbce00b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/493449941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00b1e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009850 tx=0x7fbcd4009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:53.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 -- 172.21.15.123:0/493449941 shutdown_connections 2023-07-21T19:07:53.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/493449941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00b1e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/493449941 >> v2:172.21.15.145:3300/0 conn(0x7fbce00cfe10 0x7fbce006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 -- 172.21.15.123:0/493449941 >> 172.21.15.123:0/493449941 conn(0x7fbce0060320 msgr2=0x7fbce0060720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:53.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 -- 172.21.15.123:0/493449941 shutdown_connections 2023-07-21T19:07:53.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.748+0000 7fbce5ebc700 1 -- 172.21.15.123:0/493449941 wait complete. 2023-07-21T19:07:53.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.752+0000 7fbce5ebc700 1 Processor -- start 2023-07-21T19:07:53.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.752+0000 7fbce5ebc700 1 -- start start 2023-07-21T19:07:53.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.752+0000 7fbce5ebc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbce00b23b0 0x7fbce01efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:53.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.752+0000 7fbce5ebc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:53.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.752+0000 7fbce5ebc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 0x7fbce00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:53.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.752+0000 7fbce5ebc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce01f00f0 con 0x7fbce00cfe10 2023-07-21T19:07:53.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbce5ebc700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015a780 con 0x7fbce00b23b0 2023-07-21T19:07:53.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbce5ebc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015aa60 con 0x7fbce00b2a80 2023-07-21T19:07:53.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 0x7fbce00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:53.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 0x7fbce00b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42924/0 (socket says 172.21.15.123:42924) 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 -- 172.21.15.123:0/263696402 learned_addr learned my addr 172.21.15.123:0/263696402 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdf7fe700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbce00b23b0 0x7fbce01efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdeffd700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 -- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 msgr2=0x7fbce00a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 -- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbce00b23b0 msgr2=0x7fbce01efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbce00b23b0 0x7fbce01efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 -- 172.21.15.123:0/263696402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40094b0 con 0x7fbce00cfe10 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdeffd700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdf7fe700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbce00b23b0 0x7fbce01efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcdffff700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 0x7fbce00b1750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800caa0 tx=0x7fbcd800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800a7b0 con 0x7fbce00cfe10 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800a910 con 0x7fbce00cfe10 2023-07-21T19:07:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800aca0 con 0x7fbce00cfe10 2023-07-21T19:07:53.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce015ad40 con 0x7fbce00cfe10 2023-07-21T19:07:53.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.756+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce015b300 con 0x7fbce00cfe10 2023-07-21T19:07:53.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.760+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce00ccc30 con 0x7fbce00cfe10 2023-07-21T19:07:53.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.760+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbcd801b3b0 con 0x7fbce00cfe10 2023-07-21T19:07:53.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.760+0000 7fbcc7fff700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbccc0662f0 0x7fbccc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:53.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.760+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbcd8083aa0 con 0x7fbce00cfe10 2023-07-21T19:07:53.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.760+0000 7fbcdf7fe700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbccc0662f0 0x7fbccc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:53.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.760+0000 7fbcdf7fe700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbccc0662f0 0x7fbccc0687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c40 tx=0x7fbcd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:53.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.768+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbcd8050c30 con 0x7fbce00cfe10 2023-07-21T19:07:53.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.976+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbce004dcb0 con 0x7fbce00cfe10 2023-07-21T19:07:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbcc7fff700 1 -- 172.21.15.123:0/263696402 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4711 (secure 0 0 0) 0x7fbcd8054250 con 0x7fbce00cfe10 2023-07-21T19:07:53.991 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:53.992 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:07:53.534648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-21T19:07:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbccc0662f0 msgr2=0x7fbccc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbccc0662f0 0x7fbccc0687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c40 tx=0x7fbcd0008040 comp rx=0 tx=0).stop 2023-07-21T19:07:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 msgr2=0x7fbce00b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 0x7fbce00b1750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800caa0 tx=0x7fbcd800cb80 comp rx=0 tx=0).stop 2023-07-21T19:07:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 shutdown_connections 2023-07-21T19:07:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbccc0662f0 0x7fbccc0687a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbce00cfe10 0x7fbce00b1750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbce00b2a80 0x7fbce00a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 --2- 172.21.15.123:0/263696402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbce00b23b0 0x7fbce01efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 >> 172.21.15.123:0/263696402 conn(0x7fbce0060320 msgr2=0x7fbce00b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 shutdown_connections 2023-07-21T19:07:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:53.980+0000 7fbce5ebc700 1 -- 172.21.15.123:0/263696402 wait complete. 2023-07-21T19:07:53.997 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2023-07-21T19:07:54.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:54.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.176+0000 7fe64d3a0700 1 Processor -- start 2023-07-21T19:07:54.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.176+0000 7fe64d3a0700 1 -- start start 2023-07-21T19:07:54.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe64d3a0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe6480b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe64d3a0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6480d1430 0x7fe6480b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe64d3a0700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64815c2f0 con 0x7fe6480b1530 2023-07-21T19:07:54.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe64d3a0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe648070830 con 0x7fe6480d1430 2023-07-21T19:07:54.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe64d3a0700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe648070b10 con 0x7fe64815bf20 2023-07-21T19:07:54.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe6477fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6480d1430 0x7fe6480b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe646ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe6480b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe6467fc700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fe6480b1530 0x7fe6480d0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:33612/0 (socket says 172.21.15.123:33612) 2023-07-21T19:07:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe6467fc700 1 -- 172.21.15.123:0/2010352479 learned_addr learned my addr 172.21.15.123:0/2010352479 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe645ffb700 1 -- 172.21.15.123:0/2010352479 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819709367 0 0) 0x7fe64815c2f0 con 0x7fe6480b1530 2023-07-21T19:07:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.180+0000 7fe645ffb700 1 -- 172.21.15.123:0/2010352479 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6300035d0 con 0x7fe6480b1530 2023-07-21T19:07:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe646ffd700 1 -- 172.21.15.123:0/2010352479 >> v2:172.21.15.123:3300/0 conn(0x7fe6480d1430 msgr2=0x7fe6480b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe646ffd700 1 --2- 172.21.15.123:0/2010352479 >> v2:172.21.15.123:3300/0 conn(0x7fe6480d1430 0x7fe6480b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe646ffd700 1 -- 172.21.15.123:0/2010352479 >> v1:172.21.15.145:6789/0 conn(0x7fe6480b1530 legacy=0x7fe6480d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe646ffd700 1 -- 172.21.15.123:0/2010352479 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480cccc0 con 0x7fe64815bf20 2023-07-21T19:07:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe6477fe700 1 --2- 172.21.15.123:0/2010352479 >> v2:172.21.15.123:3300/0 conn(0x7fe6480d1430 0x7fe6480b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe646ffd700 1 --2- 172.21.15.123:0/2010352479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe6480b5420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe638009850 tx=0x7fe638009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc0fdfd0fc2966a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe645ffb700 1 -- 172.21.15.123:0/2010352479 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638011830 con 0x7fe64815bf20 2023-07-21T19:07:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe645ffb700 1 -- 172.21.15.123:0/2010352479 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe638011990 con 0x7fe64815bf20 2023-07-21T19:07:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe645ffb700 1 -- 172.21.15.123:0/2010352479 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638011d40 con 0x7fe64815bf20 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2010352479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 msgr2=0x7fe6480b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2010352479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe6480b5420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe638009850 tx=0x7fe638009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2010352479 shutdown_connections 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2010352479 >> v2:172.21.15.123:3300/0 conn(0x7fe6480d1430 0x7fe6480b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2010352479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe6480b5420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2010352479 >> 172.21.15.123:0/2010352479 conn(0x7fe64806fc80 msgr2=0x7fe648070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2010352479 shutdown_connections 2023-07-21T19:07:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.184+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2010352479 wait complete. 2023-07-21T19:07:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 Processor -- start 2023-07-21T19:07:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 -- start start 2023-07-21T19:07:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 0x7fe64815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6480d1430 0x7fe64814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe64815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64815f3e0 con 0x7fe6480b1530 2023-07-21T19:07:54.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64815b760 con 0x7fe6480d1430 2023-07-21T19:07:54.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe64d3a0700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64815aec0 con 0x7fe64815bf20 2023-07-21T19:07:54.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 0x7fe64815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 0x7fe64815a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42950/0 (socket says 172.21.15.123:42950) 2023-07-21T19:07:54.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 -- 172.21.15.123:0/2333771074 learned_addr learned my addr 172.21.15.123:0/2333771074 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:54.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe6477fe700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe64815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe6467fc700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6480d1430 0x7fe64814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 -- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 msgr2=0x7fe64815eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe64815eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 -- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6480d1430 msgr2=0x7fe64814f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6480d1430 0x7fe64814f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.188+0000 7fe646ffd700 1 -- 172.21.15.123:0/2333771074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640009a70 con 0x7fe6480b1530 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe646ffd700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 0x7fe64815a7c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6380090b0 tx=0x7fe638004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380043c0 con 0x7fe6480b1530 2023-07-21T19:07:54.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63801f070 con 0x7fe6480b1530 2023-07-21T19:07:54.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6380094b0 con 0x7fe6480b1530 2023-07-21T19:07:54.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380036c0 con 0x7fe6480b1530 2023-07-21T19:07:54.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64815b480 con 0x7fe6480b1530 2023-07-21T19:07:54.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.192+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64804dcb0 con 0x7fe6480b1530 2023-07-21T19:07:54.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.196+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe638021030 con 0x7fe6480b1530 2023-07-21T19:07:54.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.196+0000 7fe62f7fe700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe6340662f0 0x7fe6340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.196+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe638085300 con 0x7fe6480b1530 2023-07-21T19:07:54.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.196+0000 7fe6467fc700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe6340662f0 0x7fe6340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.196+0000 7fe6467fc700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe6340662f0 0x7fe6340687a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6480b82a0 tx=0x7fe63c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:54.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.204+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe6380525a0 con 0x7fe6480b1530 2023-07-21T19:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.376+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6480ccf70 con 0x7fe6480b1530 2023-07-21T19:07:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.380+0000 7fe62f7fe700 1 -- 172.21.15.123:0/2333771074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fe638006ce0 con 0x7fe6480b1530 2023-07-21T19:07:54.392 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:54.392 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe6340662f0 msgr2=0x7fe6340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe6340662f0 0x7fe6340687a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6480b82a0 tx=0x7fe63c009040 comp rx=0 tx=0).stop 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 msgr2=0x7fe64815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 0x7fe64815a7c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6380090b0 tx=0x7fe638004770 comp rx=0 tx=0).stop 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 shutdown_connections 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe6340662f0 0x7fe6340687a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6480d1430 0x7fe64814f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe64815bf20 0x7fe64815eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 --2- 172.21.15.123:0/2333771074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6480b1530 0x7fe64815a7c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 >> 172.21.15.123:0/2333771074 conn(0x7fe64806fc80 msgr2=0x7fe6480cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 shutdown_connections 2023-07-21T19:07:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.384+0000 7fe64d3a0700 1 -- 172.21.15.123:0/2333771074 wait complete. 2023-07-21T19:07:54.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.580+0000 7ff40639e700 1 Processor -- start 2023-07-21T19:07:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.580+0000 7ff40639e700 1 -- start start 2023-07-21T19:07:54.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff40639e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff400159300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff40639e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff40006fa80 0x7ff4000ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff40639e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff400158e70 con 0x7ff4000add20 2023-07-21T19:07:54.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff40639e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40006efe0 con 0x7ff40006fa80 2023-07-21T19:07:54.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff40639e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40006ed00 con 0x7ff400158110 2023-07-21T19:07:54.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff404b9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff4000add20 0x7ff40006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50100/0 (socket says 172.21.15.123:50100) 2023-07-21T19:07:54.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff404b9b700 1 -- 172.21.15.123:0/507139782 learned_addr learned my addr 172.21.15.123:0/507139782 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:54.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff405b9d700 1 --2- 172.21.15.123:0/507139782 >> v2:172.21.15.145:3300/0 conn(0x7ff40006fa80 0x7ff4000ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff40539c700 1 --2- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff400159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff405b9d700 1 -- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 msgr2=0x7ff400159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff405b9d700 1 --2- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff400159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff405b9d700 1 -- 172.21.15.123:0/507139782 >> v1:172.21.15.123:6789/0 conn(0x7ff4000add20 legacy=0x7ff40006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff405b9d700 1 -- 172.21.15.123:0/507139782 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400158820 con 0x7ff40006fa80 2023-07-21T19:07:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff3f7fff700 1 -- 172.21.15.123:0/507139782 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253396260 0 0) 0x7ff400158e70 con 0x7ff4000add20 2023-07-21T19:07:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff405b9d700 1 --2- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff40006fa80 0x7ff4000ce380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009d90 tx=0x7ff3f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=393afcc7ba6827d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff3f7fff700 1 -- 172.21.15.123:0/507139782 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800bd20 con 0x7ff40006fa80 2023-07-21T19:07:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff3f7fff700 1 -- 172.21.15.123:0/507139782 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f800be80 con 0x7ff40006fa80 2023-07-21T19:07:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.584+0000 7ff3f7fff700 1 -- 172.21.15.123:0/507139782 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80116a0 con 0x7ff40006fa80 2023-07-21T19:07:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 -- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff40006fa80 msgr2=0x7ff4000ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 --2- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff40006fa80 0x7ff4000ce380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009d90 tx=0x7ff3f800b330 comp rx=0 tx=0).stop 2023-07-21T19:07:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 -- 172.21.15.123:0/507139782 shutdown_connections 2023-07-21T19:07:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 --2- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff40006fa80 0x7ff4000ce380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 --2- 172.21.15.123:0/507139782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff400159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 -- 172.21.15.123:0/507139782 >> 172.21.15.123:0/507139782 conn(0x7ff4000711b0 msgr2=0x7ff4000715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 -- 172.21.15.123:0/507139782 shutdown_connections 2023-07-21T19:07:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.588+0000 7ff40639e700 1 -- 172.21.15.123:0/507139782 wait complete. 2023-07-21T19:07:54.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 Processor -- start 2023-07-21T19:07:54.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 -- start start 2023-07-21T19:07:54.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 0x7ff4001f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4000add20 0x7ff4000b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff4001f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40013c020 con 0x7ff40006fa80 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000b1f90 con 0x7ff4000add20 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40639e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000b1980 con 0x7ff400158110 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 0x7ff4001f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 0x7ff4001f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42962/0 (socket says 172.21.15.123:42962) 2023-07-21T19:07:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 -- 172.21.15.123:0/1236050826 learned_addr learned my addr 172.21.15.123:0/1236050826 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:54.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff405b9d700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff4001f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff404b9b700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4000add20 0x7ff4000b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 -- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 msgr2=0x7ff4001f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff4001f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 -- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4000add20 msgr2=0x7ff4000b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4000add20 0x7ff4000b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 -- 172.21.15.123:0/1236050826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8009a70 con 0x7ff40006fa80 2023-07-21T19:07:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff405b9d700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff4001f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.592+0000 7ff40539c700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 0x7ff4001f0d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00e840 tx=0x7ff3fc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0095a0 con 0x7ff40006fa80 2023-07-21T19:07:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00c690 con 0x7ff40006fa80 2023-07-21T19:07:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00ca00 con 0x7ff40006fa80 2023-07-21T19:07:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4000b1090 con 0x7ff40006fa80 2023-07-21T19:07:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4000b1370 con 0x7ff40006fa80 2023-07-21T19:07:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40004e500 con 0x7ff40006fa80 2023-07-21T19:07:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.596+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3fc00cb60 con 0x7ff40006fa80 2023-07-21T19:07:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.600+0000 7ff3f5ffb700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff3e4066320 0x7ff3e40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.600+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff3fc083fa0 con 0x7ff40006fa80 2023-07-21T19:07:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.600+0000 7ff404b9b700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff3e4066320 0x7ff3e40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:54.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.600+0000 7ff404b9b700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff3e4066320 0x7ff3e40687d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff400142070 tx=0x7ff3f0007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:54.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.608+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff3fc051090 con 0x7ff40006fa80 2023-07-21T19:07:54.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.780+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4000cf750 con 0x7ff40006fa80 2023-07-21T19:07:54.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.784+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/1236050826 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7ff3fc0546b0 con 0x7ff40006fa80 2023-07-21T19:07:54.797 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:54.797 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:54.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff3e4066320 msgr2=0x7ff3e40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff3e4066320 0x7ff3e40687d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff400142070 tx=0x7ff3f0007c00 comp rx=0 tx=0).stop 2023-07-21T19:07:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 msgr2=0x7ff4001f0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 0x7ff4001f0d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00e840 tx=0x7ff3fc00ec00 comp rx=0 tx=0).stop 2023-07-21T19:07:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 shutdown_connections 2023-07-21T19:07:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff3e4066320 0x7ff3e40687d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4000add20 0x7ff4000b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff400158110 0x7ff4001f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 --2- 172.21.15.123:0/1236050826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff40006fa80 0x7ff4001f0d90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:54.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 >> 172.21.15.123:0/1236050826 conn(0x7ff4000711b0 msgr2=0x7ff40015b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:54.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 shutdown_connections 2023-07-21T19:07:54.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.788+0000 7ff40639e700 1 -- 172.21.15.123:0/1236050826 wait complete. 2023-07-21T19:07:54.837 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.996+0000 7f71fcb15700 1 Processor -- start 2023-07-21T19:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:54.996+0000 7f71fcb15700 1 -- start start 2023-07-21T19:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71fcb15700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f71f815ffa0 0x7f71f806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71fcb15700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f806dc50 0x7f71f80caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71fcb15700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80ca8a0 con 0x7f71f8160370 2023-07-21T19:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71fcb15700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80cbcd0 con 0x7f71f815ffa0 2023-07-21T19:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71fcb15700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80cbf70 con 0x7f71f806dc50 2023-07-21T19:07:55.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f71f815ffa0 0x7f71f806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f6ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f806dc50 0x7f71f80caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f7fff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f71f8160370 0x7f71f80ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:33628/0 (socket says 172.21.15.123:33628) 2023-07-21T19:07:55.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f71f815ffa0 0x7f71f806d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45504/0 (socket says 172.21.15.123:45504) 2023-07-21T19:07:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f7fff700 1 -- 172.21.15.123:0/394819258 learned_addr learned my addr 172.21.15.123:0/394819258 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 -- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f806dc50 msgr2=0x7f71f80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 --2- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f806dc50 0x7f71f80caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 -- 172.21.15.123:0/394819258 >> v1:172.21.15.145:6789/0 conn(0x7f71f8160370 legacy=0x7f71f80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 -- 172.21.15.123:0/394819258 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80cc250 con 0x7f71f815ffa0 2023-07-21T19:07:55.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f77fe700 1 --2- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f806d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009850 tx=0x7f71e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=761c605e2985f837 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:55.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f67fc700 1 -- 172.21.15.123:0/394819258 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8011830 con 0x7f71f815ffa0 2023-07-21T19:07:55.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f67fc700 1 -- 172.21.15.123:0/394819258 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8011990 con 0x7f71f815ffa0 2023-07-21T19:07:55.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.000+0000 7f71f67fc700 1 -- 172.21.15.123:0/394819258 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8011d40 con 0x7f71f815ffa0 2023-07-21T19:07:55.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 -- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 msgr2=0x7f71f806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 --2- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f806d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009850 tx=0x7f71e8009b60 comp rx=0 tx=0).stop 2023-07-21T19:07:55.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 -- 172.21.15.123:0/394819258 shutdown_connections 2023-07-21T19:07:55.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 --2- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f806dc50 0x7f71f80caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 --2- 172.21.15.123:0/394819258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f806d710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 -- 172.21.15.123:0/394819258 >> 172.21.15.123:0/394819258 conn(0x7f71f806e960 msgr2=0x7f71f806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:55.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 -- 172.21.15.123:0/394819258 shutdown_connections 2023-07-21T19:07:55.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.004+0000 7f71fcb15700 1 -- 172.21.15.123:0/394819258 wait complete. 2023-07-21T19:07:55.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 Processor -- start 2023-07-21T19:07:55.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 -- start start 2023-07-21T19:07:55.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 0x7f71f80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f8160370 0x7f71f80c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8158c80 con 0x7f71f806dc50 2023-07-21T19:07:55.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c7400 con 0x7f71f815ffa0 2023-07-21T19:07:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71fcb15700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c2df0 con 0x7f71f8160370 2023-07-21T19:07:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 0x7f71f80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 0x7f71f80c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42974/0 (socket says 172.21.15.123:42974) 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 -- 172.21.15.123:0/4067953858 learned_addr learned my addr 172.21.15.123:0/4067953858 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f6ffd700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f7fff700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f8160370 0x7f71f80c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 -- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f8160370 msgr2=0x7f71f80c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f8160370 0x7f71f80c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 -- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 msgr2=0x7f71f80c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f80c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 -- 172.21.15.123:0/4067953858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80094b0 con 0x7f71f806dc50 2023-07-21T19:07:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f7fff700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f8160370 0x7f71f80c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.008+0000 7f71f77fe700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 0x7f71f80c7890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71e8014040 tx=0x7f71e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8004480 con 0x7f71f806dc50 2023-07-21T19:07:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f80c67f0 con 0x7f71f806dc50 2023-07-21T19:07:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e801e070 con 0x7f71f806dc50 2023-07-21T19:07:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8003900 con 0x7f71f806dc50 2023-07-21T19:07:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80c6db0 con 0x7f71f806dc50 2023-07-21T19:07:55.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f8071620 con 0x7f71f806dc50 2023-07-21T19:07:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.012+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71e8020030 con 0x7f71f806dc50 2023-07-21T19:07:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.016+0000 7f71dffff700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71e40662f0 0x7f71e40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.016+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71e8084e90 con 0x7f71f806dc50 2023-07-21T19:07:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.016+0000 7f71f6ffd700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71e40662f0 0x7f71e40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.016+0000 7f71f6ffd700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71e40662f0 0x7f71e40687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71f815f190 tx=0x7f71ec009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:55.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.020+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f71e80520b0 con 0x7f71f806dc50 2023-07-21T19:07:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.228+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71f804e500 con 0x7f71f806dc50 2023-07-21T19:07:55.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.228+0000 7f71dffff700 1 -- 172.21.15.123:0/4067953858 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f71e80556d0 con 0x7f71f806dc50 2023-07-21T19:07:55.242 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:55.242 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:07:53.534648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-21T19:07:55.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71e40662f0 msgr2=0x7f71e40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71e40662f0 0x7f71e40687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71f815f190 tx=0x7f71ec009240 comp rx=0 tx=0).stop 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 msgr2=0x7f71f80c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 0x7f71f80c7890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71e8014040 tx=0x7f71e8004770 comp rx=0 tx=0).stop 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 shutdown_connections 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f71e40662f0 0x7f71e40687a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71f815ffa0 0x7f71f80c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71f8160370 0x7f71f80c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 --2- 172.21.15.123:0/4067953858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f806dc50 0x7f71f80c7890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 >> 172.21.15.123:0/4067953858 conn(0x7f71f806e960 msgr2=0x7f71f80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:55.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 shutdown_connections 2023-07-21T19:07:55.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.232+0000 7f71fcb15700 1 -- 172.21.15.123:0/4067953858 wait complete. 2023-07-21T19:07:55.247 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2023-07-21T19:07:55.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:07:55.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 Processor -- start 2023-07-21T19:07:55.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 -- start start 2023-07-21T19:07:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec2c0cb340 0x7fec2c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c15c4f0 0x7fec2c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0cfc90 con 0x7fec2c14f920 2023-07-21T19:07:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0b3310 con 0x7fec2c0cb340 2023-07-21T19:07:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2b59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0b29e0 con 0x7fec2c15c4f0 2023-07-21T19:07:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec2c0cb340 0x7fec2c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec2c0cb340 0x7fec2c0cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42980/0 (socket says 172.21.15.123:42980) 2023-07-21T19:07:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 -- 172.21.15.123:0/1356147188 learned_addr learned my addr 172.21.15.123:0/1356147188 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec2ad9d700 1 --2- 172.21.15.123:0/1356147188 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c15c4f0 0x7fec2c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 -- 172.21.15.123:0/1356147188 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c15c4f0 msgr2=0x7fec2c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 --2- 172.21.15.123:0/1356147188 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c15c4f0 0x7fec2c15c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 -- 172.21.15.123:0/1356147188 >> v1:172.21.15.145:6789/0 conn(0x7fec2c14f920 legacy=0x7fec2c0cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.428+0000 7fec29d9b700 1 -- 172.21.15.123:0/1356147188 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0b2cc0 con 0x7fec2c0cb340 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec29d9b700 1 --2- 172.21.15.123:0/1356147188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c0cb340 0x7fec2c0cb790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec20009910 tx=0x7fec20009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46897045382f11e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2959a700 1 -- 172.21.15.123:0/1356147188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2000ba60 con 0x7fec2c0cb340 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2959a700 1 -- 172.21.15.123:0/1356147188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2000bbc0 con 0x7fec2c0cb340 2023-07-21T19:07:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2959a700 1 -- 172.21.15.123:0/1356147188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20009e60 con 0x7fec2c0cb340 2023-07-21T19:07:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 -- 172.21.15.123:0/1356147188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c0cb340 msgr2=0x7fec2c0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 --2- 172.21.15.123:0/1356147188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c0cb340 0x7fec2c0cb790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec20009910 tx=0x7fec20009c20 comp rx=0 tx=0).stop 2023-07-21T19:07:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 -- 172.21.15.123:0/1356147188 shutdown_connections 2023-07-21T19:07:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 --2- 172.21.15.123:0/1356147188 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c15c4f0 0x7fec2c15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 --2- 172.21.15.123:0/1356147188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c0cb340 0x7fec2c0cb790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 -- 172.21.15.123:0/1356147188 >> 172.21.15.123:0/1356147188 conn(0x7fec2c06fa70 msgr2=0x7fec2c06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 -- 172.21.15.123:0/1356147188 shutdown_connections 2023-07-21T19:07:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.432+0000 7fec2b59e700 1 -- 172.21.15.123:0/1356147188 wait complete. 2023-07-21T19:07:55.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 Processor -- start 2023-07-21T19:07:55.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 -- start start 2023-07-21T19:07:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec2c0cb340 0x7fec2c14d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c14f920 0x7fec2c1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 0x7fec2c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1ef780 con 0x7fec2c15c4f0 2023-07-21T19:07:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1efa60 con 0x7fec2c0cb340 2023-07-21T19:07:55.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1efd40 con 0x7fec2c14f920 2023-07-21T19:07:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 0x7fec2c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 0x7fec2c14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42988/0 (socket says 172.21.15.123:42988) 2023-07-21T19:07:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 -- 172.21.15.123:0/904987535 learned_addr learned my addr 172.21.15.123:0/904987535 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2a59c700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec2c0cb340 0x7fec2c14d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec29d9b700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c14f920 0x7fec2c1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 -- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c14f920 msgr2=0x7fec2c1519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c14f920 0x7fec2c1519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 -- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec2c0cb340 msgr2=0x7fec2c14d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec2c0cb340 0x7fec2c14d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 -- 172.21.15.123:0/904987535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20009570 con 0x7fec2c15c4f0 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2ad9d700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 0x7fec2c14e080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec24007e40 tx=0x7fec2400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2400ed30 con 0x7fec2c15c4f0 2023-07-21T19:07:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec24014420 con 0x7fec2c15c4f0 2023-07-21T19:07:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c1f0020 con 0x7fec2c15c4f0 2023-07-21T19:07:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240147d0 con 0x7fec2c15c4f0 2023-07-21T19:07:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.436+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c1ef4a0 con 0x7fec2c15c4f0 2023-07-21T19:07:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.440+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c158240 con 0x7fec2c15c4f0 2023-07-21T19:07:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.440+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec24014930 con 0x7fec2c15c4f0 2023-07-21T19:07:55.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.444+0000 7fec1affd700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fec0c066320 0x7fec0c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:55.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.444+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec240846d0 con 0x7fec2c15c4f0 2023-07-21T19:07:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.444+0000 7fec2a59c700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fec0c066320 0x7fec0c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.444+0000 7fec2a59c700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fec0c066320 0x7fec0c0687d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec2c155740 tx=0x7fec1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.448+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fec24051850 con 0x7fec2c15c4f0 2023-07-21T19:07:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.624+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec2c0b2f70 con 0x7fec2c15c4f0 2023-07-21T19:07:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.624+0000 7fec1affd700 1 -- 172.21.15.123:0/904987535 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fec24054e70 con 0x7fec2c15c4f0 2023-07-21T19:07:55.639 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:07:55.639 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:07:55.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fec0c066320 msgr2=0x7fec0c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fec0c066320 0x7fec0c0687d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec2c155740 tx=0x7fec1c009040 comp rx=0 tx=0).stop 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 msgr2=0x7fec2c14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 0x7fec2c14e080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec24007e40 tx=0x7fec2400e3c0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 shutdown_connections 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fec0c066320 0x7fec0c0687d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c15c4f0 0x7fec2c14e080 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2c14f920 0x7fec2c1519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 --2- 172.21.15.123:0/904987535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec2c0cb340 0x7fec2c14d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 >> 172.21.15.123:0/904987535 conn(0x7fec2c06fa70 msgr2=0x7fec2c15c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 shutdown_connections 2023-07-21T19:07:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:55.632+0000 7fec2b59e700 1 -- 172.21.15.123:0/904987535 wait complete. 2023-07-21T19:07:56.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T19:07:47.865751+0000', 'modified': '2023-07-21T19:07:53.534648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6835/2690918060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6833', 'nonce': 2690918060}, {'type': 'v1', 'addr': '172.21.15.145:6835', 'nonce': 2690918060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-21T19:07:56.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T19:07:56.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-21T19:07:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 Processor -- start 2023-07-21T19:07:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 -- start start 2023-07-21T19:07:56.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd044159f20 0x7fd0440caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0440caf70 0x7fd04415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0440b0ef0 con 0x7fd0440c9d90 2023-07-21T19:07:56.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440ce9c0 con 0x7fd044159f20 2023-07-21T19:07:56.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.232+0000 7fd049af2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440cee50 con 0x7fd0440caf70 2023-07-21T19:07:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd044159f20 0x7fd0440caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd044159f20 0x7fd0440caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42992/0 (socket says 172.21.15.123:42992) 2023-07-21T19:07:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 -- 172.21.15.123:0/1694673779 learned_addr learned my addr 172.21.15.123:0/1694673779 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd048af0700 1 --1- 172.21.15.123:0/1694673779 >> v1:172.21.15.145:6789/0 conn(0x7fd0440c9d90 0x7fd0440ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:33648/0 (socket says 172.21.15.123:33648) 2023-07-21T19:07:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd0492f1700 1 --2- 172.21.15.123:0/1694673779 >> v2:172.21.15.145:3300/0 conn(0x7fd0440caf70 0x7fd04415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 -- 172.21.15.123:0/1694673779 >> v2:172.21.15.145:3300/0 conn(0x7fd0440caf70 msgr2=0x7fd04415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 --2- 172.21.15.123:0/1694673779 >> v2:172.21.15.145:3300/0 conn(0x7fd0440caf70 0x7fd04415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 -- 172.21.15.123:0/1694673779 >> v1:172.21.15.145:6789/0 conn(0x7fd0440c9d90 legacy=0x7fd0440ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd0437fe700 1 -- 172.21.15.123:0/1694673779 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138096519 0 0) 0x7fd0440b0ef0 con 0x7fd0440c9d90 2023-07-21T19:07:56.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 -- 172.21.15.123:0/1694673779 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440cb4f0 con 0x7fd044159f20 2023-07-21T19:07:56.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd043fff700 1 --2- 172.21.15.123:0/1694673779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440caa30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0440ca950 tx=0x7fd034009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ef96e5937963ea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd0437fe700 1 -- 172.21.15.123:0/1694673779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034011830 con 0x7fd044159f20 2023-07-21T19:07:56.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd0437fe700 1 -- 172.21.15.123:0/1694673779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034011990 con 0x7fd044159f20 2023-07-21T19:07:56.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd0437fe700 1 -- 172.21.15.123:0/1694673779 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034011d20 con 0x7fd044159f20 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 -- 172.21.15.123:0/1694673779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 msgr2=0x7fd0440caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 --2- 172.21.15.123:0/1694673779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440caa30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0440ca950 tx=0x7fd034009bf0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 -- 172.21.15.123:0/1694673779 shutdown_connections 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 --2- 172.21.15.123:0/1694673779 >> v2:172.21.15.145:3300/0 conn(0x7fd0440caf70 0x7fd04415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 --2- 172.21.15.123:0/1694673779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440caa30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 -- 172.21.15.123:0/1694673779 >> 172.21.15.123:0/1694673779 conn(0x7fd04406e960 msgr2=0x7fd04406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 -- 172.21.15.123:0/1694673779 shutdown_connections 2023-07-21T19:07:56.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.236+0000 7fd049af2700 1 -- 172.21.15.123:0/1694673779 wait complete. 2023-07-21T19:07:56.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 Processor -- start 2023-07-21T19:07:56.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 -- start start 2023-07-21T19:07:56.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0440c9d90 0x7fd0441543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0440caf70 0x7fd044158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440c2be0 con 0x7fd044159f20 2023-07-21T19:07:56.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044154900 con 0x7fd0440caf70 2023-07-21T19:07:56.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd049af2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044158d70 con 0x7fd0440c9d90 2023-07-21T19:07:56.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42998/0 (socket says 172.21.15.123:42998) 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd0492f1700 1 -- 172.21.15.123:0/1768024013 learned_addr learned my addr 172.21.15.123:0/1768024013 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd043fff700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0440caf70 0x7fd044158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.240+0000 7fd048af0700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0440c9d90 0x7fd0441543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0492f1700 1 -- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0440c9d90 msgr2=0x7fd0441543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0492f1700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0440c9d90 0x7fd0441543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0492f1700 1 -- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0440caf70 msgr2=0x7fd044158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0492f1700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0440caf70 0x7fd044158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0492f1700 1 -- 172.21.15.123:0/1768024013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009570 con 0x7fd044159f20 2023-07-21T19:07:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd048af0700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0440c9d90 0x7fd0441543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0492f1700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440cc760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00efc0 tx=0x7fd03c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0417fa700 1 -- 172.21.15.123:0/1768024013 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c009ea0 con 0x7fd044159f20 2023-07-21T19:07:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0417fa700 1 -- 172.21.15.123:0/1768024013 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00f040 con 0x7fd044159f20 2023-07-21T19:07:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd044159050 con 0x7fd044159f20 2023-07-21T19:07:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd0417fa700 1 -- 172.21.15.123:0/1768024013 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c014480 con 0x7fd044159f20 2023-07-21T19:07:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.244+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0440c2e80 con 0x7fd044159f20 2023-07-21T19:07:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd0417fa700 1 -- 172.21.15.123:0/1768024013 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd03c0145e0 con 0x7fd044159f20 2023-07-21T19:07:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd0417fa700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd0300662f0 0x7fd0300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd0417fa700 1 -- 172.21.15.123:0/1768024013 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd03c0848a0 con 0x7fd044159f20 2023-07-21T19:07:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd048af0700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd0300662f0 0x7fd0300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd04dfd5740 1 Processor -- start 2023-07-21T19:07:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd048af0700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd0300662f0 0x7fd0300687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd038000f60 tx=0x7fd038007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.248+0000 7fd04dfd5740 1 -- start start 2023-07-21T19:07:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839eb0 0x1af28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1af2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1aa7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x19c6270 con 0x1839eb0 2023-07-21T19:07:56.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a193a0 con 0x1839710 2023-07-21T19:07:56.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a12600 con 0x1839ae0 2023-07-21T19:07:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1af2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd048af0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839eb0 0x1af28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1aa7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1af2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:39702/0 (socket says 172.21.15.123:39702) 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 -- 172.21.15.123:0/382102905 learned_addr learned my addr 172.21.15.123:0/382102905 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 -- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 msgr2=0x1aa7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1aa7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 -- 172.21.15.123:0/382102905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839eb0 msgr2=0x1af28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839eb0 0x1af28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 -- 172.21.15.123:0/382102905 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18859e0 con 0x1839ae0 2023-07-21T19:07:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd0492f1700 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1aa7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd048af0700 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839eb0 0x1af28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd043fff700 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1af2df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd034013000 tx=0x7fd034010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e97ab69348f4c80 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd02a7fc700 1 -- 172.21.15.123:0/382102905 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034020070 con 0x1839ae0 2023-07-21T19:07:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd02a7fc700 1 -- 172.21.15.123:0/382102905 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0340117f0 con 0x1839ae0 2023-07-21T19:07:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.252+0000 7fd02a7fc700 1 -- 172.21.15.123:0/382102905 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004040 con 0x1839ae0 2023-07-21T19:07:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 msgr2=0x1af2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1af2df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd034013000 tx=0x7fd034010000 comp rx=0 tx=0).stop 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- 172.21.15.123:0/382102905 shutdown_connections 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1aa7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1af2df0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/382102905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839eb0 0x1af28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- 172.21.15.123:0/382102905 >> 172.21.15.123:0/382102905 conn(0x1aa3b60 msgr2=0x1aae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- 172.21.15.123:0/382102905 shutdown_connections 2023-07-21T19:07:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- 172.21.15.123:0/382102905 wait complete. 2023-07-21T19:07:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- start start 2023-07-21T19:07:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 Processor -- start 2023-07-21T19:07:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1adbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1adad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839eb0 0x1afc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d4b00 con 0x1839ae0 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d3470 con 0x1839710 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x18beb20 con 0x1839eb0 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd04dfd5740 10 client.0 _ll_register_callbacks cb 0x1a38530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd043fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1adad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd043fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1adad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43016/0 (socket says 172.21.15.123:43016) 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.256+0000 7fd043fff700 1 -- 172.21.15.123:0/285556340 learned_addr learned my addr 172.21.15.123:0/285556340 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd048af0700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1adbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0492f1700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839eb0 0x1afc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd043fff700 1 -- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839eb0 msgr2=0x1afc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd043fff700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839eb0 0x1afc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd043fff700 1 -- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 msgr2=0x1adbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd043fff700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1adbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd043fff700 1 -- 172.21.15.123:0/285556340 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0440c2e80 con 0x1839ae0 2023-07-21T19:07:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd048af0700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1adbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd043fff700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1adad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd04406a6f0 tx=0x7fd0340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6aa23c4fd7f8237 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0237fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-21T19:07:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0237fe700 1 -- 172.21.15.123:0/285556340 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034020040 con 0x1839ae0 2023-07-21T19:07:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a0b5e0 con 0x1839ae0 2023-07-21T19:07:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0237fe700 1 -- 172.21.15.123:0/285556340 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd034004540 con 0x1839ae0 2023-07-21T19:07:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0237fe700 1 -- 172.21.15.123:0/285556340 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0340036c0 con 0x1839ae0 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 10 client.4425 fetch_fsmap learned FSMap version 7 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7fd03800f040 con 0x1839ae0 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0237fe700 1 -- 172.21.15.123:0/285556340 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a0b5e0 con 0x1839ae0 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd0237fe700 1 -- 172.21.15.123:0/285556340 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd03402c070 con 0x1839ae0 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 20 client.4425 populate_metadata read hostname 'smithi123' 2023-07-21T19:07:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1884790 0x1adc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 4 client.4425 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T19:07:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 --> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a0b300 con 0x1884790 2023-07-21T19:07:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.260+0000 7fd048af0700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1884790 0x1adc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd048af0700 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1884790 0x1adc9a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aafe02166880da97 server_cookie=bff0a607a088e863 in_seq=0 out_seq=0 2023-07-21T19:07:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd0237fe700 10 client.4425 ms_handle_connect on v2:172.21.15.145:6833/2690918060 2023-07-21T19:07:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd0237fe700 1 -- 172.21.15.123:0/285556340 <== mds.0 v2:172.21.15.145:6833/2690918060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x1a0b300 con 0x1884790 2023-07-21T19:07:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd0237fe700 10 client.4425 handle_command_reply: tid=0 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 client.4425 shutdown 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 msgr2=0x1adad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1adad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd04406a6f0 tx=0x7fd0340047e0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 shutdown_connections 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1884790 0x1adc9a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839eb0 0x1afc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1adad10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/285556340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1adbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 >> 172.21.15.123:0/285556340 conn(0x1aa3b60 msgr2=0x1aa7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd0237fe700 0 client.4425 ms_handle_reset on v2:172.21.15.145:6833/2690918060 2023-07-21T19:07:56.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 shutdown_connections 2023-07-21T19:07:56.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 1 -- 172.21.15.123:0/285556340 wait complete. 2023-07-21T19:07:56.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.264+0000 7fd04dfd5740 20 client.4425 trim_cache size 0 max 16384 2023-07-21T19:07:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 Processor -- start 2023-07-21T19:07:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 -- start start 2023-07-21T19:07:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1aa3b60 0x1ad4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1ad5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1afa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a1a630 con 0x1839ae0 2023-07-21T19:07:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a188e0 con 0x1839710 2023-07-21T19:07:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x19cfd90 con 0x1aa3b60 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1afa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1ad5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1afa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43024/0 (socket says 172.21.15.123:43024) 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd0492f1700 1 -- 172.21.15.123:0/1577286438 learned_addr learned my addr 172.21.15.123:0/1577286438 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd048af0700 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1aa3b60 0x1ad4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 -- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1aa3b60 msgr2=0x1ad4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1aa3b60 0x1ad4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 -- 172.21.15.123:0/1577286438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 msgr2=0x1afa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1afa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 -- 172.21.15.123:0/1577286438 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ad9ee0 con 0x1839710 2023-07-21T19:07:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd0492f1700 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1afa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd043fff700 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1ad5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd034006eb0 tx=0x7fd03400b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76d4a9b02c5020a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd02affd700 1 -- 172.21.15.123:0/1577286438 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034020070 con 0x1839710 2023-07-21T19:07:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd02affd700 1 -- 172.21.15.123:0/1577286438 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034003870 con 0x1839710 2023-07-21T19:07:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.288+0000 7fd02affd700 1 -- 172.21.15.123:0/1577286438 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004540 con 0x1839710 2023-07-21T19:07:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 msgr2=0x1ad5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1ad5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd034006eb0 tx=0x7fd03400b050 comp rx=0 tx=0).stop 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- 172.21.15.123:0/1577286438 shutdown_connections 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1ad5350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1839ae0 0x1afa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/1577286438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1aa3b60 0x1ad4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- 172.21.15.123:0/1577286438 >> 172.21.15.123:0/1577286438 conn(0x1afc210 msgr2=0x1adab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- 172.21.15.123:0/1577286438 shutdown_connections 2023-07-21T19:07:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- 172.21.15.123:0/1577286438 wait complete. 2023-07-21T19:07:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- start start 2023-07-21T19:07:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 Processor -- start 2023-07-21T19:07:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1b00c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1aa88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 0x1b020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b4fb20 con 0x1aa3b60 2023-07-21T19:07:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a750d0 con 0x1839710 2023-07-21T19:07:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a0ab00 con 0x1839ae0 2023-07-21T19:07:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.292+0000 7fd04dfd5740 10 client.0 _ll_register_callbacks cb 0x19ca800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T19:07:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 0x1b020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 0x1b020f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43028/0 (socket says 172.21.15.123:43028) 2023-07-21T19:07:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 -- 172.21.15.123:0/3581220310 learned_addr learned my addr 172.21.15.123:0/3581220310 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd048af0700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1b00c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd043fff700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1aa88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 -- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 msgr2=0x1aa88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1aa88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 -- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 msgr2=0x1b00c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1b00c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 -- 172.21.15.123:0/3581220310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03800f040 con 0x1aa3b60 2023-07-21T19:07:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd048af0700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1b00c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:07:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0492f1700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 0x1b020f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd03c082940 tx=0x7fd03c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8843aa9403db6219 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0237fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-21T19:07:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0237fe700 1 -- 172.21.15.123:0/3581220310 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0516d0 con 0x1aa3b60 2023-07-21T19:07:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0340117f0 con 0x1aa3b60 2023-07-21T19:07:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0237fe700 1 -- 172.21.15.123:0/3581220310 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd03c051830 con 0x1aa3b60 2023-07-21T19:07:56.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0237fe700 1 -- 172.21.15.123:0/3581220310 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd03c056ad0 con 0x1aa3b60 2023-07-21T19:07:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 10 client.4431 fetch_fsmap learned FSMap version 7 2023-07-21T19:07:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7fd0440cd000 con 0x1aa3b60 2023-07-21T19:07:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0237fe700 1 -- 172.21.15.123:0/3581220310 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0340117f0 con 0x1aa3b60 2023-07-21T19:07:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd0237fe700 1 -- 172.21.15.123:0/3581220310 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd03c056c30 con 0x1aa3b60 2023-07-21T19:07:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-07-21T19:07:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 10 client.4431 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 20 client.4431 populate_metadata read hostname 'smithi123' 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1839eb0 0x1b53960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 4 client.4431 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 --> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x18914e0 con 0x1839eb0 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.296+0000 7fd048af0700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1839eb0 0x1b53960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd048af0700 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1839eb0 0x1b53960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6b6804994a10fb server_cookie=a628b9ef5eedc3b6 in_seq=0 out_seq=0 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd0237fe700 10 client.4431 ms_handle_connect on v2:172.21.15.145:6833/2690918060 2023-07-21T19:07:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd0237fe700 1 -- 172.21.15.123:0/3581220310 <== mds.0 v2:172.21.15.145:6833/2690918060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x18914e0 con 0x1839eb0 2023-07-21T19:07:56.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd0237fe700 10 client.4431 handle_command_reply: tid=0 2023-07-21T19:07:56.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 client.4431 shutdown 2023-07-21T19:07:56.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 msgr2=0x1b020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 0x1b020f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd03c082940 tx=0x7fd03c013000 comp rx=0 tx=0).stop 2023-07-21T19:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 shutdown_connections 2023-07-21T19:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x1839eb0 0x1b53960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1aa3b60 0x1b020f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1839ae0 0x1aa88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd0237fe700 0 client.4431 ms_handle_reset on v2:172.21.15.145:6833/2690918060 2023-07-21T19:07:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 --2- 172.21.15.123:0/3581220310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1839710 0x1b00c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 >> 172.21.15.123:0/3581220310 conn(0x1afc210 msgr2=0x1ad8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 shutdown_connections 2023-07-21T19:07:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 1 -- 172.21.15.123:0/3581220310 wait complete. 2023-07-21T19:07:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd04dfd5740 20 client.4431 trim_cache size 0 max 16384 2023-07-21T19:07:56.316 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "786ff8a7-6b4c-4933-876c-0b96df73a43e", 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4290, 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2023-07-21T19:07:56.317 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 7.8484046689999998, 2023-07-21T19:07:56.318 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 7, 2023-07-21T19:07:56.318 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 28, 2023-07-21T19:07:56.318 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 28, 2023-07-21T19:07:56.318 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.768126848 2023-07-21T19:07:56.318 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd0300662f0 msgr2=0x7fd0300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd0300662f0 0x7fd0300687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd038000f60 tx=0x7fd038007d50 comp rx=0 tx=0).stop 2023-07-21T19:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 msgr2=0x7fd0440cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440cc760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00efc0 tx=0x7fd03c00c3a0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 shutdown_connections 2023-07-21T19:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd0300662f0 0x7fd0300687a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0440caf70 0x7fd044158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd044159f20 0x7fd0440cc760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 --2- 172.21.15.123:0/1768024013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0440c9d90 0x7fd0441543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 >> 172.21.15.123:0/1768024013 conn(0x7fd04406e960 msgr2=0x7fd0440add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 shutdown_connections 2023-07-21T19:07:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.300+0000 7fd049af2700 1 -- 172.21.15.123:0/1768024013 wait complete. 2023-07-21T19:07:56.337 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T19:07:56.337 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:07:56.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T19:07:56.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.496+0000 7f5502d89700 1 Processor -- start 2023-07-21T19:07:56.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.496+0000 7f5502d89700 1 -- start start 2023-07-21T19:07:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502d89700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc15ffa0 0x7f54fc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502d89700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f54fc0cb180 0x7f54fc0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502d89700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0ca8a0 con 0x7f54fc06dc50 2023-07-21T19:07:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502d89700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc0cbcd0 con 0x7f54fc0cb180 2023-07-21T19:07:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502d89700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0cbf70 con 0x7f54fc15ffa0 2023-07-21T19:07:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5501586700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f54fc06dc50 0x7f54fc0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50114/0 (socket says 172.21.15.123:50114) 2023-07-21T19:07:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5501586700 1 -- 172.21.15.123:0/934805249 learned_addr learned my addr 172.21.15.123:0/934805249 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:07:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502588700 1 --2- 172.21.15.123:0/934805249 >> v2:172.21.15.145:3300/0 conn(0x7f54fc0cb180 0x7f54fc0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5501d87700 1 --2- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc15ffa0 0x7f54fc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5500d85700 1 -- 172.21.15.123:0/934805249 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861245331 0 0) 0x7f54ec001110 con 0x7f54fc06dc50 2023-07-21T19:07:56.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5500d85700 1 -- 172.21.15.123:0/934805249 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e80035d0 con 0x7f54fc06dc50 2023-07-21T19:07:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502588700 1 -- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc15ffa0 msgr2=0x7f54fc06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:07:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502588700 1 --2- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc15ffa0 0x7f54fc06d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502588700 1 -- 172.21.15.123:0/934805249 >> v1:172.21.15.123:6789/0 conn(0x7f54fc06dc50 legacy=0x7f54fc0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502588700 1 -- 172.21.15.123:0/934805249 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0cc250 con 0x7f54fc0cb180 2023-07-21T19:07:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.500+0000 7f5502588700 1 --2- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc0cb180 0x7f54fc0ce340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009d90 tx=0x7f54f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c54de18de640fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5500d85700 1 -- 172.21.15.123:0/934805249 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400e070 con 0x7f54fc0cb180 2023-07-21T19:07:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5500d85700 1 -- 172.21.15.123:0/934805249 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f400bb20 con 0x7f54fc0cb180 2023-07-21T19:07:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5500d85700 1 -- 172.21.15.123:0/934805249 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4012430 con 0x7f54fc0cb180 2023-07-21T19:07:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 -- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc0cb180 msgr2=0x7f54fc0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 --2- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc0cb180 0x7f54fc0ce340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009d90 tx=0x7f54f400b330 comp rx=0 tx=0).stop 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 -- 172.21.15.123:0/934805249 shutdown_connections 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 --2- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc0cb180 0x7f54fc0ce340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 --2- 172.21.15.123:0/934805249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc15ffa0 0x7f54fc06d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 -- 172.21.15.123:0/934805249 >> 172.21.15.123:0/934805249 conn(0x7f54fc06e960 msgr2=0x7f54fc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 -- 172.21.15.123:0/934805249 shutdown_connections 2023-07-21T19:07:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.504+0000 7f5502d89700 1 -- 172.21.15.123:0/934805249 wait complete. 2023-07-21T19:07:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 Processor -- start 2023-07-21T19:07:56.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 -- start start 2023-07-21T19:07:56.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc06dc50 0x7f54fc15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0cb180 0x7f54fc0c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 0x7f54fc0c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc15fae0 con 0x7f54fc15ffa0 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0c2980 con 0x7f54fc06dc50 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502d89700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0c2c60 con 0x7f54fc0cb180 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 0x7f54fc0c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 0x7f54fc0c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43040/0 (socket says 172.21.15.123:43040) 2023-07-21T19:07:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 -- 172.21.15.123:0/3370225714 learned_addr learned my addr 172.21.15.123:0/3370225714 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:07:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5501d87700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc06dc50 0x7f54fc15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5501586700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0cb180 0x7f54fc0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 -- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0cb180 msgr2=0x7f54fc0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0cb180 0x7f54fc0c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 -- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc06dc50 msgr2=0x7f54fc15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc06dc50 0x7f54fc15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 -- 172.21.15.123:0/3370225714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009a70 con 0x7f54fc15ffa0 2023-07-21T19:07:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5501d87700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc06dc50 0x7f54fc15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:07:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.508+0000 7f5502588700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 0x7f54fc0c4490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54f4014040 tx=0x7f54f4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.512+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4012430 con 0x7f54fc15ffa0 2023-07-21T19:07:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.512+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4020070 con 0x7f54fc15ffa0 2023-07-21T19:07:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.512+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc0c2f40 con 0x7f54fc15ffa0 2023-07-21T19:07:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.512+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4004280 con 0x7f54fc15ffa0 2023-07-21T19:07:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.512+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc0c3500 con 0x7f54fc15ffa0 2023-07-21T19:07:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.512+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc0c36f0 con 0x7f54fc15ffa0 2023-07-21T19:07:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.516+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54f40043e0 con 0x7f54fc15ffa0 2023-07-21T19:07:56.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.516+0000 7f54f27fc700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f54e00662f0 0x7f54e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:07:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.516+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54f4022070 con 0x7f54fc15ffa0 2023-07-21T19:07:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.516+0000 7f5501d87700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f54e00662f0 0x7f54e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:07:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.520+0000 7f5501d87700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f54e00662f0 0x7f54e00687a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009c40 tx=0x7f54f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:07:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.524+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f54f4052df0 con 0x7f54fc15ffa0 2023-07-21T19:07:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.732+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f54fc071620 con 0x7f54fc15ffa0 2023-07-21T19:07:56.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.736+0000 7f54f27fc700 1 -- 172.21.15.123:0/3370225714 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f54f402c070 con 0x7f54fc15ffa0 2023-07-21T19:07:56.747 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T19:07:56.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f54e00662f0 msgr2=0x7f54e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f54e00662f0 0x7f54e00687a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009c40 tx=0x7f54f8008040 comp rx=0 tx=0).stop 2023-07-21T19:07:56.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 msgr2=0x7f54fc0c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:07:56.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 0x7f54fc0c4490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54f4014040 tx=0x7f54f4004af0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 shutdown_connections 2023-07-21T19:07:56.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f54e00662f0 0x7f54e00687a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc15ffa0 0x7f54fc0c4490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0cb180 0x7f54fc0c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 --2- 172.21.15.123:0/3370225714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc06dc50 0x7f54fc15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:07:56.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 >> 172.21.15.123:0/3370225714 conn(0x7f54fc06e960 msgr2=0x7f54fc0cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:07:56.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 shutdown_connections 2023-07-21T19:07:56.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:07:56.740+0000 7f5502d89700 1 -- 172.21.15.123:0/3370225714 wait complete. 2023-07-21T19:07:56.773 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T19:07:56.774 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T19:07:56.774 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2023-07-21T19:07:56.774 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-21T19:07:56.775 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:07:56.775 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T19:07:56.775 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T19:07:56.775 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T19:07:56.775 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-21T19:07:56.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:56.776 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2023-07-21T19:07:56.793 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:07:56.794 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:07:56.794 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:07:56.794 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:07:56.794 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-07-21T19:07:56.794 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:07:56.794 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:07:56.795 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2023-07-21T19:07:56.795 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2023-07-21T19:07:56.795 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:07:56.795 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2023-07-21T19:07:56.795 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2023-07-21T19:07:56.795 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42146sec preferred_lft 42146sec 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2023-07-21T19:07:56.796 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:07:56.797 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T19:07:56.797 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:a8:46:62:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:07:56.797 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T19:07:56.797 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:07:56.798 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T19:07:56.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:56.799 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:07:56.799 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:07:56.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2023-07-21T19:07:56.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2023-07-21T19:07:56.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2023-07-21T19:07:56.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T19:07:56.800 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:07:56.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:56.956 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T19:07:56.989 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-07-21T19:07:56.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:56.993 DEBUG:teuthology.orchestra.run.smithi123:> route 2023-07-21T19:07:57.080 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2023-07-21T19:07:57.080 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T19:07:57.080 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T19:07:57.080 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T19:07:57.080 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T19:07:57.080 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T19:07:57.081 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T19:07:57.081 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T19:07:57.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.082 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:07:57.082 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:07:57.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T19:07:57.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T19:07:57.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T19:07:57.083 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:07:57.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.220 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-07-21T19:07:57.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.238 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2023-07-21T19:07:57.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.302 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:07:57.302 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:07:57.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-21T19:07:57.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-21T19:07:57.303 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:07:57.415 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-21T19:07:57.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.416 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:07:57.416 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:07:57.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-21T19:07:57.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T19:07:57.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-21T19:07:57.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-21T19:07:57.418 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-21T19:07:57.418 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:07:57.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.600 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:07:57.600 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:07:57.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2023-07-21T19:07:57.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T19:07:57.601 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:07:57.671 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-21T19:07:57.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:07:57.672 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:07:57.689 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-21T19:07:57.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:07:57.690 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:07:57.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:07:57.827 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:07:57.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:07:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:07:57.900 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:07:57.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:57.902 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:07:57.963 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T19:07:57.963 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-21T19:07:58.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:07:58.046 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:07:58.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:07:58.120 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:07:58.122 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:07:58.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:58.124 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:07:58.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:2023-07-21T19:07:58.144+0000 7f53888ca640 -1 init, newargv = 0x55995bcfd1c0 newargc=15 2023-07-21T19:07:58.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[40772]: starting ceph client 2023-07-21T19:07:58.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[40772]: starting fuse 2023-07-21T19:07:59.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:07:59.310 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:07:59.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:07:59.392 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:07:59.394 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:07:59.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:59.397 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:07:59.456 INFO:teuthology.orchestra.run.smithi123.stdout:48 2023-07-21T19:07:59.456 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2023-07-21T19:07:59.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T19:07:59.457 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2023-07-21T19:07:59.457 DEBUG:teuthology.orchestra.run.smithi123:> import re 2023-07-21T19:07:59.457 DEBUG:teuthology.orchestra.run.smithi123:> import os 2023-07-21T19:07:59.458 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2023-07-21T19:07:59.458 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:07:59.458 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2023-07-21T19:07:59.458 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-21T19:07:59.459 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2023-07-21T19:07:59.459 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-21T19:07:59.459 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:07:59.460 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2023-07-21T19:07:59.460 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2023-07-21T19:07:59.460 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2023-07-21T19:07:59.461 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2023-07-21T19:07:59.462 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:07:59.462 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2023-07-21T19:07:59.462 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T19:07:59.462 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T19:07:59.463 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T19:07:59.463 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2023-07-21T19:07:59.463 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2023-07-21T19:07:59.464 DEBUG:teuthology.orchestra.run.smithi123:> return f 2023-07-21T19:07:59.464 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T19:07:59.464 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:07:59.464 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.admin")) 2023-07-21T19:07:59.465 DEBUG:teuthology.orchestra.run.smithi123:> ' 2023-07-21T19:07:59.615 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.admin.40772.asok 2023-07-21T19:07:59.798 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.40772.asok 2023-07-21T19:07:59.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:07:59.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.40772.asok status 2023-07-21T19:07:59.988 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:07:59.989 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2023-07-21T19:07:59.989 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "81cf785aa7781c4e08381c540f890cb9bc987ef9", 2023-07-21T19:07:59.989 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev)", 2023-07-21T19:07:59.989 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "admin", 2023-07-21T19:07:59.989 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2023-07-21T19:07:59.989 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-21T19:07:59.990 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "40772", 2023-07-21T19:07:59.990 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2023-07-21T19:07:59.990 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:07:59.990 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2023-07-21T19:07:59.990 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2023-07-21T19:07:59.990 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4443, 2023-07-21T19:07:59.991 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2023-07-21T19:07:59.991 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2023-07-21T19:07:59.991 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2023-07-21T19:07:59.991 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4443 2023-07-21T19:07:59.991 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1804942277 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:07:59.992 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1804942277 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4443 192.168.0.1:0/1804942277", 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1804942277", 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2023-07-21T19:07:59.993 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 7, 2023-07-21T19:07:59.994 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 28, 2023-07-21T19:07:59.994 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2023-07-21T19:07:59.994 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2023-07-21T19:07:59.994 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2023-07-21T19:07:59.994 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:08:00.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:00.003 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2023-07-21T19:08:00.004 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:08:00.024 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2023-07-21T19:08:00.025 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:08:00.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:00.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:08:00.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:00.105 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-21T19:08:00.240 INFO:teuthology.orchestra.run.smithi123.stdout:# file: . 2023-07-21T19:08:00.241 INFO:teuthology.orchestra.run.smithi123.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-21T19:08:00.241 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:00.242 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:00.242 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:00.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:00.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.464+0000 7fb396c82700 1 Processor -- start 2023-07-21T19:08:00.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.464+0000 7fb396c82700 1 -- start start 2023-07-21T19:08:00.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb396c82700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb39006d860 0x7fb3900cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb396c82700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb3900c1e00 0x7fb3900cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb396c82700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3900cc1b0 con 0x7fb39006be70 2023-07-21T19:08:00.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb396c82700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900cd690 con 0x7fb39006d860 2023-07-21T19:08:00.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb396c82700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900cd970 con 0x7fb3900c1e00 2023-07-21T19:08:00.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb394a1e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb39006d860 0x7fb3900cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb38ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb39006be70 0x7fb39006dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50126/0 (socket says 172.21.15.123:50126) 2023-07-21T19:08:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb38ffff700 1 -- 172.21.15.123:0/1015872489 learned_addr learned my addr 172.21.15.123:0/1015872489 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb39521f700 1 --2- 172.21.15.123:0/1015872489 >> v2:172.21.15.145:3300/0 conn(0x7fb3900c1e00 0x7fb3900cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb394a1e700 1 -- 172.21.15.123:0/1015872489 >> v2:172.21.15.145:3300/0 conn(0x7fb3900c1e00 msgr2=0x7fb3900cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb394a1e700 1 --2- 172.21.15.123:0/1015872489 >> v2:172.21.15.145:3300/0 conn(0x7fb3900c1e00 0x7fb3900cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb394a1e700 1 -- 172.21.15.123:0/1015872489 >> v1:172.21.15.123:6789/0 conn(0x7fb39006be70 legacy=0x7fb39006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb394a1e700 1 -- 172.21.15.123:0/1015872489 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900cdc50 con 0x7fb39006d860 2023-07-21T19:08:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb394a1e700 1 --2- 172.21.15.123:0/1015872489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb39006d860 0x7fb3900cb840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb39006ba40 tx=0x7fb384009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c385c29e7744b65d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb38f7fe700 1 -- 172.21.15.123:0/1015872489 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384011830 con 0x7fb39006d860 2023-07-21T19:08:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb38f7fe700 1 -- 172.21.15.123:0/1015872489 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb384011990 con 0x7fb39006d860 2023-07-21T19:08:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.468+0000 7fb38f7fe700 1 -- 172.21.15.123:0/1015872489 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384011d40 con 0x7fb39006d860 2023-07-21T19:08:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 -- 172.21.15.123:0/1015872489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb39006d860 msgr2=0x7fb3900cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 --2- 172.21.15.123:0/1015872489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb39006d860 0x7fb3900cb840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb39006ba40 tx=0x7fb384009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 -- 172.21.15.123:0/1015872489 shutdown_connections 2023-07-21T19:08:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 --2- 172.21.15.123:0/1015872489 >> v2:172.21.15.145:3300/0 conn(0x7fb3900c1e00 0x7fb3900cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 --2- 172.21.15.123:0/1015872489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb39006d860 0x7fb3900cb840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 -- 172.21.15.123:0/1015872489 >> 172.21.15.123:0/1015872489 conn(0x7fb3900cad30 msgr2=0x7fb3900cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 -- 172.21.15.123:0/1015872489 shutdown_connections 2023-07-21T19:08:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 -- 172.21.15.123:0/1015872489 wait complete. 2023-07-21T19:08:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 Processor -- start 2023-07-21T19:08:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.472+0000 7fb396c82700 1 -- start start 2023-07-21T19:08:00.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb39006be70 0x7fb3901f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb39006d860 0x7fb39014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 0x7fb390158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c63d0 con 0x7fb3900c1e00 2023-07-21T19:08:00.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901f3420 con 0x7fb39006d860 2023-07-21T19:08:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c7650 con 0x7fb39006be70 2023-07-21T19:08:00.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 0x7fb390158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 0x7fb390158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43048/0 (socket says 172.21.15.123:43048) 2023-07-21T19:08:00.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 -- 172.21.15.123:0/151780062 learned_addr learned my addr 172.21.15.123:0/151780062 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:00.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb38ffff700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb39006d860 0x7fb39014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb394a1e700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb39006be70 0x7fb3901f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 -- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb39006be70 msgr2=0x7fb3901f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb39006be70 0x7fb3901f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 -- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb39006d860 msgr2=0x7fb39014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb39006d860 0x7fb39014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 -- 172.21.15.123:0/151780062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840094b0 con 0x7fb3900c1e00 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb39521f700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 0x7fb390158f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb388007e90 tx=0x7fb38800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:00.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800ede0 con 0x7fb3900c1e00 2023-07-21T19:08:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388014420 con 0x7fb3900c1e00 2023-07-21T19:08:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880147d0 con 0x7fb3900c1e00 2023-07-21T19:08:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3900c65b0 con 0x7fb3900c1e00 2023-07-21T19:08:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.476+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3900c6b70 con 0x7fb3900c1e00 2023-07-21T19:08:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.480+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39004dcb0 con 0x7fb3900c1e00 2023-07-21T19:08:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.480+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb388014930 con 0x7fb3900c1e00 2023-07-21T19:08:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.480+0000 7fb38d7fa700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3740662f0 0x7fb3740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.480+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb388084750 con 0x7fb3900c1e00 2023-07-21T19:08:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.484+0000 7fb394a1e700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3740662f0 0x7fb3740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.484+0000 7fb394a1e700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3740662f0 0x7fb3740687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3840090b0 tx=0x7fb384008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:00.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.488+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb3880518e0 con 0x7fb3900c1e00 2023-07-21T19:08:00.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.668+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3900b0c90 con 0x7fb3900c1e00 2023-07-21T19:08:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.668+0000 7fb38d7fa700 1 -- 172.21.15.123:0/151780062 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fb388054f00 con 0x7fb3900c1e00 2023-07-21T19:08:00.681 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:00.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3740662f0 msgr2=0x7fb3740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3740662f0 0x7fb3740687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3840090b0 tx=0x7fb384008030 comp rx=0 tx=0).stop 2023-07-21T19:08:00.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 msgr2=0x7fb390158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 0x7fb390158f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb388007e90 tx=0x7fb38800e3c0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 shutdown_connections 2023-07-21T19:08:00.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3740662f0 0x7fb3740687a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb39006d860 0x7fb39014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3900c1e00 0x7fb390158f10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 --2- 172.21.15.123:0/151780062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb39006be70 0x7fb3901f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 >> 172.21.15.123:0/151780062 conn(0x7fb3900cad30 msgr2=0x7fb3901574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 shutdown_connections 2023-07-21T19:08:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.672+0000 7fb396c82700 1 -- 172.21.15.123:0/151780062 wait complete. 2023-07-21T19:08:00.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:00.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.876+0000 7f39993c1700 1 Processor -- start 2023-07-21T19:08:00.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.876+0000 7f39993c1700 1 -- start start 2023-07-21T19:08:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39993c1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39940b0ee0 0x7f39940ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39993c1700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f39940cd090 0x7f39940d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39993c1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940cd4e0 con 0x7f39940d0610 2023-07-21T19:08:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39993c1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39940d1a60 con 0x7f39940b0ee0 2023-07-21T19:08:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39993c1700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39940d1ef0 con 0x7f39940cd090 2023-07-21T19:08:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39937fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f39940d0610 0x7f399415f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50130/0 (socket says 172.21.15.123:50130) 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3992ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39940b0ee0 0x7f39940ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39937fe700 1 -- 172.21.15.123:0/342089885 learned_addr learned my addr 172.21.15.123:0/342089885 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f39927fc700 1 --2- 172.21.15.123:0/342089885 >> v2:172.21.15.145:3300/0 conn(0x7f39940cd090 0x7f39940d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3991ffb700 1 -- 172.21.15.123:0/342089885 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269470722 0 0) 0x7f398c001490 con 0x7f39940d0610 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3991ffb700 1 -- 172.21.15.123:0/342089885 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c0035d0 con 0x7f39940d0610 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3992ffd700 1 -- 172.21.15.123:0/342089885 >> v2:172.21.15.145:3300/0 conn(0x7f39940cd090 msgr2=0x7f39940d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3992ffd700 1 --2- 172.21.15.123:0/342089885 >> v2:172.21.15.145:3300/0 conn(0x7f39940cd090 0x7f39940d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3992ffd700 1 -- 172.21.15.123:0/342089885 >> v1:172.21.15.123:6789/0 conn(0x7f39940d0610 legacy=0x7f399415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3992ffd700 1 -- 172.21.15.123:0/342089885 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940d0e50 con 0x7f39940b0ee0 2023-07-21T19:08:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.880+0000 7f3992ffd700 1 --2- 172.21.15.123:0/342089885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f39940ccb50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39940b5090 tx=0x7f3984009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523b3d66158c4c6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f3991ffb700 1 -- 172.21.15.123:0/342089885 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984011830 con 0x7f39940b0ee0 2023-07-21T19:08:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f3991ffb700 1 -- 172.21.15.123:0/342089885 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984011990 con 0x7f39940b0ee0 2023-07-21T19:08:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f3991ffb700 1 -- 172.21.15.123:0/342089885 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984011d20 con 0x7f39940b0ee0 2023-07-21T19:08:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 -- 172.21.15.123:0/342089885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 msgr2=0x7f39940ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 --2- 172.21.15.123:0/342089885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f39940ccb50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39940b5090 tx=0x7f3984009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 -- 172.21.15.123:0/342089885 shutdown_connections 2023-07-21T19:08:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 --2- 172.21.15.123:0/342089885 >> v2:172.21.15.145:3300/0 conn(0x7f39940cd090 0x7f39940d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 --2- 172.21.15.123:0/342089885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f39940ccb50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 -- 172.21.15.123:0/342089885 >> 172.21.15.123:0/342089885 conn(0x7f3994060c40 msgr2=0x7f399409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 -- 172.21.15.123:0/342089885 shutdown_connections 2023-07-21T19:08:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.884+0000 7f39993c1700 1 -- 172.21.15.123:0/342089885 wait complete. 2023-07-21T19:08:00.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 Processor -- start 2023-07-21T19:08:00.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 -- start start 2023-07-21T19:08:00.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f3994152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39940cd090 0x7f39940c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940d0610 0x7f39940cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940ca020 con 0x7f39940b0ee0 2023-07-21T19:08:00.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940ca300 con 0x7f39940d0610 2023-07-21T19:08:00.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.888+0000 7f39993c1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940ca5e0 con 0x7f39940cd090 2023-07-21T19:08:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f3994152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f3994152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43066/0 (socket says 172.21.15.123:43066) 2023-07-21T19:08:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 -- 172.21.15.123:0/566669877 learned_addr learned my addr 172.21.15.123:0/566669877 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f39937fe700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940d0610 0x7f39940cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f39927fc700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39940cd090 0x7f39940c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 -- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39940cd090 msgr2=0x7f39940c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39940cd090 0x7f39940c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 -- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940d0610 msgr2=0x7f39940cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940d0610 0x7f39940cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 -- 172.21.15.123:0/566669877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840094b0 con 0x7f39940b0ee0 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f39937fe700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940d0610 0x7f39940cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f3992ffd700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f3994152070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3984014040 tx=0x7f3984004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840036c0 con 0x7f39940b0ee0 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39940ca8c0 con 0x7f39940b0ee0 2023-07-21T19:08:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398401e070 con 0x7f39940b0ee0 2023-07-21T19:08:00.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984003a60 con 0x7f39940b0ee0 2023-07-21T19:08:00.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39940cb0c0 con 0x7f39940b0ee0 2023-07-21T19:08:00.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.892+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399404e500 con 0x7f39940b0ee0 2023-07-21T19:08:00.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.896+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3984003bc0 con 0x7f39940b0ee0 2023-07-21T19:08:00.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.896+0000 7f397b7fe700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39800662f0 0x7f39800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:00.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.900+0000 7f39927fc700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39800662f0 0x7f39800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:00.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.900+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3984085150 con 0x7f39940b0ee0 2023-07-21T19:08:00.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.900+0000 7f39927fc700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39800662f0 0x7f39800687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f399415f730 tx=0x7f3988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:00.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:00.904+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3984052250 con 0x7f39940b0ee0 2023-07-21T19:08:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.072+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f399406dff0 con 0x7f39940b0ee0 2023-07-21T19:08:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.072+0000 7f397b7fe700 1 -- 172.21.15.123:0/566669877 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3984055870 con 0x7f39940b0ee0 2023-07-21T19:08:01.086 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:01.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39800662f0 msgr2=0x7f39800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39800662f0 0x7f39800687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f399415f730 tx=0x7f3988008040 comp rx=0 tx=0).stop 2023-07-21T19:08:01.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 msgr2=0x7f3994152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f3994152070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3984014040 tx=0x7f3984004770 comp rx=0 tx=0).stop 2023-07-21T19:08:01.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 shutdown_connections 2023-07-21T19:08:01.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39800662f0 0x7f39800687a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940d0610 0x7f39940cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39940cd090 0x7f39940c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 --2- 172.21.15.123:0/566669877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39940b0ee0 0x7f3994152070 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 >> 172.21.15.123:0/566669877 conn(0x7f3994060c40 msgr2=0x7f39940ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:01.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 shutdown_connections 2023-07-21T19:08:01.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.076+0000 7f39993c1700 1 -- 172.21.15.123:0/566669877 wait complete. 2023-07-21T19:08:01.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.284+0000 7f8785689700 1 Processor -- start 2023-07-21T19:08:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.284+0000 7f8785689700 1 -- start start 2023-07-21T19:08:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f8785689700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015bd30 0x7f87800ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f8785689700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f878015c100 0x7f87800d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f8785689700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f87800b5430 0x7f87800b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f8785689700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8780070c80 con 0x7f878015c100 2023-07-21T19:08:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f8785689700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87800cd170 con 0x7f87800b5430 2023-07-21T19:08:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f8785689700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800cd3a0 con 0x7f878015bd30 2023-07-21T19:08:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f878015c100 0x7f87800d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877effd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015bd30 0x7f87800ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f878015c100 0x7f87800d1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43068/0 (socket says 172.21.15.123:43068) 2023-07-21T19:08:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 -- 172.21.15.123:0/1300231561 learned_addr learned my addr 172.21.15.123:0/1300231561 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877f7fe700 1 --2- 172.21.15.123:0/1300231561 >> v2:172.21.15.145:3300/0 conn(0x7f87800b5430 0x7f87800b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 -- 172.21.15.123:0/1300231561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015bd30 msgr2=0x7f87800ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 --2- 172.21.15.123:0/1300231561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015bd30 0x7f87800ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 -- 172.21.15.123:0/1300231561 >> v2:172.21.15.145:3300/0 conn(0x7f87800b5430 msgr2=0x7f87800b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 --2- 172.21.15.123:0/1300231561 >> v2:172.21.15.145:3300/0 conn(0x7f87800b5430 0x7f87800b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.288+0000 7f877e7fc700 1 -- 172.21.15.123:0/1300231561 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87800d0c60 con 0x7f878015c100 2023-07-21T19:08:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f877e7fc700 1 --2- 172.21.15.123:0/1300231561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015c100 0x7f87800d1a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f87800b1610 tx=0x7f8774009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ffef64617e00d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f877dffb700 1 -- 172.21.15.123:0/1300231561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774011830 con 0x7f878015c100 2023-07-21T19:08:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f877dffb700 1 -- 172.21.15.123:0/1300231561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774011990 con 0x7f878015c100 2023-07-21T19:08:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f877dffb700 1 -- 172.21.15.123:0/1300231561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774011d20 con 0x7f878015c100 2023-07-21T19:08:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 -- 172.21.15.123:0/1300231561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015c100 msgr2=0x7f87800d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 --2- 172.21.15.123:0/1300231561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015c100 0x7f87800d1a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f87800b1610 tx=0x7f8774009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 -- 172.21.15.123:0/1300231561 shutdown_connections 2023-07-21T19:08:01.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 --2- 172.21.15.123:0/1300231561 >> v2:172.21.15.145:3300/0 conn(0x7f87800b5430 0x7f87800b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 --2- 172.21.15.123:0/1300231561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015c100 0x7f87800d1a20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 --2- 172.21.15.123:0/1300231561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015bd30 0x7f87800ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 -- 172.21.15.123:0/1300231561 >> 172.21.15.123:0/1300231561 conn(0x7f878006fcf0 msgr2=0x7f87800700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:01.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 -- 172.21.15.123:0/1300231561 shutdown_connections 2023-07-21T19:08:01.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.292+0000 7f8785689700 1 -- 172.21.15.123:0/1300231561 wait complete. 2023-07-21T19:08:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 Processor -- start 2023-07-21T19:08:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 -- start start 2023-07-21T19:08:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87800b5430 0x7f87801f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 0x7f8780157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015c100 0x7f87800c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800c9ee0 con 0x7f878015bd30 2023-07-21T19:08:01.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800ca1c0 con 0x7f87800b5430 2023-07-21T19:08:01.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f8785689700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800ca4a0 con 0x7f878015c100 2023-07-21T19:08:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f877e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 0x7f8780157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f877e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 0x7f8780157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43078/0 (socket says 172.21.15.123:43078) 2023-07-21T19:08:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f877e7fc700 1 -- 172.21.15.123:0/2241809863 learned_addr learned my addr 172.21.15.123:0/2241809863 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f877effd700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87800b5430 0x7f87801f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.296+0000 7f877f7fe700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015c100 0x7f87800c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f877e7fc700 1 -- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015c100 msgr2=0x7f87800c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f877e7fc700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015c100 0x7f87800c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f877e7fc700 1 -- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87800b5430 msgr2=0x7f87801f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f877e7fc700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87800b5430 0x7f87801f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f877e7fc700 1 -- 172.21.15.123:0/2241809863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009570 con 0x7f878015bd30 2023-07-21T19:08:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f877e7fc700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 0x7f8780157c60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8774014040 tx=0x7f8774004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774004450 con 0x7f878015bd30 2023-07-21T19:08:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877401e070 con 0x7f878015bd30 2023-07-21T19:08:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774003900 con 0x7f878015bd30 2023-07-21T19:08:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87800ca780 con 0x7f878015bd30 2023-07-21T19:08:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87800c9bf0 con 0x7f878015bd30 2023-07-21T19:08:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.300+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87800caca0 con 0x7f878015bd30 2023-07-21T19:08:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.304+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8774003a60 con 0x7f878015bd30 2023-07-21T19:08:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.304+0000 7f87677fe700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f876c0662f0 0x7f876c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.304+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8774084a30 con 0x7f878015bd30 2023-07-21T19:08:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.304+0000 7f877effd700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f876c0662f0 0x7f876c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.304+0000 7f877effd700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f876c0662f0 0x7f876c0687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87700113e0 tx=0x7f877000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.312+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f87800caca0 con 0x7f878015bd30 2023-07-21T19:08:01.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.476+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87800caca0 con 0x7f878015bd30 2023-07-21T19:08:01.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.476+0000 7f87677fe700 1 -- 172.21.15.123:0/2241809863 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87800caca0 con 0x7f878015bd30 2023-07-21T19:08:01.490 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:01.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f876c0662f0 msgr2=0x7f876c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f876c0662f0 0x7f876c0687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87700113e0 tx=0x7f877000b040 comp rx=0 tx=0).stop 2023-07-21T19:08:01.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 msgr2=0x7f8780157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 0x7f8780157c60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8774014040 tx=0x7f8774004770 comp rx=0 tx=0).stop 2023-07-21T19:08:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 shutdown_connections 2023-07-21T19:08:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f876c0662f0 0x7f876c0687a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f878015c100 0x7f87800c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f878015bd30 0x7f8780157c60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 --2- 172.21.15.123:0/2241809863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87800b5430 0x7f87801f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 >> 172.21.15.123:0/2241809863 conn(0x7f878006fcf0 msgr2=0x7f87800cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 shutdown_connections 2023-07-21T19:08:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.480+0000 7f8785689700 1 -- 172.21.15.123:0/2241809863 wait complete. 2023-07-21T19:08:01.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.676+0000 7f7668278700 1 Processor -- start 2023-07-21T19:08:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.676+0000 7f7668278700 1 -- start start 2023-07-21T19:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7668278700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f766006c820 0x7f76600cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7668278700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76600cea60 0x7f76600b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7668278700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766015a170 con 0x7f7660159da0 2023-07-21T19:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7668278700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600ca920 con 0x7f76600cea60 2023-07-21T19:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7668278700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600cc0b0 con 0x7f766006c820 2023-07-21T19:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7666014700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f7660159da0 0x7f76600ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:33658/0 (socket says 172.21.15.123:33658) 2023-07-21T19:08:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7666014700 1 -- 172.21.15.123:0/4052751546 learned_addr learned my addr 172.21.15.123:0/4052751546 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7666815700 1 --2- 172.21.15.123:0/4052751546 >> v2:172.21.15.145:3300/0 conn(0x7f76600cea60 0x7f76600b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665813700 1 --2- 172.21.15.123:0/4052751546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f766006c820 0x7f76600cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665012700 1 -- 172.21.15.123:0/4052751546 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114043929 0 0) 0x7f766015a170 con 0x7f7660159da0 2023-07-21T19:08:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665012700 1 -- 172.21.15.123:0/4052751546 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f764c0035d0 con 0x7f7660159da0 2023-07-21T19:08:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665813700 1 -- 172.21.15.123:0/4052751546 >> v2:172.21.15.145:3300/0 conn(0x7f76600cea60 msgr2=0x7f76600b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665813700 1 --2- 172.21.15.123:0/4052751546 >> v2:172.21.15.145:3300/0 conn(0x7f76600cea60 0x7f76600b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665813700 1 -- 172.21.15.123:0/4052751546 >> v1:172.21.15.145:6789/0 conn(0x7f7660159da0 legacy=0x7f76600ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665813700 1 -- 172.21.15.123:0/4052751546 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600cc350 con 0x7f766006c820 2023-07-21T19:08:01.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.680+0000 7f7665813700 1 --2- 172.21.15.123:0/4052751546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f766006c820 0x7f76600cd3f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7650009850 tx=0x7f7650009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f05f468e4008ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:01.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7665012700 1 -- 172.21.15.123:0/4052751546 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011830 con 0x7f766006c820 2023-07-21T19:08:01.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7665012700 1 -- 172.21.15.123:0/4052751546 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650011990 con 0x7f766006c820 2023-07-21T19:08:01.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7665012700 1 -- 172.21.15.123:0/4052751546 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011d40 con 0x7f766006c820 2023-07-21T19:08:01.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 -- 172.21.15.123:0/4052751546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f766006c820 msgr2=0x7f76600cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 --2- 172.21.15.123:0/4052751546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f766006c820 0x7f76600cd3f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7650009850 tx=0x7f7650009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:01.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 -- 172.21.15.123:0/4052751546 shutdown_connections 2023-07-21T19:08:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 --2- 172.21.15.123:0/4052751546 >> v2:172.21.15.145:3300/0 conn(0x7f76600cea60 0x7f76600b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 --2- 172.21.15.123:0/4052751546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f766006c820 0x7f76600cd3f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 -- 172.21.15.123:0/4052751546 >> 172.21.15.123:0/4052751546 conn(0x7f7660060f70 msgr2=0x7f766006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 -- 172.21.15.123:0/4052751546 shutdown_connections 2023-07-21T19:08:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.684+0000 7f7668278700 1 -- 172.21.15.123:0/4052751546 wait complete. 2023-07-21T19:08:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 Processor -- start 2023-07-21T19:08:01.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 -- start start 2023-07-21T19:08:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 0x7f76601f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76600cea60 0x7f766014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7660159da0 0x7f76600b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766015b060 con 0x7f766006c820 2023-07-21T19:08:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601f59f0 con 0x7f7660159da0 2023-07-21T19:08:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.688+0000 7f7668278700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766015a170 con 0x7f76600cea60 2023-07-21T19:08:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7666014700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 0x7f76601f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76600cea60 0x7f766014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7666014700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 0x7f76601f54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43088/0 (socket says 172.21.15.123:43088) 2023-07-21T19:08:01.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7666014700 1 -- 172.21.15.123:0/3623043293 learned_addr learned my addr 172.21.15.123:0/3623043293 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:01.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7666815700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7660159da0 0x7f76600b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 -- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7660159da0 msgr2=0x7f76600b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7660159da0 0x7f76600b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 -- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 msgr2=0x7f76601f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 0x7f76601f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 -- 172.21.15.123:0/3623043293 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094b0 con 0x7f76600cea60 2023-07-21T19:08:01.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7666014700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 0x7f76601f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:01.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7665813700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76600cea60 0x7f766014b220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7650016000 tx=0x7f7650004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:01.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650004590 con 0x7f76600cea60 2023-07-21T19:08:01.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500036c0 con 0x7f76600cea60 2023-07-21T19:08:01.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650003a70 con 0x7f76600cea60 2023-07-21T19:08:01.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766015a450 con 0x7f76600cea60 2023-07-21T19:08:01.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.692+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766015aa10 con 0x7f76600cea60 2023-07-21T19:08:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.696+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766015b1d0 con 0x7f76600cea60 2023-07-21T19:08:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.696+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7650003bd0 con 0x7f76600cea60 2023-07-21T19:08:01.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.700+0000 7f7656ffd700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7644066370 0x7f7644068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:01.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.700+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7650021030 con 0x7f76600cea60 2023-07-21T19:08:01.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.700+0000 7f7666014700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7644066370 0x7f7644068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:01.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.700+0000 7f7666014700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7644066370 0x7f7644068820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f765c0011e0 tx=0x7f765c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:01.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.708+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7650052670 con 0x7f76600cea60 2023-07-21T19:08:01.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.884+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f766004dcb0 con 0x7f76600cea60 2023-07-21T19:08:01.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.888+0000 7f7656ffd700 1 -- 172.21.15.123:0/3623043293 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7650055c90 con 0x7f76600cea60 2023-07-21T19:08:01.899 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:01.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7644066370 msgr2=0x7f7644068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7644066370 0x7f7644068820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f765c0011e0 tx=0x7f765c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76600cea60 msgr2=0x7f766014b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76600cea60 0x7f766014b220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7650016000 tx=0x7f7650004770 comp rx=0 tx=0).stop 2023-07-21T19:08:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 shutdown_connections 2023-07-21T19:08:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7644066370 0x7f7644068820 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7660159da0 0x7f76600b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76600cea60 0x7f766014b220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 --2- 172.21.15.123:0/3623043293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766006c820 0x7f76601f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 >> 172.21.15.123:0/3623043293 conn(0x7f7660060f70 msgr2=0x7f76600d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 shutdown_connections 2023-07-21T19:08:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:01.892+0000 7f7668278700 1 -- 172.21.15.123:0/3623043293 wait complete. 2023-07-21T19:08:01.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.088+0000 7f49a2f81700 1 Processor -- start 2023-07-21T19:08:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.088+0000 7f49a2f81700 1 -- start start 2023-07-21T19:08:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.092+0000 7f49a2f81700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 0x7f499c0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.092+0000 7f49a2f81700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c1608f0 con 0x7f499c15c190 2023-07-21T19:08:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.092+0000 7f49a2f81700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c06df00 con 0x7f499c0cace0 2023-07-21T19:08:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.092+0000 7f49a2f81700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c06d380 con 0x7f499c15bdc0 2023-07-21T19:08:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49a0d1d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 0x7f499c0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f499c15c190 0x7f499c15fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50146/0 (socket says 172.21.15.123:50146) 2023-07-21T19:08:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 -- 172.21.15.123:0/401284875 learned_addr learned my addr 172.21.15.123:0/401284875 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579662557 0 0) 0x7f499c1608f0 con 0x7f499c15c190 2023-07-21T19:08:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49840035d0 con 0x7f499c15c190 2023-07-21T19:08:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875369834 0 0) 0x7f49840035d0 con 0x7f499c15c190 2023-07-21T19:08:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 msgr2=0x7f499c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 0x7f499c0ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 >> v1:172.21.15.145:6789/0 conn(0x7f499c0cace0 legacy=0x7f499c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c06d660 con 0x7f499c15c190 2023-07-21T19:08:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f4998001670 con 0x7f499c15c190 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 >> v1:172.21.15.123:6789/0 conn(0x7f499c15c190 legacy=0x7f499c15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 0x7f4984003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4984003fd0 0x7f4984004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4984004db0 0x7f4984005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c06d380 con 0x7f4984003fd0 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498400bb10 con 0x7f4984004db0 2023-07-21T19:08:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498400bcd0 con 0x7f499c15bdc0 2023-07-21T19:08:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4984003fd0 0x7f4984004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49a0d1d700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 0x7f4984003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49a151e700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4984004db0 0x7f4984005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 -- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 msgr2=0x7f4984003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f499c15bdc0 0x7f4984003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 -- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4984004db0 msgr2=0x7f4984005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:02.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4984004db0 0x7f4984005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 -- 172.21.15.123:0/401284875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840035d0 con 0x7f4984003fd0 2023-07-21T19:08:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f4993fff700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4984003fd0 0x7f4984004870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f499c15c5a0 tx=0x7f49840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bf0e7dbba82172 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998007c30 con 0x7f4984003fd0 2023-07-21T19:08:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499800ce00 con 0x7f4984003fd0 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.096+0000 7f49937fe700 1 -- 172.21.15.123:0/401284875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998005bc0 con 0x7f4984003fd0 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 -- 172.21.15.123:0/401284875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4984003fd0 msgr2=0x7f4984004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 --2- 172.21.15.123:0/401284875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4984003fd0 0x7f4984004870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f499c15c5a0 tx=0x7f49840058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a151e700 1 -- 172.21.15.123:0/401284875 reap_dead start 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 -- 172.21.15.123:0/401284875 shutdown_connections 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 -- 172.21.15.123:0/401284875 >> 172.21.15.123:0/401284875 conn(0x7f499c0cca60 msgr2=0x7f499c0cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 -- 172.21.15.123:0/401284875 shutdown_connections 2023-07-21T19:08:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 -- 172.21.15.123:0/401284875 wait complete. 2023-07-21T19:08:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 Processor -- start 2023-07-21T19:08:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.100+0000 7f49a2f81700 1 -- start start 2023-07-21T19:08:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4984003fd0 0x7f499c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f499c0b4eb0 0x7f499c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 0x7f499c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b44e0 con 0x7f499c1554e0 2023-07-21T19:08:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b38d0 con 0x7f499c0b4eb0 2023-07-21T19:08:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b3bb0 con 0x7f4984003fd0 2023-07-21T19:08:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 0x7f499c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 0x7f499c0c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43112/0 (socket says 172.21.15.123:43112) 2023-07-21T19:08:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 -- 172.21.15.123:0/3196190164 learned_addr learned my addr 172.21.15.123:0/3196190164 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 -- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4984003fd0 msgr2=0x7f499c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a0d1d700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4984003fd0 0x7f499c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4984003fd0 0x7f499c0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 -- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f499c0b4eb0 msgr2=0x7f499c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f499c0b4eb0 0x7f499c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 -- 172.21.15.123:0/3196190164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0b3e90 con 0x7f499c1554e0 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a151e700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 0x7f499c0c4370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f499c067320 tx=0x7f499400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994001dd0 con 0x7f499c1554e0 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994003c30 con 0x7f499c1554e0 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c0b4170 con 0x7f499c1554e0 2023-07-21T19:08:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499400d990 con 0x7f499c1554e0 2023-07-21T19:08:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c06a5a0 con 0x7f499c1554e0 2023-07-21T19:08:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.104+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c0b4650 con 0x7f499c1554e0 2023-07-21T19:08:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.108+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f499400daf0 con 0x7f499c1554e0 2023-07-21T19:08:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.108+0000 7f49917fa700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4988066320 0x7f49880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.108+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f49940843e0 con 0x7f499c1554e0 2023-07-21T19:08:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.108+0000 7f49a0d1d700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4988066320 0x7f49880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.108+0000 7f49a0d1d700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4988066320 0x7f49880687d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f498c009ab0 tx=0x7f498c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.112+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4994054ed0 con 0x7f499c1554e0 2023-07-21T19:08:02.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.292+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f499c06dbf0 con 0x7f499c1554e0 2023-07-21T19:08:02.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.292+0000 7f49917fa700 1 -- 172.21.15.123:0/3196190164 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4994054a60 con 0x7f499c1554e0 2023-07-21T19:08:02.305 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4988066320 msgr2=0x7f49880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4988066320 0x7f49880687d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f498c009ab0 tx=0x7f498c008040 comp rx=0 tx=0).stop 2023-07-21T19:08:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 msgr2=0x7f499c0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 0x7f499c0c4370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f499c067320 tx=0x7f499400d430 comp rx=0 tx=0).stop 2023-07-21T19:08:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 shutdown_connections 2023-07-21T19:08:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4988066320 0x7f49880687d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f499c0b4eb0 0x7f499c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f499c1554e0 0x7f499c0c4370 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 --2- 172.21.15.123:0/3196190164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4984003fd0 0x7f499c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 >> 172.21.15.123:0/3196190164 conn(0x7f499c0cca60 msgr2=0x7f499c0ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 shutdown_connections 2023-07-21T19:08:02.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.296+0000 7f49a2f81700 1 -- 172.21.15.123:0/3196190164 wait complete. 2023-07-21T19:08:02.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.492+0000 7f2d31f13700 1 Processor -- start 2023-07-21T19:08:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.492+0000 7f2d31f13700 1 -- start start 2023-07-21T19:08:02.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d31f13700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2d2c0b0490 0x7f2d2c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d31f13700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160610 0x7f2d2c0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d31f13700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c163fe0 con 0x7f2d2c160240 2023-07-21T19:08:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d31f13700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c0c8c30 con 0x7f2d2c0b0490 2023-07-21T19:08:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d31f13700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0ca9e0 con 0x7f2d2c160610 2023-07-21T19:08:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2d2c160240 0x7f2d2c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37970/0 (socket says 172.21.15.123:37970) 2023-07-21T19:08:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2b7fe700 1 -- 172.21.15.123:0/228849720 learned_addr learned my addr 172.21.15.123:0/228849720 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2bfff700 1 --2- 172.21.15.123:0/228849720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160610 0x7f2d2c0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2affd700 1 --2- 172.21.15.123:0/228849720 >> v2:172.21.15.145:3300/0 conn(0x7f2d2c0b0490 0x7f2d2c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2a7fc700 1 -- 172.21.15.123:0/228849720 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237236104 0 0) 0x7f2d2c163fe0 con 0x7f2d2c160240 2023-07-21T19:08:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2a7fc700 1 -- 172.21.15.123:0/228849720 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d140035d0 con 0x7f2d2c160240 2023-07-21T19:08:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2bfff700 1 -- 172.21.15.123:0/228849720 >> v2:172.21.15.145:3300/0 conn(0x7f2d2c0b0490 msgr2=0x7f2d2c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2bfff700 1 --2- 172.21.15.123:0/228849720 >> v2:172.21.15.145:3300/0 conn(0x7f2d2c0b0490 0x7f2d2c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2bfff700 1 -- 172.21.15.123:0/228849720 >> v1:172.21.15.123:6789/0 conn(0x7f2d2c160240 legacy=0x7f2d2c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2bfff700 1 -- 172.21.15.123:0/228849720 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c164230 con 0x7f2d2c160610 2023-07-21T19:08:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.496+0000 7f2d2bfff700 1 --2- 172.21.15.123:0/228849720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160610 0x7f2d2c0ca320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009d90 tx=0x7f2d2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6033424f89c18467 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d2a7fc700 1 -- 172.21.15.123:0/228849720 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400e070 con 0x7f2d2c160610 2023-07-21T19:08:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d2a7fc700 1 -- 172.21.15.123:0/228849720 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400bb20 con 0x7f2d2c160610 2023-07-21T19:08:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d2a7fc700 1 -- 172.21.15.123:0/228849720 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24012430 con 0x7f2d2c160610 2023-07-21T19:08:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 -- 172.21.15.123:0/228849720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160610 msgr2=0x7f2d2c0ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 --2- 172.21.15.123:0/228849720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160610 0x7f2d2c0ca320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009d90 tx=0x7f2d2400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 -- 172.21.15.123:0/228849720 shutdown_connections 2023-07-21T19:08:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 --2- 172.21.15.123:0/228849720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160610 0x7f2d2c0ca320 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 --2- 172.21.15.123:0/228849720 >> v2:172.21.15.145:3300/0 conn(0x7f2d2c0b0490 0x7f2d2c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 -- 172.21.15.123:0/228849720 >> 172.21.15.123:0/228849720 conn(0x7f2d2c0cad80 msgr2=0x7f2d2c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:02.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 -- 172.21.15.123:0/228849720 shutdown_connections 2023-07-21T19:08:02.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.500+0000 7f2d31f13700 1 -- 172.21.15.123:0/228849720 wait complete. 2023-07-21T19:08:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.504+0000 7f2d31f13700 1 Processor -- start 2023-07-21T19:08:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.504+0000 7f2d31f13700 1 -- start start 2023-07-21T19:08:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 0x7f2d2c0c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160240 0x7f2d2c14c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2c160610 0x7f2d2c161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0c6420 con 0x7f2d2c0b0490 2023-07-21T19:08:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0c6700 con 0x7f2d2c160610 2023-07-21T19:08:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0c69e0 con 0x7f2d2c160240 2023-07-21T19:08:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 0x7f2d2c0c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 0x7f2d2c0c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58576/0 (socket says 172.21.15.123:58576) 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 -- 172.21.15.123:0/3515036736 learned_addr learned my addr 172.21.15.123:0/3515036736 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2affd700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160240 0x7f2d2c14c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2bfff700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2c160610 0x7f2d2c161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 -- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160240 msgr2=0x7f2d2c14c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160240 0x7f2d2c14c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 -- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2c160610 msgr2=0x7f2d2c161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2c160610 0x7f2d2c161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 -- 172.21.15.123:0/3515036736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009a70 con 0x7f2d2c0b0490 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d2b7fe700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 0x7f2d2c0c77a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c700 tx=0x7f2d1c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c005d90 con 0x7f2d2c0b0490 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0070d0 con 0x7f2d2c0b0490 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c007480 con 0x7f2d2c0b0490 2023-07-21T19:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c0c6cc0 con 0x7f2d2c0b0490 2023-07-21T19:08:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.508+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c0c7280 con 0x7f2d2c0b0490 2023-07-21T19:08:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.512+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c04dcb0 con 0x7f2d2c0b0490 2023-07-21T19:08:02.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.512+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d1c0075e0 con 0x7f2d2c0b0490 2023-07-21T19:08:02.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.512+0000 7f2d13fff700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2d180662f0 0x7f2d180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.516+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d1c083790 con 0x7f2d2c0b0490 2023-07-21T19:08:02.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.516+0000 7f2d2affd700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2d180662f0 0x7f2d180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.516+0000 7f2d2affd700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2d180662f0 0x7f2d180687a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c15ec90 tx=0x7f2d20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.520+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2d1c050800 con 0x7f2d2c0b0490 2023-07-21T19:08:02.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.696+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d2c0b0bc0 con 0x7f2d2c0b0490 2023-07-21T19:08:02.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.696+0000 7f2d13fff700 1 -- 172.21.15.123:0/3515036736 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d1c053e20 con 0x7f2d2c0b0490 2023-07-21T19:08:02.710 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:02.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2d180662f0 msgr2=0x7f2d180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2d180662f0 0x7f2d180687a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c15ec90 tx=0x7f2d20008040 comp rx=0 tx=0).stop 2023-07-21T19:08:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 msgr2=0x7f2d2c0c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 0x7f2d2c0c77a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c700 tx=0x7f2d1c00cac0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 shutdown_connections 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2d180662f0 0x7f2d180687a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2c160610 0x7f2d2c161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d2c160240 0x7f2d2c14c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 --2- 172.21.15.123:0/3515036736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2c0b0490 0x7f2d2c0c77a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 >> 172.21.15.123:0/3515036736 conn(0x7f2d2c0cad80 msgr2=0x7f2d2c0afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 shutdown_connections 2023-07-21T19:08:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.700+0000 7f2d31f13700 1 -- 172.21.15.123:0/3515036736 wait complete. 2023-07-21T19:08:02.734 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:08:02.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.896+0000 7fc6f4b6b700 1 Processor -- start 2023-07-21T19:08:02.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.896+0000 7fc6f4b6b700 1 -- start start 2023-07-21T19:08:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6f4b6b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 0x7fc6f00ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6f4b6b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 0x7fc6f00ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6f4b6b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f00cd4c0 con 0x7fc6f00ceff0 2023-07-21T19:08:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6f4b6b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00af0a0 con 0x7fc6f00cd070 2023-07-21T19:08:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6f4b6b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00cf470 con 0x7fc6f015bff0 2023-07-21T19:08:02.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6eeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 0x7fc6f00ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 0x7fc6f00ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 0x7fc6f00ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46584/0 (socket says 172.21.15.123:46584) 2023-07-21T19:08:02.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6eeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 0x7fc6f00ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58592/0 (socket says 172.21.15.123:58592) 2023-07-21T19:08:02.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/145878502 learned_addr learned my addr 172.21.15.123:0/145878502 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:02.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/145878502 >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 msgr2=0x7fc6f00ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:02.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 --2- 172.21.15.123:0/145878502 >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 0x7fc6f00ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/145878502 >> v1:172.21.15.145:6789/0 conn(0x7fc6f00ceff0 legacy=0x7fc6f00d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/145878502 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00cf720 con 0x7fc6f015bff0 2023-07-21T19:08:02.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6eeffd700 1 --2- 172.21.15.123:0/145878502 >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 0x7fc6f00ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:02.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ef7fe700 1 --2- 172.21.15.123:0/145878502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 0x7fc6f00ccb30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009910 tx=0x7fc6e0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9f516ceaba1ba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ee7fc700 1 -- 172.21.15.123:0/145878502 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0011830 con 0x7fc6f015bff0 2023-07-21T19:08:02.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ee7fc700 1 -- 172.21.15.123:0/145878502 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0011990 con 0x7fc6f015bff0 2023-07-21T19:08:02.916 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.900+0000 7fc6ee7fc700 1 -- 172.21.15.123:0/145878502 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0011d40 con 0x7fc6f015bff0 2023-07-21T19:08:02.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/145878502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 msgr2=0x7fc6f00ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/145878502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 0x7fc6f00ccb30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009910 tx=0x7fc6e0009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:02.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/145878502 shutdown_connections 2023-07-21T19:08:02.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/145878502 >> v2:172.21.15.123:3300/0 conn(0x7fc6f00cd070 0x7fc6f00ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/145878502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f015bff0 0x7fc6f00ccb30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/145878502 >> 172.21.15.123:0/145878502 conn(0x7fc6f0060c40 msgr2=0x7fc6f009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:02.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/145878502 shutdown_connections 2023-07-21T19:08:02.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.904+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/145878502 wait complete. 2023-07-21T19:08:02.920 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 Processor -- start 2023-07-21T19:08:02.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 -- start start 2023-07-21T19:08:02.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f00cd070 0x7fc6f00b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6f00ceff0 0x7fc6f00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f015bff0 0x7fc6f00d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f014b0f0 con 0x7fc6f015bff0 2023-07-21T19:08:02.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f014a4e0 con 0x7fc6f00ceff0 2023-07-21T19:08:02.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6f4b6b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f014a7c0 con 0x7fc6f00cd070 2023-07-21T19:08:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f015bff0 0x7fc6f00d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6ef7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f00cd070 0x7fc6f00b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f015bff0 0x7fc6f00d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58604/0 (socket says 172.21.15.123:58604) 2023-07-21T19:08:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6effff700 1 -- 172.21.15.123:0/200767244 learned_addr learned my addr 172.21.15.123:0/200767244 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:02.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6eeffd700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6f00ceff0 0x7fc6f00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6f00ceff0 msgr2=0x7fc6f00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6ef7fe700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6f00ceff0 0x7fc6f00d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f015bff0 msgr2=0x7fc6f00d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:02.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.908+0000 7fc6ef7fe700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f015bff0 0x7fc6f00d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:02.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6ef7fe700 1 -- 172.21.15.123:0/200767244 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e40094b0 con 0x7fc6f00cd070 2023-07-21T19:08:02.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6ef7fe700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f00cd070 0x7fc6f00b3f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0016000 tx=0x7fc6e0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004250 con 0x7fc6f00cd070 2023-07-21T19:08:02.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e001f070 con 0x7fc6f00cd070 2023-07-21T19:08:02.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00045d0 con 0x7fc6f00cd070 2023-07-21T19:08:02.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0009570 con 0x7fc6f00cd070 2023-07-21T19:08:02.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f014ad80 con 0x7fc6f00cd070 2023-07-21T19:08:02.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.912+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f004e500 con 0x7fc6f00cd070 2023-07-21T19:08:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.916+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6e0021030 con 0x7fc6f00cd070 2023-07-21T19:08:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.916+0000 7fc6d7fff700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6dc0663c0 0x7fc6dc068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.916+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc6e0085190 con 0x7fc6f00cd070 2023-07-21T19:08:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.916+0000 7fc6eeffd700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6dc0663c0 0x7fc6dc068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.916+0000 7fc6eeffd700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6dc0663c0 0x7fc6dc068870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00b07a0 tx=0x7fc6e4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:02.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:02.924+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc6e00524b0 con 0x7fc6f00cd070 2023-07-21T19:08:03.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.112+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6f006ebd0 con 0x7fc6f00cd070 2023-07-21T19:08:03.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.112+0000 7fc6d7fff700 1 -- 172.21.15.123:0/200767244 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6e0055ad0 con 0x7fc6f00cd070 2023-07-21T19:08:03.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6dc0663c0 msgr2=0x7fc6dc068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6dc0663c0 0x7fc6dc068870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00b07a0 tx=0x7fc6e4009240 comp rx=0 tx=0).stop 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f00cd070 msgr2=0x7fc6f00b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f00cd070 0x7fc6f00b3f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0016000 tx=0x7fc6e0004770 comp rx=0 tx=0).stop 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 shutdown_connections 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6dc0663c0 0x7fc6dc068870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6f00ceff0 0x7fc6f00d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f015bff0 0x7fc6f00d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 --2- 172.21.15.123:0/200767244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6f00cd070 0x7fc6f00b3f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 >> 172.21.15.123:0/200767244 conn(0x7fc6f0060c40 msgr2=0x7fc6f00711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:03.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 shutdown_connections 2023-07-21T19:08:03.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.116+0000 7fc6f4b6b700 1 -- 172.21.15.123:0/200767244 wait complete. 2023-07-21T19:08:03.131 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:08:03.151 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:03.152 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:03.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:03.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.368+0000 7f35ff0e7700 1 Processor -- start 2023-07-21T19:08:03.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.368+0000 7f35ff0e7700 1 -- start start 2023-07-21T19:08:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ff0e7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f35f806d860 0x7f35f80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ff0e7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f80c1e00 0x7f35f80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ff0e7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f80cc1b0 con 0x7f35f806be70 2023-07-21T19:08:03.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ff0e7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80cd690 con 0x7f35f806d860 2023-07-21T19:08:03.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ff0e7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80cd970 con 0x7f35f80c1e00 2023-07-21T19:08:03.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fce83700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f35f806d860 0x7f35f80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35effff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f35f806be70 0x7f35f806dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37972/0 (socket says 172.21.15.123:37972) 2023-07-21T19:08:03.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35effff700 1 -- 172.21.15.123:0/1869902158 learned_addr learned my addr 172.21.15.123:0/1869902158 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:03.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fd684700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f80c1e00 0x7f35f80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fce83700 1 -- 172.21.15.123:0/1869902158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f80c1e00 msgr2=0x7f35f80cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:03.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fce83700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f80c1e00 0x7f35f80cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fce83700 1 -- 172.21.15.123:0/1869902158 >> v1:172.21.15.123:6789/0 conn(0x7f35f806be70 legacy=0x7f35f806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fce83700 1 -- 172.21.15.123:0/1869902158 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80cdc50 con 0x7f35f806d860 2023-07-21T19:08:03.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fd684700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f80c1e00 0x7f35f80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:03.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35fce83700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806d860 0x7f35f80cb840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009850 tx=0x7f35f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a94ef9ee5ae0b11 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ef7fe700 1 -- 172.21.15.123:0/1869902158 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011830 con 0x7f35f806d860 2023-07-21T19:08:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ef7fe700 1 -- 172.21.15.123:0/1869902158 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4011990 con 0x7f35f806d860 2023-07-21T19:08:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.372+0000 7f35ef7fe700 1 -- 172.21.15.123:0/1869902158 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011d20 con 0x7f35f806d860 2023-07-21T19:08:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 -- 172.21.15.123:0/1869902158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806d860 msgr2=0x7f35f80cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806d860 0x7f35f80cb840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009850 tx=0x7f35f4009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 -- 172.21.15.123:0/1869902158 shutdown_connections 2023-07-21T19:08:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f80c1e00 0x7f35f80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/1869902158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806d860 0x7f35f80cb840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 -- 172.21.15.123:0/1869902158 >> 172.21.15.123:0/1869902158 conn(0x7f35f80cad30 msgr2=0x7f35f80cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 -- 172.21.15.123:0/1869902158 shutdown_connections 2023-07-21T19:08:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 -- 172.21.15.123:0/1869902158 wait complete. 2023-07-21T19:08:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.376+0000 7f35ff0e7700 1 Processor -- start 2023-07-21T19:08:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 -- start start 2023-07-21T19:08:03.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 0x7f35f81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806d860 0x7f35f81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f80c1e00 0x7f35f8155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81f3740 con 0x7f35f806be70 2023-07-21T19:08:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81f2980 con 0x7f35f80c1e00 2023-07-21T19:08:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81f2c60 con 0x7f35f806d860 2023-07-21T19:08:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 0x7f35f81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 0x7f35f81549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58614/0 (socket says 172.21.15.123:58614) 2023-07-21T19:08:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 -- 172.21.15.123:0/2174809757 learned_addr learned my addr 172.21.15.123:0/2174809757 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fd684700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f80c1e00 0x7f35f8155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35effff700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806d860 0x7f35f81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 -- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806d860 msgr2=0x7f35f81551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806d860 0x7f35f81551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 -- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f80c1e00 msgr2=0x7f35f8155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f80c1e00 0x7f35f8155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 -- 172.21.15.123:0/2174809757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40094b0 con 0x7f35f806be70 2023-07-21T19:08:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35effff700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806d860 0x7f35f81551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35fce83700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 0x7f35f81549d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35f80700e0 tx=0x7f35f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f40036c0 con 0x7f35f806be70 2023-07-21T19:08:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f401f070 con 0x7f35f806be70 2023-07-21T19:08:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f81f2f40 con 0x7f35f806be70 2023-07-21T19:08:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.380+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4003a60 con 0x7f35f806be70 2023-07-21T19:08:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.384+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f81f0170 con 0x7f35f806be70 2023-07-21T19:08:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.384+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f81f3460 con 0x7f35f806be70 2023-07-21T19:08:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.384+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35f4003bc0 con 0x7f35f806be70 2023-07-21T19:08:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.388+0000 7f35ed7fa700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35e40662f0 0x7f35e40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.388+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f35f4021070 con 0x7f35f806be70 2023-07-21T19:08:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.388+0000 7f35effff700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35e40662f0 0x7f35e40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.388+0000 7f35effff700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35e40662f0 0x7f35e40687a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35f80c8320 tx=0x7f35e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:03.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.392+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f35f81f3460 con 0x7f35f806be70 2023-07-21T19:08:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.568+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f81f3460 con 0x7f35f806be70 2023-07-21T19:08:03.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.572+0000 7f35ed7fa700 1 -- 172.21.15.123:0/2174809757 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f35f81f3460 con 0x7f35f806be70 2023-07-21T19:08:03.586 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:03.587 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:03.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35e40662f0 msgr2=0x7f35e40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35e40662f0 0x7f35e40687a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35f80c8320 tx=0x7f35e8009040 comp rx=0 tx=0).stop 2023-07-21T19:08:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 msgr2=0x7f35f81549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 0x7f35f81549d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35f80700e0 tx=0x7f35f4004770 comp rx=0 tx=0).stop 2023-07-21T19:08:03.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 shutdown_connections 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35e40662f0 0x7f35e40687a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f80c1e00 0x7f35f8155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806d860 0x7f35f81551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 --2- 172.21.15.123:0/2174809757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f806be70 0x7f35f81549d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 >> 172.21.15.123:0/2174809757 conn(0x7f35f80cad30 msgr2=0x7f35f80c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 shutdown_connections 2023-07-21T19:08:03.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.576+0000 7f35ff0e7700 1 -- 172.21.15.123:0/2174809757 wait complete. 2023-07-21T19:08:03.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:03.614 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:03.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.780+0000 7fd40494a700 1 Processor -- start 2023-07-21T19:08:03.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.780+0000 7fd40494a700 1 -- start start 2023-07-21T19:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000b0ee0 0x7fd4000ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4000cd090 0x7fd4000d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000cd4e0 con 0x7fd4000d0610 2023-07-21T19:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000d1a60 con 0x7fd4000cd090 2023-07-21T19:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000d1ef0 con 0x7fd4000b0ee0 2023-07-21T19:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3ff7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000b0ee0 0x7fd4000ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3fffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd4000d0610 0x7fd40015f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37986/0 (socket says 172.21.15.123:37986) 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3fffff700 1 -- 172.21.15.123:0/4111716930 learned_addr learned my addr 172.21.15.123:0/4111716930 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3feffd700 1 --2- 172.21.15.123:0/4111716930 >> v2:172.21.15.123:3300/0 conn(0x7fd4000cd090 0x7fd4000d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3feffd700 1 -- 172.21.15.123:0/4111716930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000b0ee0 msgr2=0x7fd4000ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3feffd700 1 --2- 172.21.15.123:0/4111716930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000b0ee0 0x7fd4000ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3feffd700 1 -- 172.21.15.123:0/4111716930 >> v1:172.21.15.123:6789/0 conn(0x7fd4000d0610 legacy=0x7fd40015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3feffd700 1 -- 172.21.15.123:0/4111716930 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000d0e50 con 0x7fd4000cd090 2023-07-21T19:08:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3fe7fc700 1 -- 172.21.15.123:0/4111716930 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208017712 0 0) 0x7fd3f8001490 con 0x7fd4000d0610 2023-07-21T19:08:03.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3feffd700 1 --2- 172.21.15.123:0/4111716930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000cd090 0x7fd4000d00d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009880 tx=0x7fd3f4009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98e55f4f9240358 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:03.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3fe7fc700 1 -- 172.21.15.123:0/4111716930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4011830 con 0x7fd4000cd090 2023-07-21T19:08:03.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3fe7fc700 1 -- 172.21.15.123:0/4111716930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f4011990 con 0x7fd4000cd090 2023-07-21T19:08:03.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd3fe7fc700 1 -- 172.21.15.123:0/4111716930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4011d20 con 0x7fd4000cd090 2023-07-21T19:08:03.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 -- 172.21.15.123:0/4111716930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000cd090 msgr2=0x7fd4000d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.784+0000 7fd40494a700 1 --2- 172.21.15.123:0/4111716930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000cd090 0x7fd4000d00d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009880 tx=0x7fd3f4009b90 comp rx=0 tx=0).stop 2023-07-21T19:08:03.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- 172.21.15.123:0/4111716930 shutdown_connections 2023-07-21T19:08:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 --2- 172.21.15.123:0/4111716930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000cd090 0x7fd4000d00d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 --2- 172.21.15.123:0/4111716930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000b0ee0 0x7fd4000ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- 172.21.15.123:0/4111716930 >> 172.21.15.123:0/4111716930 conn(0x7fd400060c40 msgr2=0x7fd40009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- 172.21.15.123:0/4111716930 shutdown_connections 2023-07-21T19:08:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- 172.21.15.123:0/4111716930 wait complete. 2023-07-21T19:08:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 Processor -- start 2023-07-21T19:08:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- start start 2023-07-21T19:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4000b0ee0 0x7fd4001590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000cd090 0x7fd4000cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 0x7fd4000cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd400159620 con 0x7fd4000d0610 2023-07-21T19:08:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b30b0 con 0x7fd4000b0ee0 2023-07-21T19:08:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.788+0000 7fd40494a700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b3350 con 0x7fd4000cd090 2023-07-21T19:08:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 0x7fd4000cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 0x7fd4000cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58640/0 (socket says 172.21.15.123:58640) 2023-07-21T19:08:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 -- 172.21.15.123:0/3532614036 learned_addr learned my addr 172.21.15.123:0/3532614036 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3feffd700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000cd090 0x7fd4000cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3ff7fe700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4000b0ee0 0x7fd4001590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 -- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000cd090 msgr2=0x7fd4000cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000cd090 0x7fd4000cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 -- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4000b0ee0 msgr2=0x7fd4001590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4000b0ee0 0x7fd4001590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 -- 172.21.15.123:0/3532614036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40094b0 con 0x7fd4000d0610 2023-07-21T19:08:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3ff7fe700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4000b0ee0 0x7fd4001590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3fffff700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 0x7fd4000cb2a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800cca0 tx=0x7fd3f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800abc0 con 0x7fd4000d0610 2023-07-21T19:08:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800ad40 con 0x7fd4000d0610 2023-07-21T19:08:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000b3630 con 0x7fd4000d0610 2023-07-21T19:08:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8007310 con 0x7fd4000d0610 2023-07-21T19:08:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4000b3bf0 con 0x7fd4000d0610 2023-07-21T19:08:03.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.792+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000cf720 con 0x7fd4000d0610 2023-07-21T19:08:03.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.796+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3f8007470 con 0x7fd4000d0610 2023-07-21T19:08:03.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.796+0000 7fd3e7fff700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.796+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd3f8083d30 con 0x7fd4000d0610 2023-07-21T19:08:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.796+0000 7fd3ff7fe700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.796+0000 7fd3ff7fe700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4000c9500 tx=0x7fd3f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:03.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.804+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd3f8050eb0 con 0x7fd4000d0610 2023-07-21T19:08:03.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4000cd4e0 con 0x7fd4000d0610 2023-07-21T19:08:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd3e7fff700 1 -- 172.21.15.123:0/3532614036 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4000cd4e0 con 0x7fd4000d0610 2023-07-21T19:08:03.992 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:03.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3ec0662f0 msgr2=0x7fd3ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4000c9500 tx=0x7fd3f0008040 comp rx=0 tx=0).stop 2023-07-21T19:08:03.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 msgr2=0x7fd4000cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:03.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 0x7fd4000cb2a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800cca0 tx=0x7fd3f800a060 comp rx=0 tx=0).stop 2023-07-21T19:08:03.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 shutdown_connections 2023-07-21T19:08:03.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4000d0610 0x7fd4000cb2a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4000cd090 0x7fd4000cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 --2- 172.21.15.123:0/3532614036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4000b0ee0 0x7fd4001590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.980+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 >> 172.21.15.123:0/3532614036 conn(0x7fd400060c40 msgr2=0x7fd4000cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.984+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 shutdown_connections 2023-07-21T19:08:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:03.984+0000 7fd40494a700 1 -- 172.21.15.123:0/3532614036 wait complete. 2023-07-21T19:08:04.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:04.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.176+0000 7fa4d3ac6700 1 Processor -- start 2023-07-21T19:08:04.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d3ac6700 1 -- start start 2023-07-21T19:08:04.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d3ac6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa4cc160240 0x7fa4cc0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d3ac6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc163fe0 con 0x7fa4cc0b0490 2023-07-21T19:08:04.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d3ac6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0c8c30 con 0x7fa4cc160610 2023-07-21T19:08:04.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d3ac6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc0ca9e0 con 0x7fa4cc160240 2023-07-21T19:08:04.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d2063700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4cc0b0490 0x7fa4cc06cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37988/0 (socket says 172.21.15.123:37988) 2023-07-21T19:08:04.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d2063700 1 -- 172.21.15.123:0/392726166 learned_addr learned my addr 172.21.15.123:0/392726166 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:04.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d1862700 1 --2- 172.21.15.123:0/392726166 >> v2:172.21.15.145:3300/0 conn(0x7fa4cc160240 0x7fa4cc0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109835992 0 0) 0x7fa4cc163fe0 con 0x7fa4cc0b0490 2023-07-21T19:08:04.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b80035d0 con 0x7fa4cc0b0490 2023-07-21T19:08:04.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533932121 0 0) 0x7fa4cc0c8c30 con 0x7fa4cc160610 2023-07-21T19:08:04.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc163fe0 con 0x7fa4cc160610 2023-07-21T19:08:04.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887261500 0 0) 0x7fa4b80035d0 con 0x7fa4cc0b0490 2023-07-21T19:08:04.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 >> v2:172.21.15.145:3300/0 conn(0x7fa4cc160240 msgr2=0x7fa4cc0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 --2- 172.21.15.123:0/392726166 >> v2:172.21.15.145:3300/0 conn(0x7fa4cc160240 0x7fa4cc0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 >> v1:172.21.15.145:6789/0 conn(0x7fa4cc160610 legacy=0x7fa4cc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc164230 con 0x7fa4cc0b0490 2023-07-21T19:08:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.180+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7fa4c40019f0 con 0x7fa4cc0b0490 2023-07-21T19:08:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 >> v1:172.21.15.123:6789/0 conn(0x7fa4cc0b0490 legacy=0x7fa4cc06cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b8003bb0 0x7fa4b8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8004870 0x7fa4b8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b8005220 0x7fa4b800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0ca9e0 con 0x7fa4b8005220 2023-07-21T19:08:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b800c130 con 0x7fa4b8004870 2023-07-21T19:08:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b800c2f0 con 0x7fa4b8003bb0 2023-07-21T19:08:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b8005220 0x7fa4b800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 -- 172.21.15.123:0/392726166 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b8003bb0 msgr2=0x7fa4b8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b8003bb0 0x7fa4b8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 -- 172.21.15.123:0/392726166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8004870 msgr2=0x7fa4b8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:04.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8004870 0x7fa4b8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 -- 172.21.15.123:0/392726166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80035d0 con 0x7fa4b8005220 2023-07-21T19:08:04.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 -- 172.21.15.123:0/392726166 reap_dead start 2023-07-21T19:08:04.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d2063700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b8005220 0x7fa4b800ba30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4002230 tx=0x7fa4b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21fe0950d269218 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:04.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40072d0 con 0x7fa4b8005220 2023-07-21T19:08:04.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4007430 con 0x7fa4b8005220 2023-07-21T19:08:04.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d0860700 1 -- 172.21.15.123:0/392726166 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40077a0 con 0x7fa4b8005220 2023-07-21T19:08:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/392726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b8005220 msgr2=0x7fa4b800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b8005220 0x7fa4b800ba30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4002230 tx=0x7fa4b80058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/392726166 shutdown_connections 2023-07-21T19:08:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/392726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b8005220 0x7fa4b800ba30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/392726166 >> 172.21.15.123:0/392726166 conn(0x7fa4cc0cad80 msgr2=0x7fa4cc0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/392726166 shutdown_connections 2023-07-21T19:08:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.184+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/392726166 wait complete. 2023-07-21T19:08:04.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 Processor -- start 2023-07-21T19:08:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 -- start start 2023-07-21T19:08:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8005220 0x7fa4cc0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 0x7fa4cc0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4cc15a410 0x7fa4cc0af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0b0290 con 0x7fa4cc15a910 2023-07-21T19:08:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c1d60 con 0x7fa4b8005220 2023-07-21T19:08:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c6950 con 0x7fa4cc15a410 2023-07-21T19:08:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 0x7fa4cc0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 0x7fa4cc0af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58668/0 (socket says 172.21.15.123:58668) 2023-07-21T19:08:04.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 -- 172.21.15.123:0/1371805870 learned_addr learned my addr 172.21.15.123:0/1371805870 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:04.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d2063700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4cc15a410 0x7fa4cc0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1862700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8005220 0x7fa4cc0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 -- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4cc15a410 msgr2=0x7fa4cc0af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4cc15a410 0x7fa4cc0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 -- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8005220 msgr2=0x7fa4cc0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8005220 0x7fa4cc0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 -- 172.21.15.123:0/1371805870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0b1a40 con 0x7fa4cc15a910 2023-07-21T19:08:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1862700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8005220 0x7fa4cc0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d1061700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 0x7fa4cc0af310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c700 tx=0x7fa4bc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0052d0 con 0x7fa4cc15a910 2023-07-21T19:08:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc005430 con 0x7fa4cc15a910 2023-07-21T19:08:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc0b1d20 con 0x7fa4cc15a910 2023-07-21T19:08:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.188+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0055a0 con 0x7fa4cc15a910 2023-07-21T19:08:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.192+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc0b2000 con 0x7fa4cc15a910 2023-07-21T19:08:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.192+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc04dcb0 con 0x7fa4cc15a910 2023-07-21T19:08:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.192+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4bc0038e0 con 0x7fa4cc15a910 2023-07-21T19:08:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.196+0000 7fa4c27fc700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4b0066320 0x7fa4b00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.196+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa4bc083b50 con 0x7fa4cc15a910 2023-07-21T19:08:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.196+0000 7fa4d1862700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4b0066320 0x7fa4b00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.196+0000 7fa4d1862700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4b0066320 0x7fa4b00687d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009ad0 tx=0x7fa4c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.200+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa4bc050c50 con 0x7fa4cc15a910 2023-07-21T19:08:04.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.376+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4cc071690 con 0x7fa4cc15a910 2023-07-21T19:08:04.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.376+0000 7fa4c27fc700 1 -- 172.21.15.123:0/1371805870 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4bc054270 con 0x7fa4cc15a910 2023-07-21T19:08:04.390 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4b0066320 msgr2=0x7fa4b00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4b0066320 0x7fa4b00687d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009ad0 tx=0x7fa4c8008040 comp rx=0 tx=0).stop 2023-07-21T19:08:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 msgr2=0x7fa4cc0af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 0x7fa4cc0af310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c700 tx=0x7fa4bc00cac0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 shutdown_connections 2023-07-21T19:08:04.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4b0066320 0x7fa4b00687d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4cc15a410 0x7fa4cc0af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc15a910 0x7fa4cc0af310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 --2- 172.21.15.123:0/1371805870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b8005220 0x7fa4cc0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 >> 172.21.15.123:0/1371805870 conn(0x7fa4cc0cad80 msgr2=0x7fa4cc06bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:04.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 shutdown_connections 2023-07-21T19:08:04.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.384+0000 7fa4d3ac6700 1 -- 172.21.15.123:0/1371805870 wait complete. 2023-07-21T19:08:04.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.592+0000 7f5321f92700 1 Processor -- start 2023-07-21T19:08:04.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.592+0000 7f5321f92700 1 -- start start 2023-07-21T19:08:04.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 0x7f531c0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 0x7f531c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c0cf1d0 con 0x7f531c0cfcc0 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c06df00 con 0x7f531c15bdc0 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c06d380 con 0x7f531c15c190 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531b7fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 0x7f531c0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 0x7f531c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 0x7f531c0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46646/0 (socket says 172.21.15.123:46646) 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531bfff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f531c0cfcc0 0x7f531c15fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:46924/0 (socket says 172.21.15.123:46924) 2023-07-21T19:08:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531b7fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 0x7f531c0ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:43884/0 (socket says 172.21.15.123:43884) 2023-07-21T19:08:04.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 -- 172.21.15.123:0/1112463543 learned_addr learned my addr 172.21.15.123:0/1112463543 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:04.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 -- 172.21.15.123:0/1112463543 >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 msgr2=0x7f531c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:04.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 --2- 172.21.15.123:0/1112463543 >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 0x7f531c0ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 -- 172.21.15.123:0/1112463543 >> v1:172.21.15.145:6789/0 conn(0x7f531c0cfcc0 legacy=0x7f531c15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 -- 172.21.15.123:0/1112463543 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c06d660 con 0x7f531c15c190 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531b7fe700 1 --2- 172.21.15.123:0/1112463543 >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 0x7f531c0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531affd700 1 --2- 172.21.15.123:0/1112463543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 0x7f531c0cec90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5310009910 tx=0x7f5310009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a18673dc7e45768 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531a7fc700 1 -- 172.21.15.123:0/1112463543 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310011830 con 0x7f531c15c190 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531a7fc700 1 -- 172.21.15.123:0/1112463543 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310011990 con 0x7f531c15c190 2023-07-21T19:08:04.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f531a7fc700 1 -- 172.21.15.123:0/1112463543 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310011d40 con 0x7f531c15c190 2023-07-21T19:08:04.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- 172.21.15.123:0/1112463543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 msgr2=0x7f531c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 --2- 172.21.15.123:0/1112463543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 0x7f531c0cec90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5310009910 tx=0x7f5310009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:04.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- 172.21.15.123:0/1112463543 shutdown_connections 2023-07-21T19:08:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 --2- 172.21.15.123:0/1112463543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c15c190 0x7f531c0cec90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 --2- 172.21.15.123:0/1112463543 >> v2:172.21.15.145:3300/0 conn(0x7f531c15bdc0 0x7f531c0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- 172.21.15.123:0/1112463543 >> 172.21.15.123:0/1112463543 conn(0x7f531c0cca60 msgr2=0x7f531c0cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- 172.21.15.123:0/1112463543 shutdown_connections 2023-07-21T19:08:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.596+0000 7f5321f92700 1 -- 172.21.15.123:0/1112463543 wait complete. 2023-07-21T19:08:04.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.600+0000 7f5321f92700 1 Processor -- start 2023-07-21T19:08:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.600+0000 7f5321f92700 1 -- start start 2023-07-21T19:08:04.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c0cfcc0 0x7f531c148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 0x7f531c0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c15c190 0x7f531c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c14a180 con 0x7f531c15bdc0 2023-07-21T19:08:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c149570 con 0x7f531c15c190 2023-07-21T19:08:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c149850 con 0x7f531c0cfcc0 2023-07-21T19:08:04.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 0x7f531c0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 0x7f531c0b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58678/0 (socket says 172.21.15.123:58678) 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 -- 172.21.15.123:0/2850854467 learned_addr learned my addr 172.21.15.123:0/2850854467 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531bfff700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c15c190 0x7f531c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531b7fe700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c0cfcc0 0x7f531c148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 -- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c0cfcc0 msgr2=0x7f531c148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c0cfcc0 0x7f531c148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 -- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c15c190 msgr2=0x7f531c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c15c190 0x7f531c0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 -- 172.21.15.123:0/2850854467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c0094b0 con 0x7f531c15bdc0 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f531affd700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 0x7f531c0b14c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310004590 con 0x7f531c15bdc0 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531001e070 con 0x7f531c15bdc0 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5310009570 con 0x7f531c15bdc0 2023-07-21T19:08:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310003900 con 0x7f531c15bdc0 2023-07-21T19:08:04.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.604+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c149e10 con 0x7f531c15bdc0 2023-07-21T19:08:04.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.608+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c04dcb0 con 0x7f531c15bdc0 2023-07-21T19:08:04.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.608+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5310003a60 con 0x7f531c15bdc0 2023-07-21T19:08:04.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.608+0000 7f5303fff700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5308066320 0x7f53080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:04.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.608+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5310084c50 con 0x7f531c15bdc0 2023-07-21T19:08:04.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.612+0000 7f531b7fe700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5308066320 0x7f53080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.612+0000 7f531b7fe700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5308066320 0x7f53080687d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f530c009d10 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:04.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.616+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5310051dd0 con 0x7f531c15bdc0 2023-07-21T19:08:04.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.792+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f531c0b5320 con 0x7f531c15bdc0 2023-07-21T19:08:04.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.792+0000 7f5303fff700 1 -- 172.21.15.123:0/2850854467 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53100553f0 con 0x7f531c15bdc0 2023-07-21T19:08:04.805 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:04.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5308066320 msgr2=0x7f53080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5308066320 0x7f53080687d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f530c009d10 tx=0x7f530c008040 comp rx=0 tx=0).stop 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 msgr2=0x7f531c0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 0x7f531c0b14c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310004770 comp rx=0 tx=0).stop 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 shutdown_connections 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5308066320 0x7f53080687d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c15c190 0x7f531c0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f531c15bdc0 0x7f531c0b14c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 --2- 172.21.15.123:0/2850854467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f531c0cfcc0 0x7f531c148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:04.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 >> 172.21.15.123:0/2850854467 conn(0x7f531c0cca60 msgr2=0x7f531c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:04.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 shutdown_connections 2023-07-21T19:08:04.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:04.796+0000 7f5321f92700 1 -- 172.21.15.123:0/2850854467 wait complete. 2023-07-21T19:08:04.832 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.000+0000 7fa8a6c25700 1 Processor -- start 2023-07-21T19:08:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.000+0000 7fa8a6c25700 1 -- start start 2023-07-21T19:08:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a6c25700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a00b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a6c25700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa8a00d21c0 0x7fa8a00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a6c25700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00af2e0 con 0x7fa8a00cf7a0 2023-07-21T19:08:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a6c25700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00d0030 con 0x7fa8a00d21c0 2023-07-21T19:08:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a6c25700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00af5c0 con 0x7fa8a00d0920 2023-07-21T19:08:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa8a00d21c0 0x7fa8a00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a49c1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa8a00cf7a0 0x7fa8a00d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38004/0 (socket says 172.21.15.123:38004) 2023-07-21T19:08:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 --2- 172.21.15.123:0/2802416677 >> v2:172.21.15.123:3300/0 conn(0x7fa8a00d21c0 0x7fa8a00b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58694/0 (socket says 172.21.15.123:58694) 2023-07-21T19:08:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a49c1700 1 -- 172.21.15.123:0/2802416677 learned_addr learned my addr 172.21.15.123:0/2802416677 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa89ffff700 1 --2- 172.21.15.123:0/2802416677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a00b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 -- 172.21.15.123:0/2802416677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 msgr2=0x7fa8a00b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:05.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 --2- 172.21.15.123:0/2802416677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a00b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 -- 172.21.15.123:0/2802416677 >> v1:172.21.15.123:6789/0 conn(0x7fa8a00cf7a0 legacy=0x7fa8a00d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 -- 172.21.15.123:0/2802416677 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00af8a0 con 0x7fa8a00d21c0 2023-07-21T19:08:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.004+0000 7fa8a51c2700 1 --2- 172.21.15.123:0/2802416677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a00b08c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa898009d90 tx=0x7fa89800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9983381085e7d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa89f7fe700 1 -- 172.21.15.123:0/2802416677 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800e070 con 0x7fa8a00d21c0 2023-07-21T19:08:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa89f7fe700 1 -- 172.21.15.123:0/2802416677 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800bb20 con 0x7fa8a00d21c0 2023-07-21T19:08:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa89f7fe700 1 -- 172.21.15.123:0/2802416677 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898012430 con 0x7fa8a00d21c0 2023-07-21T19:08:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 -- 172.21.15.123:0/2802416677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 msgr2=0x7fa8a00b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/2802416677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a00b08c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa898009d90 tx=0x7fa89800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 -- 172.21.15.123:0/2802416677 shutdown_connections 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/2802416677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a00b08c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/2802416677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a00b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 -- 172.21.15.123:0/2802416677 >> 172.21.15.123:0/2802416677 conn(0x7fa8a009b9c0 msgr2=0x7fa8a00d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 -- 172.21.15.123:0/2802416677 shutdown_connections 2023-07-21T19:08:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 -- 172.21.15.123:0/2802416677 wait complete. 2023-07-21T19:08:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 Processor -- start 2023-07-21T19:08:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.008+0000 7fa8a6c25700 1 -- start start 2023-07-21T19:08:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cf7a0 0x7fa8a015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a0158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a0159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b5810 con 0x7fa8a00d21c0 2023-07-21T19:08:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b5af0 con 0x7fa8a00cf7a0 2023-07-21T19:08:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b5dd0 con 0x7fa8a00d0920 2023-07-21T19:08:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a0159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58698/0 (socket says 172.21.15.123:58698) 2023-07-21T19:08:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 -- 172.21.15.123:0/3517811699 learned_addr learned my addr 172.21.15.123:0/3517811699 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa89ffff700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a0158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a49c1700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cf7a0 0x7fa8a015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 -- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 msgr2=0x7fa8a0158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a0158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 -- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cf7a0 msgr2=0x7fa8a015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cf7a0 0x7fa8a015e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 -- 172.21.15.123:0/3517811699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009a70 con 0x7fa8a00d21c0 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa89ffff700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a0158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a51c2700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a0159420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa898014040 tx=0x7fa898004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898012430 con 0x7fa8a00d21c0 2023-07-21T19:08:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898020070 con 0x7fa8a00d21c0 2023-07-21T19:08:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a00b60b0 con 0x7fa8a00d21c0 2023-07-21T19:08:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898004280 con 0x7fa8a00d21c0 2023-07-21T19:08:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.012+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00b5470 con 0x7fa8a00d21c0 2023-07-21T19:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.016+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a00b65d0 con 0x7fa8a00d21c0 2023-07-21T19:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.016+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8980043e0 con 0x7fa8a00d21c0 2023-07-21T19:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.016+0000 7fa89d7fa700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840662f0 0x7fa8840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.016+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa898022070 con 0x7fa8a00d21c0 2023-07-21T19:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.016+0000 7fa8a49c1700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840662f0 0x7fa8840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.020+0000 7fa8a49c1700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840662f0 0x7fa8840687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa894005930 tx=0x7fa894009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.024+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa8a00b65d0 con 0x7fa8a00d21c0 2023-07-21T19:08:05.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.192+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8a00b65d0 con 0x7fa8a00d21c0 2023-07-21T19:08:05.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa89d7fa700 1 -- 172.21.15.123:0/3517811699 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa89802c020 con 0x7fa8a00d21c0 2023-07-21T19:08:05.208 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840662f0 msgr2=0x7fa8840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840662f0 0x7fa8840687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa894005930 tx=0x7fa894009040 comp rx=0 tx=0).stop 2023-07-21T19:08:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 msgr2=0x7fa8a0159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a0159420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa898014040 tx=0x7fa898004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 shutdown_connections 2023-07-21T19:08:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840662f0 0x7fa8840687a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d21c0 0x7fa8a0159420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00d0920 0x7fa8a0158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 --2- 172.21.15.123:0/3517811699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cf7a0 0x7fa8a015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 >> 172.21.15.123:0/3517811699 conn(0x7fa8a009b9c0 msgr2=0x7fa8a00b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:05.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 shutdown_connections 2023-07-21T19:08:05.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.196+0000 7fa8a6c25700 1 -- 172.21.15.123:0/3517811699 wait complete. 2023-07-21T19:08:05.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:05.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.396+0000 7fc545e7b700 1 Processor -- start 2023-07-21T19:08:05.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.396+0000 7fc545e7b700 1 -- start start 2023-07-21T19:08:05.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc545e7b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400d07e0 0x7fc5401669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc545e7b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400d1a60 con 0x7fc5400b0ee0 2023-07-21T19:08:05.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc545e7b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400d1ef0 con 0x7fc5400cd260 2023-07-21T19:08:05.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc545e7b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400d0c60 con 0x7fc5400d07e0 2023-07-21T19:08:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc544e79700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc5400b0ee0 0x7fc5400ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38010/0 (socket says 172.21.15.123:38010) 2023-07-21T19:08:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc544e79700 1 -- 172.21.15.123:0/3255652711 learned_addr learned my addr 172.21.15.123:0/3255652711 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc54567a700 1 --2- 172.21.15.123:0/3255652711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400d07e0 0x7fc5401669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc53f7fe700 1 -- 172.21.15.123:0/3255652711 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700470214 0 0) 0x7fc5400d1a60 con 0x7fc5400b0ee0 2023-07-21T19:08:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc53f7fe700 1 -- 172.21.15.123:0/3255652711 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5300035d0 con 0x7fc5400b0ee0 2023-07-21T19:08:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc54567a700 1 -- 172.21.15.123:0/3255652711 >> v1:172.21.15.145:6789/0 conn(0x7fc5400cd260 legacy=0x7fc5400d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc54567a700 1 -- 172.21.15.123:0/3255652711 >> v1:172.21.15.123:6789/0 conn(0x7fc5400b0ee0 legacy=0x7fc5400ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.400+0000 7fc54567a700 1 -- 172.21.15.123:0/3255652711 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400d0e50 con 0x7fc5400d07e0 2023-07-21T19:08:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc54567a700 1 --2- 172.21.15.123:0/3255652711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400d07e0 0x7fc5401669b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc538009dc0 tx=0x7fc53800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282bc88b0447c5af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc53f7fe700 1 -- 172.21.15.123:0/3255652711 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53800e070 con 0x7fc5400d07e0 2023-07-21T19:08:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc53f7fe700 1 -- 172.21.15.123:0/3255652711 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53800bb20 con 0x7fc5400d07e0 2023-07-21T19:08:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc53f7fe700 1 -- 172.21.15.123:0/3255652711 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538012430 con 0x7fc5400d07e0 2023-07-21T19:08:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 -- 172.21.15.123:0/3255652711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400d07e0 msgr2=0x7fc5401669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 --2- 172.21.15.123:0/3255652711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400d07e0 0x7fc5401669b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc538009dc0 tx=0x7fc53800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 -- 172.21.15.123:0/3255652711 shutdown_connections 2023-07-21T19:08:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 --2- 172.21.15.123:0/3255652711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400d07e0 0x7fc5401669b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 -- 172.21.15.123:0/3255652711 >> 172.21.15.123:0/3255652711 conn(0x7fc540060c40 msgr2=0x7fc54009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 -- 172.21.15.123:0/3255652711 shutdown_connections 2023-07-21T19:08:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.404+0000 7fc545e7b700 1 -- 172.21.15.123:0/3255652711 wait complete. 2023-07-21T19:08:05.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 Processor -- start 2023-07-21T19:08:05.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 -- start start 2023-07-21T19:08:05.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400b0ee0 0x7fc540158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 0x7fc5400b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5400d07e0 0x7fc5400b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400c7a70 con 0x7fc5400cd260 2023-07-21T19:08:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400c88d0 con 0x7fc5400d07e0 2023-07-21T19:08:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc545e7b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc540158da0 con 0x7fc5400b0ee0 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 0x7fc5400b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 0x7fc5400b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58710/0 (socket says 172.21.15.123:58710) 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 -- 172.21.15.123:0/2922835075 learned_addr learned my addr 172.21.15.123:0/2922835075 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc544e79700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400b0ee0 0x7fc540158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc54567a700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5400d07e0 0x7fc5400b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 -- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400b0ee0 msgr2=0x7fc540158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400b0ee0 0x7fc540158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 -- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5400d07e0 msgr2=0x7fc5400b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5400d07e0 0x7fc5400b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 -- 172.21.15.123:0/2922835075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538009a70 con 0x7fc5400cd260 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53ffff700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 0x7fc5400b1af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00c530 tx=0x7fc52c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.408+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0052d0 con 0x7fc5400cd260 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.412+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c005430 con 0x7fc5400cd260 2023-07-21T19:08:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.412+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0055a0 con 0x7fc5400cd260 2023-07-21T19:08:05.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.412+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5400c7cc0 con 0x7fc5400cd260 2023-07-21T19:08:05.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.412+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5400c8280 con 0x7fc5400cd260 2023-07-21T19:08:05.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.412+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54004e500 con 0x7fc5400cd260 2023-07-21T19:08:05.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.412+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc52c0038c0 con 0x7fc5400cd260 2023-07-21T19:08:05.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.416+0000 7fc53d7fa700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5240662f0 0x7fc5240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.416+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc52c083470 con 0x7fc5400cd260 2023-07-21T19:08:05.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.416+0000 7fc544e79700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5240662f0 0x7fc5240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.416+0000 7fc544e79700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5240662f0 0x7fc5240687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5340011e0 tx=0x7fc534009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.420+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc52c050560 con 0x7fc5400cd260 2023-07-21T19:08:05.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.588+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5400b18d0 con 0x7fc5400cd260 2023-07-21T19:08:05.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc53d7fa700 1 -- 172.21.15.123:0/2922835075 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc52c053b80 con 0x7fc5400cd260 2023-07-21T19:08:05.604 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5240662f0 msgr2=0x7fc5240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5240662f0 0x7fc5240687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5340011e0 tx=0x7fc534009040 comp rx=0 tx=0).stop 2023-07-21T19:08:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 msgr2=0x7fc5400b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 0x7fc5400b1af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00c530 tx=0x7fc52c00c8f0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 shutdown_connections 2023-07-21T19:08:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5240662f0 0x7fc5240687a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5400d07e0 0x7fc5400b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5400cd260 0x7fc5400b1af0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 --2- 172.21.15.123:0/2922835075 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5400b0ee0 0x7fc540158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 >> 172.21.15.123:0/2922835075 conn(0x7fc540060c40 msgr2=0x7fc5400b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.592+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 shutdown_connections 2023-07-21T19:08:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.596+0000 7fc545e7b700 1 -- 172.21.15.123:0/2922835075 wait complete. 2023-07-21T19:08:05.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:08:05.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 Processor -- start 2023-07-21T19:08:05.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 -- start start 2023-07-21T19:08:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80ac159f20 0x7f80ac0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac0b0ef0 con 0x7f80ac0caf70 2023-07-21T19:08:05.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac0ce9c0 con 0x7f80ac159f20 2023-07-21T19:08:05.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80b1803700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cee50 con 0x7f80ac0c9d90 2023-07-21T19:08:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.792+0000 7f80abfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80ac159f20 0x7f80ac0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80ac159f20 0x7f80ac0caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58716/0 (socket says 172.21.15.123:58716) 2023-07-21T19:08:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 -- 172.21.15.123:0/601309380 learned_addr learned my addr 172.21.15.123:0/601309380 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1002700 1 --1- 172.21.15.123:0/601309380 >> v1:172.21.15.123:6789/0 conn(0x7f80ac0caf70 0x7f80ac0c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38012/0 (socket says 172.21.15.123:38012) 2023-07-21T19:08:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b0801700 1 --2- 172.21.15.123:0/601309380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 -- 172.21.15.123:0/601309380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 msgr2=0x7f80ac0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 --2- 172.21.15.123:0/601309380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 -- 172.21.15.123:0/601309380 >> v1:172.21.15.123:6789/0 conn(0x7f80ac0caf70 legacy=0x7f80ac0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 -- 172.21.15.123:0/601309380 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0ca6a0 con 0x7f80ac159f20 2023-07-21T19:08:05.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80ab7fe700 1 -- 172.21.15.123:0/601309380 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942634730 0 0) 0x7f80ac0b0ef0 con 0x7f80ac0caf70 2023-07-21T19:08:05.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80abfff700 1 --2- 172.21.15.123:0/601309380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0caa30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8098009910 tx=0x7f8098009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789c20ad41dbfe9d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80ab7fe700 1 -- 172.21.15.123:0/601309380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800ba60 con 0x7f80ac159f20 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80ab7fe700 1 -- 172.21.15.123:0/601309380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800bbc0 con 0x7f80ac159f20 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80ab7fe700 1 -- 172.21.15.123:0/601309380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098009e60 con 0x7f80ac159f20 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 -- 172.21.15.123:0/601309380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 msgr2=0x7f80ac0caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 --2- 172.21.15.123:0/601309380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0caa30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8098009910 tx=0x7f8098009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 -- 172.21.15.123:0/601309380 shutdown_connections 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 --2- 172.21.15.123:0/601309380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0caa30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 --2- 172.21.15.123:0/601309380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 -- 172.21.15.123:0/601309380 >> 172.21.15.123:0/601309380 conn(0x7f80ac06e960 msgr2=0x7f80ac06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:05.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 -- 172.21.15.123:0/601309380 shutdown_connections 2023-07-21T19:08:05.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.796+0000 7f80b1803700 1 -- 172.21.15.123:0/601309380 wait complete. 2023-07-21T19:08:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.800+0000 7f80b1803700 1 Processor -- start 2023-07-21T19:08:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.800+0000 7f80b1803700 1 -- start start 2023-07-21T19:08:05.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac1ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80ac0caf70 0x7f80ac1eea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac1f3340 con 0x7f80ac159f20 2023-07-21T19:08:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac147700 con 0x7f80ac0caf70 2023-07-21T19:08:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac1479e0 con 0x7f80ac0c9d90 2023-07-21T19:08:05.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58732/0 (socket says 172.21.15.123:58732) 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 -- 172.21.15.123:0/28664129 learned_addr learned my addr 172.21.15.123:0/28664129 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80abfff700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80ac0caf70 0x7f80ac1eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b0801700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac1ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 -- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 msgr2=0x7f80ac1ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac1ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 -- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80ac0caf70 msgr2=0x7f80ac1eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80ac0caf70 0x7f80ac1eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 -- 172.21.15.123:0/28664129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098009570 con 0x7f80ac159f20 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80abfff700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80ac0caf70 0x7f80ac1eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1002700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0adb60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80a4002230 tx=0x7f80a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400ac20 con 0x7f80ac159f20 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a400ada0 con 0x7f80ac159f20 2023-07-21T19:08:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac147cc0 con 0x7f80ac159f20 2023-07-21T19:08:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4007310 con 0x7f80ac159f20 2023-07-21T19:08:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac1481e0 con 0x7f80ac159f20 2023-07-21T19:08:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.804+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac04e500 con 0x7f80ac159f20 2023-07-21T19:08:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.808+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80a4007470 con 0x7f80ac159f20 2023-07-21T19:08:05.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.812+0000 7f80a97fa700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80900662f0 0x7f80900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.812+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80a4083f50 con 0x7f80ac159f20 2023-07-21T19:08:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.812+0000 7f80b0801700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80900662f0 0x7f80900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:05.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.812+0000 7f80b0801700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80900662f0 0x7f80900687a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f80a000b9d0 tx=0x7f80a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:05.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:05.816+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f80a40510e0 con 0x7f80ac159f20 2023-07-21T19:08:06.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.004+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80ac070c90 con 0x7f80ac159f20 2023-07-21T19:08:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.004+0000 7f80a97fa700 1 -- 172.21.15.123:0/28664129 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f80a4018080 con 0x7f80ac159f20 2023-07-21T19:08:06.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80900662f0 msgr2=0x7f80900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80900662f0 0x7f80900687a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f80a000b9d0 tx=0x7f80a0008040 comp rx=0 tx=0).stop 2023-07-21T19:08:06.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 msgr2=0x7f80ac0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0adb60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80a4002230 tx=0x7f80a400a060 comp rx=0 tx=0).stop 2023-07-21T19:08:06.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 shutdown_connections 2023-07-21T19:08:06.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80900662f0 0x7f80900687a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80ac0caf70 0x7f80ac1eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80ac159f20 0x7f80ac0adb60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 --2- 172.21.15.123:0/28664129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80ac0c9d90 0x7f80ac1ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 >> 172.21.15.123:0/28664129 conn(0x7f80ac06e960 msgr2=0x7f80ac0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:06.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 shutdown_connections 2023-07-21T19:08:06.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.008+0000 7f80b1803700 1 -- 172.21.15.123:0/28664129 wait complete. 2023-07-21T19:08:06.024 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:08:06.043 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2023-07-21T19:08:06.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:06.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-21T19:08:06.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[40772]: fuse finished with error 0 and tester_r 0 2023-07-21T19:08:06.090 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:08:06.147 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:08:06.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:06.148 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-21T19:08:06.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:06.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 Processor -- start 2023-07-21T19:08:06.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 -- start start 2023-07-21T19:08:06.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f261415ffa0 0x7f261406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261406dc50 0x7f26140caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2614160370 0x7f26140cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140ca8a0 con 0x7f2614160370 2023-07-21T19:08:06.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140cbcd0 con 0x7f261415ffa0 2023-07-21T19:08:06.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.376+0000 7f261aa53700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140cbf70 con 0x7f261406dc50 2023-07-21T19:08:06.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2614160370 0x7f26140cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2614160370 0x7f26140cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58740/0 (socket says 172.21.15.123:58740) 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 -- 172.21.15.123:0/315289010 learned_addr learned my addr 172.21.15.123:0/315289010 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f2619250700 1 --2- 172.21.15.123:0/315289010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261406dc50 0x7f26140caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f2619a51700 1 --2- 172.21.15.123:0/315289010 >> v2:172.21.15.145:3300/0 conn(0x7f261415ffa0 0x7f261406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 -- 172.21.15.123:0/315289010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261406dc50 msgr2=0x7f26140caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 --2- 172.21.15.123:0/315289010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261406dc50 0x7f26140caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 -- 172.21.15.123:0/315289010 >> v2:172.21.15.145:3300/0 conn(0x7f261415ffa0 msgr2=0x7f261406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 --2- 172.21.15.123:0/315289010 >> v2:172.21.15.145:3300/0 conn(0x7f261415ffa0 0x7f261406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 -- 172.21.15.123:0/315289010 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140cc250 con 0x7f2614160370 2023-07-21T19:08:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f2619a51700 1 --2- 172.21.15.123:0/315289010 >> v2:172.21.15.145:3300/0 conn(0x7f261415ffa0 0x7f261406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261a252700 1 --2- 172.21.15.123:0/315289010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614160370 0x7f26140cafb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f26140caa40 tx=0x7f260c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202c1f14e0a91db9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f2618a4f700 1 -- 172.21.15.123:0/315289010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c011830 con 0x7f2614160370 2023-07-21T19:08:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f2618a4f700 1 -- 172.21.15.123:0/315289010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c011990 con 0x7f2614160370 2023-07-21T19:08:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f2618a4f700 1 -- 172.21.15.123:0/315289010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c011d20 con 0x7f2614160370 2023-07-21T19:08:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 -- 172.21.15.123:0/315289010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614160370 msgr2=0x7f26140cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 --2- 172.21.15.123:0/315289010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614160370 0x7f26140cafb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f26140caa40 tx=0x7f260c009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 -- 172.21.15.123:0/315289010 shutdown_connections 2023-07-21T19:08:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 --2- 172.21.15.123:0/315289010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614160370 0x7f26140cafb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 --2- 172.21.15.123:0/315289010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261406dc50 0x7f26140caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 --2- 172.21.15.123:0/315289010 >> v2:172.21.15.145:3300/0 conn(0x7f261415ffa0 0x7f261406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 -- 172.21.15.123:0/315289010 >> 172.21.15.123:0/315289010 conn(0x7f261406e960 msgr2=0x7f261406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 -- 172.21.15.123:0/315289010 shutdown_connections 2023-07-21T19:08:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.380+0000 7f261aa53700 1 -- 172.21.15.123:0/315289010 wait complete. 2023-07-21T19:08:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.384+0000 7f261aa53700 1 Processor -- start 2023-07-21T19:08:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.384+0000 7f261aa53700 1 -- start start 2023-07-21T19:08:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261aa53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 0x7f26141f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261aa53700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261415ffa0 0x7f26140b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261aa53700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614160370 0x7f2614153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261aa53700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26141f6640 con 0x7f261406dc50 2023-07-21T19:08:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261aa53700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26141f6920 con 0x7f261415ffa0 2023-07-21T19:08:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261aa53700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26141f6c00 con 0x7f2614160370 2023-07-21T19:08:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 0x7f26141f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 0x7f26141f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58750/0 (socket says 172.21.15.123:58750) 2023-07-21T19:08:06.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 -- 172.21.15.123:0/387151819 learned_addr learned my addr 172.21.15.123:0/387151819 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619250700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261415ffa0 0x7f26140b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261a252700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614160370 0x7f2614153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 -- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614160370 msgr2=0x7f2614153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614160370 0x7f2614153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 -- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261415ffa0 msgr2=0x7f26140b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261415ffa0 0x7f26140b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 -- 172.21.15.123:0/387151819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009570 con 0x7f261406dc50 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619250700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261415ffa0 0x7f26140b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f261a252700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614160370 0x7f2614153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.388+0000 7f2619a51700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 0x7f26141f5cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2610009fa0 tx=0x7f261000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.392+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610003a40 con 0x7f261406dc50 2023-07-21T19:08:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.392+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000f040 con 0x7f261406dc50 2023-07-21T19:08:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.392+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26141f6f50 con 0x7f261406dc50 2023-07-21T19:08:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.392+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610003e00 con 0x7f261406dc50 2023-07-21T19:08:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.392+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26141f6230 con 0x7f261406dc50 2023-07-21T19:08:06.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.392+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614071620 con 0x7f261406dc50 2023-07-21T19:08:06.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.396+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2610004030 con 0x7f261406dc50 2023-07-21T19:08:06.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.396+0000 7f260a7fc700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f80662f0 0x7f25f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.396+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2610083fb0 con 0x7f261406dc50 2023-07-21T19:08:06.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.396+0000 7f2619250700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f80662f0 0x7f25f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.396+0000 7f2619250700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f80662f0 0x7f25f80687a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26141f6e60 tx=0x7f2604008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:06.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.400+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26100b4720 con 0x7f261406dc50 2023-07-21T19:08:06.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.576+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f261404e500 con 0x7f261406dc50 2023-07-21T19:08:06.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f260a7fc700 1 -- 172.21.15.123:0/387151819 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f261001a090 con 0x7f261406dc50 2023-07-21T19:08:06.591 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:06.591 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:06.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f80662f0 msgr2=0x7f25f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f80662f0 0x7f25f80687a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26141f6e60 tx=0x7f2604008040 comp rx=0 tx=0).stop 2023-07-21T19:08:06.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 msgr2=0x7f26141f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 0x7f26141f5cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2610009fa0 tx=0x7f261000d460 comp rx=0 tx=0).stop 2023-07-21T19:08:06.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 shutdown_connections 2023-07-21T19:08:06.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f80662f0 0x7f25f80687a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261415ffa0 0x7f26140b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614160370 0x7f2614153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 --2- 172.21.15.123:0/387151819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261406dc50 0x7f26141f5cf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 >> 172.21.15.123:0/387151819 conn(0x7f261406e960 msgr2=0x7f26140cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:06.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 shutdown_connections 2023-07-21T19:08:06.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.580+0000 7f261aa53700 1 -- 172.21.15.123:0/387151819 wait complete. 2023-07-21T19:08:06.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 Processor -- start 2023-07-21T19:08:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 -- start start 2023-07-21T19:08:06.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2d101599d0 0x7f2d10071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2d100caa20 0x7f2d100cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d100cde10 con 0x7f2d1015ccf0 2023-07-21T19:08:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100cb380 con 0x7f2d100caa20 2023-07-21T19:08:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.764+0000 7f2d15885700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100cd520 con 0x7f2d101599d0 2023-07-21T19:08:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15084700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2d100caa20 0x7f2d100cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d07fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2d1015ccf0 0x7f2d100c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38014/0 (socket says 172.21.15.123:38014) 2023-07-21T19:08:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d07fff700 1 -- 172.21.15.123:0/1230413583 learned_addr learned my addr 172.21.15.123:0/1230413583 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d14883700 1 --2- 172.21.15.123:0/1230413583 >> v2:172.21.15.145:3300/0 conn(0x7f2d101599d0 0x7f2d10071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d077fe700 1 -- 172.21.15.123:0/1230413583 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098924913 0 0) 0x7f2d100cde10 con 0x7f2d1015ccf0 2023-07-21T19:08:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d077fe700 1 -- 172.21.15.123:0/1230413583 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf80035d0 con 0x7f2d1015ccf0 2023-07-21T19:08:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15084700 1 -- 172.21.15.123:0/1230413583 >> v2:172.21.15.145:3300/0 conn(0x7f2d101599d0 msgr2=0x7f2d10071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15084700 1 --2- 172.21.15.123:0/1230413583 >> v2:172.21.15.145:3300/0 conn(0x7f2d101599d0 0x7f2d10071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15084700 1 -- 172.21.15.123:0/1230413583 >> v1:172.21.15.123:6789/0 conn(0x7f2d1015ccf0 legacy=0x7f2d100c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15084700 1 -- 172.21.15.123:0/1230413583 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1015d190 con 0x7f2d100caa20 2023-07-21T19:08:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15084700 1 --2- 172.21.15.123:0/1230413583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d100caa20 0x7f2d100cae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d100cf0d0 tx=0x7f2d0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00d7195c5055923 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d077fe700 1 -- 172.21.15.123:0/1230413583 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800e070 con 0x7f2d100caa20 2023-07-21T19:08:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d077fe700 1 -- 172.21.15.123:0/1230413583 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800bb20 con 0x7f2d100caa20 2023-07-21T19:08:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d077fe700 1 -- 172.21.15.123:0/1230413583 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08012430 con 0x7f2d100caa20 2023-07-21T19:08:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 -- 172.21.15.123:0/1230413583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d100caa20 msgr2=0x7f2d100cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 --2- 172.21.15.123:0/1230413583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d100caa20 0x7f2d100cae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d100cf0d0 tx=0x7f2d0800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 -- 172.21.15.123:0/1230413583 shutdown_connections 2023-07-21T19:08:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 --2- 172.21.15.123:0/1230413583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d100caa20 0x7f2d100cae40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 --2- 172.21.15.123:0/1230413583 >> v2:172.21.15.145:3300/0 conn(0x7f2d101599d0 0x7f2d10071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 -- 172.21.15.123:0/1230413583 >> 172.21.15.123:0/1230413583 conn(0x7f2d1006e960 msgr2=0x7f2d1006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:06.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 -- 172.21.15.123:0/1230413583 shutdown_connections 2023-07-21T19:08:06.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.768+0000 7f2d15885700 1 -- 172.21.15.123:0/1230413583 wait complete. 2023-07-21T19:08:06.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.772+0000 7f2d15885700 1 Processor -- start 2023-07-21T19:08:06.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.772+0000 7f2d15885700 1 -- start start 2023-07-21T19:08:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d100caa20 0x7f2d100c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 0x7f2d1015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d1015ccf0 0x7f2d100c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015b9e0 con 0x7f2d101599d0 2023-07-21T19:08:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015adf0 con 0x7f2d100caa20 2023-07-21T19:08:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015b040 con 0x7f2d1015ccf0 2023-07-21T19:08:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 0x7f2d1015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 0x7f2d1015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58772/0 (socket says 172.21.15.123:58772) 2023-07-21T19:08:06.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 -- 172.21.15.123:0/2801713712 learned_addr learned my addr 172.21.15.123:0/2801713712 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:06.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15084700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d1015ccf0 0x7f2d100c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d14883700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d100caa20 0x7f2d100c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 -- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d1015ccf0 msgr2=0x7f2d100c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d1015ccf0 0x7f2d100c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 -- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d100caa20 msgr2=0x7f2d100c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d100caa20 0x7f2d100c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 -- 172.21.15.123:0/2801713712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08009a70 con 0x7f2d101599d0 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d07fff700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 0x7f2d1015da10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c730 tx=0x7f2d0000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00005d90 con 0x7f2d101599d0 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d000070d0 con 0x7f2d101599d0 2023-07-21T19:08:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1015b320 con 0x7f2d101599d0 2023-07-21T19:08:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00007460 con 0x7f2d101599d0 2023-07-21T19:08:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1015df50 con 0x7f2d101599d0 2023-07-21T19:08:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.776+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1015e110 con 0x7f2d101599d0 2023-07-21T19:08:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.780+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d000075c0 con 0x7f2d101599d0 2023-07-21T19:08:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.780+0000 7f2d057fa700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2cfc0662f0 0x7f2cfc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.780+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d000835d0 con 0x7f2d101599d0 2023-07-21T19:08:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.780+0000 7f2d14883700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2cfc0662f0 0x7f2cfc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.780+0000 7f2d14883700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2cfc0662f0 0x7f2cfc0687a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009b80 tx=0x7f2d0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:06.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.788+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2d00050750 con 0x7f2d101599d0 2023-07-21T19:08:06.877 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:06.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.964+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d1004e500 con 0x7f2d101599d0 2023-07-21T19:08:06.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.964+0000 7f2d057fa700 1 -- 172.21.15.123:0/2801713712 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f2d00053d70 con 0x7f2d101599d0 2023-07-21T19:08:06.978 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:06.978 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2cfc0662f0 msgr2=0x7f2cfc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2cfc0662f0 0x7f2cfc0687a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009b80 tx=0x7f2d0c008040 comp rx=0 tx=0).stop 2023-07-21T19:08:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 msgr2=0x7f2d1015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 0x7f2d1015da10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c730 tx=0x7f2d0000caf0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 shutdown_connections 2023-07-21T19:08:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2cfc0662f0 0x7f2cfc0687a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d1015ccf0 0x7f2d100c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d101599d0 0x7f2d1015da10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 --2- 172.21.15.123:0/2801713712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d100caa20 0x7f2d100c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 >> 172.21.15.123:0/2801713712 conn(0x7f2d1006e960 msgr2=0x7f2d10158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 shutdown_connections 2023-07-21T19:08:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:06.968+0000 7f2d15885700 1 -- 172.21.15.123:0/2801713712 wait complete. 2023-07-21T19:08:07.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T19:08:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 Processor -- start 2023-07-21T19:08:07.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 -- start start 2023-07-21T19:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fb80b06c0 0x7f7fb80b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 0x7f7fb80cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb80cbb60 con 0x7f7fb80b1380 2023-07-21T19:08:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb80b0f60 con 0x7f7fb80b06c0 2023-07-21T19:08:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.216+0000 7f7fbedaf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80cb510 con 0x7f7fb80b18d0 2023-07-21T19:08:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 0x7f7fb80cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbddad700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fb80b06c0 0x7f7fb80b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 0x7f7fb80cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46764/0 (socket says 172.21.15.123:46764) 2023-07-21T19:08:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 -- 172.21.15.123:0/3173275357 learned_addr learned my addr 172.21.15.123:0/3173275357 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 -- 172.21.15.123:0/3173275357 >> v2:172.21.15.123:3300/0 conn(0x7f7fb80b06c0 msgr2=0x7f7fb80b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:07.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 --2- 172.21.15.123:0/3173275357 >> v2:172.21.15.123:3300/0 conn(0x7f7fb80b06c0 0x7f7fb80b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 -- 172.21.15.123:0/3173275357 >> v1:172.21.15.145:6789/0 conn(0x7f7fb80b1380 legacy=0x7f7fb80cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 -- 172.21.15.123:0/3173275357 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80cb7f0 con 0x7f7fb80b18d0 2023-07-21T19:08:07.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbd5ac700 1 --2- 172.21.15.123:0/3173275357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 0x7f7fb80cdf00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009910 tx=0x7f7fa8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab50cc3bde11b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:07.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbcdab700 1 -- 172.21.15.123:0/3173275357 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8011830 con 0x7f7fb80b18d0 2023-07-21T19:08:07.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbcdab700 1 -- 172.21.15.123:0/3173275357 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa8011990 con 0x7f7fb80b18d0 2023-07-21T19:08:07.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbcdab700 1 -- 172.21.15.123:0/3173275357 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8011d40 con 0x7f7fb80b18d0 2023-07-21T19:08:07.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3173275357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 msgr2=0x7f7fb80cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3173275357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 0x7f7fb80cdf00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009910 tx=0x7f7fa8009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3173275357 shutdown_connections 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3173275357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b18d0 0x7f7fb80cdf00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3173275357 >> v2:172.21.15.123:3300/0 conn(0x7f7fb80b06c0 0x7f7fb80b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3173275357 >> 172.21.15.123:0/3173275357 conn(0x7f7fb8099600 msgr2=0x7f7fb80d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3173275357 shutdown_connections 2023-07-21T19:08:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.220+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3173275357 wait complete. 2023-07-21T19:08:07.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 Processor -- start 2023-07-21T19:08:07.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 -- start start 2023-07-21T19:08:07.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b06c0 0x7f7fb81f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fb80b1380 0x7f7fb80c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 0x7f7fb80c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80c8ee0 con 0x7f7fb80b18d0 2023-07-21T19:08:07.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80cb0a0 con 0x7f7fb80b1380 2023-07-21T19:08:07.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.224+0000 7f7fbedaf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80ca420 con 0x7f7fb80b06c0 2023-07-21T19:08:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 0x7f7fb80c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 0x7f7fb80c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58788/0 (socket says 172.21.15.123:58788) 2023-07-21T19:08:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 -- 172.21.15.123:0/3855722446 learned_addr learned my addr 172.21.15.123:0/3855722446 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbd5ac700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fb80b1380 0x7f7fb80c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbddad700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b06c0 0x7f7fb81f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 -- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b06c0 msgr2=0x7f7fb81f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b06c0 0x7f7fb81f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 -- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fb80b1380 msgr2=0x7f7fb80c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fb80b1380 0x7f7fb80c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 -- 172.21.15.123:0/3855722446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8009570 con 0x7f7fb80b18d0 2023-07-21T19:08:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbddad700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b06c0 0x7f7fb81f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbd5ac700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fb80b1380 0x7f7fb80c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbe5ae700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 0x7f7fb80c7940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000cbc0 tx=0x7f7fb000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0003c20 con 0x7f7fb80b18d0 2023-07-21T19:08:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0003d80 con 0x7f7fb80b18d0 2023-07-21T19:08:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000abf0 con 0x7f7fb80b18d0 2023-07-21T19:08:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb80ca700 con 0x7f7fb80b18d0 2023-07-21T19:08:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80cacc0 con 0x7f7fb80b18d0 2023-07-21T19:08:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.228+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb80c6f60 con 0x7f7fb80b18d0 2023-07-21T19:08:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.232+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fb000ad50 con 0x7f7fb80b18d0 2023-07-21T19:08:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.232+0000 7f7fae7fc700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f9c0662f0 0x7f7f9c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.232+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fb0084160 con 0x7f7fb80b18d0 2023-07-21T19:08:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.232+0000 7f7fbddad700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f9c0662f0 0x7f7f9c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.232+0000 7f7fbddad700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f9c0662f0 0x7f7f9c0687a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009c30 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.236+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7fb0051260 con 0x7f7fb80b18d0 2023-07-21T19:08:07.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.448+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7fb804e500 con 0x7f7fb80b18d0 2023-07-21T19:08:07.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.620+0000 7f7fae7fc700 1 -- 172.21.15.123:0/3855722446 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7fb0054880 con 0x7f7fb80b18d0 2023-07-21T19:08:07.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f9c0662f0 msgr2=0x7f7f9c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f9c0662f0 0x7f7f9c0687a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009c30 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2023-07-21T19:08:07.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 msgr2=0x7f7fb80c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 0x7f7fb80c7940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000cbc0 tx=0x7f7fb000cf80 comp rx=0 tx=0).stop 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 shutdown_connections 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f9c0662f0 0x7f7f9c0687a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fb80b1380 0x7f7fb80c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb80b18d0 0x7f7fb80c7940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 --2- 172.21.15.123:0/3855722446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fb80b06c0 0x7f7fb81f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 >> 172.21.15.123:0/3855722446 conn(0x7f7fb8099600 msgr2=0x7f7fb80cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:07.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 shutdown_connections 2023-07-21T19:08:07.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.628+0000 7f7fbedaf700 1 -- 172.21.15.123:0/3855722446 wait complete. 2023-07-21T19:08:07.661 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-21T19:08:07.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T19:08:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.828+0000 7f36e4f86700 1 Processor -- start 2023-07-21T19:08:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36e4f86700 1 -- start start 2023-07-21T19:08:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36e4f86700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f36e00d0210 0x7f36e00d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36e4f86700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36e00cf000 0x7f36e00cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36e4f86700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e0071d10 con 0x7f36e00b1c50 2023-07-21T19:08:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36e4f86700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e00cf9a0 con 0x7f36e00cf000 2023-07-21T19:08:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36e4f86700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e015c420 con 0x7f36e00d0210 2023-07-21T19:08:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.832+0000 7f36ded9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36e00cf000 0x7f36e00cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36e00cf000 0x7f36e00cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58804/0 (socket says 172.21.15.123:58804) 2023-07-21T19:08:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 -- 172.21.15.123:0/2498222683 learned_addr learned my addr 172.21.15.123:0/2498222683 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ddd9b700 1 --2- 172.21.15.123:0/2498222683 >> v2:172.21.15.145:3300/0 conn(0x7f36e00d0210 0x7f36e00d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 -- 172.21.15.123:0/2498222683 >> v2:172.21.15.145:3300/0 conn(0x7f36e00d0210 msgr2=0x7f36e00d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 --2- 172.21.15.123:0/2498222683 >> v2:172.21.15.145:3300/0 conn(0x7f36e00d0210 0x7f36e00d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 -- 172.21.15.123:0/2498222683 >> v1:172.21.15.123:6789/0 conn(0x7f36e00b1c50 legacy=0x7f36e0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:07.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 -- 172.21.15.123:0/2498222683 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0070840 con 0x7f36e00cf000 2023-07-21T19:08:07.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36ded9d700 1 --2- 172.21.15.123:0/2498222683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00cf000 0x7f36e00cf460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36e006f910 tx=0x7f36d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0be95e7fdd0c5bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:07.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36dd59a700 1 -- 172.21.15.123:0/2498222683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800e070 con 0x7f36e00cf000 2023-07-21T19:08:07.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36dd59a700 1 -- 172.21.15.123:0/2498222683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8003a40 con 0x7f36e00cf000 2023-07-21T19:08:07.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36dd59a700 1 -- 172.21.15.123:0/2498222683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8003df0 con 0x7f36e00cf000 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 -- 172.21.15.123:0/2498222683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00cf000 msgr2=0x7f36e00cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 --2- 172.21.15.123:0/2498222683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00cf000 0x7f36e00cf460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36e006f910 tx=0x7f36d800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 -- 172.21.15.123:0/2498222683 shutdown_connections 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 --2- 172.21.15.123:0/2498222683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00cf000 0x7f36e00cf460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 --2- 172.21.15.123:0/2498222683 >> v2:172.21.15.145:3300/0 conn(0x7f36e00d0210 0x7f36e00d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 -- 172.21.15.123:0/2498222683 >> 172.21.15.123:0/2498222683 conn(0x7f36e009b9c0 msgr2=0x7f36e00d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:07.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 -- 172.21.15.123:0/2498222683 shutdown_connections 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.836+0000 7f36e4f86700 1 -- 172.21.15.123:0/2498222683 wait complete. 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.840+0000 7f36e4f86700 1 Processor -- start 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.840+0000 7f36e4f86700 1 -- start start 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.840+0000 7f36e4f86700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36e00b1c50 0x7f36e0149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.840+0000 7f36e4f86700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36e00cf000 0x7f36e0159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 0x7f36e01e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01e18c0 con 0x7f36e00d0210 2023-07-21T19:08:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01e12d0 con 0x7f36e00b1c50 2023-07-21T19:08:07.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01497a0 con 0x7f36e00cf000 2023-07-21T19:08:07.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 0x7f36e01e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 0x7f36e01e45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58810/0 (socket says 172.21.15.123:58810) 2023-07-21T19:08:07.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 -- 172.21.15.123:0/1556240283 learned_addr learned my addr 172.21.15.123:0/1556240283 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:07.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ddd9b700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36e00cf000 0x7f36e0159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36de59c700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36e00b1c50 0x7f36e0149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 -- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36e00cf000 msgr2=0x7f36e0159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36e00cf000 0x7f36e0159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 -- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36e00b1c50 msgr2=0x7f36e0149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:07.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36e00b1c50 0x7f36e0149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:07.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 -- 172.21.15.123:0/1556240283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8009b30 con 0x7f36e00d0210 2023-07-21T19:08:07.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ded9d700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 0x7f36e01e45c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36d8015040 tx=0x7f36d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:07.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8004440 con 0x7f36e00d0210 2023-07-21T19:08:07.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d80045c0 con 0x7f36e00d0210 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e014c0f0 con 0x7f36e00d0210 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8004970 con 0x7f36e00d0210 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e01e3b00 con 0x7f36e00d0210 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.844+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e01e3d20 con 0x7f36e00d0210 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.848+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36d8012430 con 0x7f36e00d0210 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.852+0000 7f36ceffd700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f36c00662f0 0x7f36c00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.852+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36d80852b0 con 0x7f36e00d0210 2023-07-21T19:08:07.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.852+0000 7f36de59c700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f36c00662f0 0x7f36c00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:07.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.852+0000 7f36de59c700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f36c00662f0 0x7f36c00687a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36d0004f70 tx=0x7f36d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:07.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:07.856+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36d8052430 con 0x7f36e00d0210 2023-07-21T19:08:08.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.068+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f36e01e1a00 con 0x7f36e00d0210 2023-07-21T19:08:08.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.636+0000 7f36ceffd700 1 -- 172.21.15.123:0/1556240283 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36e01e1a00 con 0x7f36e00d0210 2023-07-21T19:08:08.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f36c00662f0 msgr2=0x7f36c00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:08.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f36c00662f0 0x7f36c00687a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36d0004f70 tx=0x7f36d0009040 comp rx=0 tx=0).stop 2023-07-21T19:08:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 msgr2=0x7f36e01e45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 0x7f36e01e45c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36d8015040 tx=0x7f36d8004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 shutdown_connections 2023-07-21T19:08:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f36c00662f0 0x7f36c00687a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36e00d0210 0x7f36e01e45c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36e00cf000 0x7f36e0159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 --2- 172.21.15.123:0/1556240283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36e00b1c50 0x7f36e0149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 >> 172.21.15.123:0/1556240283 conn(0x7f36e009b9c0 msgr2=0x7f36e00b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:08.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 shutdown_connections 2023-07-21T19:08:08.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.640+0000 7f36e4f86700 1 -- 172.21.15.123:0/1556240283 wait complete. 2023-07-21T19:08:08.675 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T19:08:08.675 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:08:08.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.836+0000 7f1118865700 1 Processor -- start 2023-07-21T19:08:08.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.836+0000 7f1118865700 1 -- start start 2023-07-21T19:08:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1118865700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f11141457d0 0x7f111406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1118865700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f111406cd00 0x7f111406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1118865700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140cc9c0 con 0x7f111406eea0 2023-07-21T19:08:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1118865700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111406f340 con 0x7f11141457d0 2023-07-21T19:08:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1118865700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111406dab0 con 0x7f111406cd00 2023-07-21T19:08:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f111259c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f11141457d0 0x7f111406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f111259c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f11141457d0 0x7f111406c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44014/0 (socket says 172.21.15.123:44014) 2023-07-21T19:08:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1111d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f111406cd00 0x7f111406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f111259c700 1 -- 172.21.15.123:0/1338489129 learned_addr learned my addr 172.21.15.123:0/1338489129 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.840+0000 7f1112d9d700 1 --1- 172.21.15.123:0/1338489129 >> v1:172.21.15.145:6789/0 conn(0x7f111406eea0 0x7f11140cb2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:46958/0 (socket says 172.21.15.123:46958) 2023-07-21T19:08:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111259c700 1 -- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f111406cd00 msgr2=0x7f111406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111259c700 1 --2- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f111406cd00 0x7f111406e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111259c700 1 -- 172.21.15.123:0/1338489129 >> v1:172.21.15.145:6789/0 conn(0x7f111406eea0 legacy=0x7f11140cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111259c700 1 -- 172.21.15.123:0/1338489129 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111406d210 con 0x7f11141457d0 2023-07-21T19:08:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111159a700 1 -- 172.21.15.123:0/1338489129 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167572514 0 0) 0x7f11140cc9c0 con 0x7f111406eea0 2023-07-21T19:08:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111259c700 1 --2- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11141457d0 0x7f111406c7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1104009910 tx=0x7f1104009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e1de1787f0436e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111159a700 1 -- 172.21.15.123:0/1338489129 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104011830 con 0x7f11141457d0 2023-07-21T19:08:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111159a700 1 -- 172.21.15.123:0/1338489129 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104011990 con 0x7f11141457d0 2023-07-21T19:08:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f111159a700 1 -- 172.21.15.123:0/1338489129 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104011d40 con 0x7f11141457d0 2023-07-21T19:08:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 -- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11141457d0 msgr2=0x7f111406c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 --2- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11141457d0 0x7f111406c7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1104009910 tx=0x7f1104009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 -- 172.21.15.123:0/1338489129 shutdown_connections 2023-07-21T19:08:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 --2- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f111406cd00 0x7f111406e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 --2- 172.21.15.123:0/1338489129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11141457d0 0x7f111406c7c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 -- 172.21.15.123:0/1338489129 >> 172.21.15.123:0/1338489129 conn(0x7f1114069800 msgr2=0x7f1114069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:08.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 -- 172.21.15.123:0/1338489129 shutdown_connections 2023-07-21T19:08:08.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.844+0000 7f1118865700 1 -- 172.21.15.123:0/1338489129 wait complete. 2023-07-21T19:08:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.848+0000 7f1118865700 1 Processor -- start 2023-07-21T19:08:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.848+0000 7f1118865700 1 -- start start 2023-07-21T19:08:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 0x7f11140b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f111406eea0 0x7f1114139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:08.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11141457d0 0x7f111413a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:08.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111413a800 con 0x7f111406cd00 2023-07-21T19:08:08.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141e4330 con 0x7f111406eea0 2023-07-21T19:08:08.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11141e4610 con 0x7f11141457d0 2023-07-21T19:08:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 0x7f11140b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 0x7f11140b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58814/0 (socket says 172.21.15.123:58814) 2023-07-21T19:08:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 -- 172.21.15.123:0/3805655621 learned_addr learned my addr 172.21.15.123:0/3805655621 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1112d9d700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11141457d0 0x7f111413a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1111d9b700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f111406eea0 0x7f1114139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 -- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11141457d0 msgr2=0x7f111413a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11141457d0 0x7f111413a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 -- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f111406eea0 msgr2=0x7f1114139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f111406eea0 0x7f1114139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 -- 172.21.15.123:0/3805655621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104009570 con 0x7f111406cd00 2023-07-21T19:08:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f111259c700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 0x7f11140b3430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f111406dfe0 tx=0x7f1104004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400b970 con 0x7f111406cd00 2023-07-21T19:08:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110401f070 con 0x7f111406cd00 2023-07-21T19:08:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11141e48f0 con 0x7f111406cd00 2023-07-21T19:08:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400bcf0 con 0x7f111406cd00 2023-07-21T19:08:08.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.852+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11141e4eb0 con 0x7f111406cd00 2023-07-21T19:08:08.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.856+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111404dcb0 con 0x7f111406cd00 2023-07-21T19:08:08.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.856+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1104026480 con 0x7f111406cd00 2023-07-21T19:08:08.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.860+0000 7f1102ffd700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f40662f0 0x7f10f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:08.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.860+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1104021070 con 0x7f111406cd00 2023-07-21T19:08:08.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.860+0000 7f1111d9b700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f40662f0 0x7f10f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.860+0000 7f1111d9b700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f40662f0 0x7f10f40687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11140b4b50 tx=0x7f1108009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:08.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:08.864+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1104052a10 con 0x7f111406cd00 2023-07-21T19:08:09.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.072+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11140c9280 con 0x7f111406cd00 2023-07-21T19:08:09.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.076+0000 7f1102ffd700 1 -- 172.21.15.123:0/3805655621 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f1104056030 con 0x7f111406cd00 2023-07-21T19:08:09.088 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:09.089 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:08:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f40662f0 msgr2=0x7f10f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f40662f0 0x7f10f40687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11140b4b50 tx=0x7f1108009240 comp rx=0 tx=0).stop 2023-07-21T19:08:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 msgr2=0x7f11140b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 0x7f11140b3430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f111406dfe0 tx=0x7f1104004770 comp rx=0 tx=0).stop 2023-07-21T19:08:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 shutdown_connections 2023-07-21T19:08:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f40662f0 0x7f10f40687a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f111406eea0 0x7f1114139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11141457d0 0x7f111413a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 --2- 172.21.15.123:0/3805655621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f111406cd00 0x7f11140b3430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 >> 172.21.15.123:0/3805655621 conn(0x7f1114069800 msgr2=0x7f11140cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:09.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 shutdown_connections 2023-07-21T19:08:09.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.080+0000 7f1118865700 1 -- 172.21.15.123:0/3805655621 wait complete. 2023-07-21T19:08:09.095 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:08:09.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:09.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 Processor -- start 2023-07-21T19:08:09.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 -- start start 2023-07-21T19:08:09.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe000c86b0 0x7fbe000c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbe000cb100 0x7fbe0006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe000cbf80 con 0x7fbe00158370 2023-07-21T19:08:09.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000cbc30 con 0x7fbe000c86b0 2023-07-21T19:08:09.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe058b7700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000c8fc0 con 0x7fbe000cb100 2023-07-21T19:08:09.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbdf7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbe00158370 0x7fbe0015bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38038/0 (socket says 172.21.15.123:38038) 2023-07-21T19:08:09.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbdf7fff700 1 -- 172.21.15.123:0/2068239470 learned_addr learned my addr 172.21.15.123:0/2068239470 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:09.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe048b5700 1 --2- 172.21.15.123:0/2068239470 >> v2:172.21.15.123:3300/0 conn(0x7fbe000c86b0 0x7fbe000c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe050b6700 1 --2- 172.21.15.123:0/2068239470 >> v2:172.21.15.145:3300/0 conn(0x7fbe000cb100 0x7fbe0006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbdf77fe700 1 -- 172.21.15.123:0/2068239470 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474996842 0 0) 0x7fbe000cbf80 con 0x7fbe00158370 2023-07-21T19:08:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbdf77fe700 1 -- 172.21.15.123:0/2068239470 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde80035d0 con 0x7fbe00158370 2023-07-21T19:08:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe048b5700 1 -- 172.21.15.123:0/2068239470 >> v2:172.21.15.145:3300/0 conn(0x7fbe000cb100 msgr2=0x7fbe0006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe048b5700 1 --2- 172.21.15.123:0/2068239470 >> v2:172.21.15.145:3300/0 conn(0x7fbe000cb100 0x7fbe0006bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe048b5700 1 -- 172.21.15.123:0/2068239470 >> v1:172.21.15.123:6789/0 conn(0x7fbe00158370 legacy=0x7fbe0015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.268+0000 7fbe048b5700 1 -- 172.21.15.123:0/2068239470 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0015c4d0 con 0x7fbe000c86b0 2023-07-21T19:08:09.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe048b5700 1 --2- 172.21.15.123:0/2068239470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe000c8a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009850 tx=0x7fbdfc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881f575d62c670b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:09.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbdf77fe700 1 -- 172.21.15.123:0/2068239470 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011830 con 0x7fbe000c86b0 2023-07-21T19:08:09.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbdf77fe700 1 -- 172.21.15.123:0/2068239470 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc011990 con 0x7fbe000c86b0 2023-07-21T19:08:09.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbdf77fe700 1 -- 172.21.15.123:0/2068239470 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011d20 con 0x7fbe000c86b0 2023-07-21T19:08:09.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 -- 172.21.15.123:0/2068239470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 msgr2=0x7fbe000c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 --2- 172.21.15.123:0/2068239470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe000c8a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009850 tx=0x7fbdfc009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 -- 172.21.15.123:0/2068239470 shutdown_connections 2023-07-21T19:08:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 --2- 172.21.15.123:0/2068239470 >> v2:172.21.15.145:3300/0 conn(0x7fbe000cb100 0x7fbe0006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 --2- 172.21.15.123:0/2068239470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe000c8a80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 -- 172.21.15.123:0/2068239470 >> 172.21.15.123:0/2068239470 conn(0x7fbe0006e960 msgr2=0x7fbe0006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 -- 172.21.15.123:0/2068239470 shutdown_connections 2023-07-21T19:08:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.272+0000 7fbe058b7700 1 -- 172.21.15.123:0/2068239470 wait complete. 2023-07-21T19:08:09.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.276+0000 7fbe058b7700 1 Processor -- start 2023-07-21T19:08:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.276+0000 7fbe058b7700 1 -- start start 2023-07-21T19:08:09.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe00158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cb100 0x7fbe0014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe00158370 0x7fbe0014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c1100 con 0x7fbe000c86b0 2023-07-21T19:08:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c6c30 con 0x7fbe000cb100 2023-07-21T19:08:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00166850 con 0x7fbe00158370 2023-07-21T19:08:09.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe00158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe00158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58834/0 (socket says 172.21.15.123:58834) 2023-07-21T19:08:09.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 -- 172.21.15.123:0/3424429218 learned_addr learned my addr 172.21.15.123:0/3424429218 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:09.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbdf7fff700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cb100 0x7fbe0014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe050b6700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe00158370 0x7fbe0014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 -- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe00158370 msgr2=0x7fbe0014fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe00158370 0x7fbe0014fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 -- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cb100 msgr2=0x7fbe0014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cb100 0x7fbe0014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 -- 172.21.15.123:0/3424429218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0094b0 con 0x7fbe000c86b0 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe048b5700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe00158cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0090b0 tx=0x7fbdfc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:09.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0036c0 con 0x7fbe000c86b0 2023-07-21T19:08:09.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc01e070 con 0x7fbe000c86b0 2023-07-21T19:08:09.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe000c1350 con 0x7fbe000c86b0 2023-07-21T19:08:09.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc003a60 con 0x7fbe000c86b0 2023-07-21T19:08:09.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.280+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe00149ff0 con 0x7fbe000c86b0 2023-07-21T19:08:09.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.284+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00166d50 con 0x7fbe000c86b0 2023-07-21T19:08:09.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.284+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbdfc003bc0 con 0x7fbe000c86b0 2023-07-21T19:08:09.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.288+0000 7fbdf57fa700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdec066320 0x7fbdec0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.288+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbdfc0850d0 con 0x7fbe000c86b0 2023-07-21T19:08:09.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.288+0000 7fbdf7fff700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdec066320 0x7fbdec0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.288+0000 7fbdf7fff700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdec066320 0x7fbdec0687d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe000cd5e0 tx=0x7fbdf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:09.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.292+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbdfc052250 con 0x7fbe000c86b0 2023-07-21T19:08:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.468+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe0014a240 con 0x7fbe000c86b0 2023-07-21T19:08:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.472+0000 7fbdf57fa700 1 -- 172.21.15.123:0/3424429218 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fbe0014a240 con 0x7fbe000c86b0 2023-07-21T19:08:09.484 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:09.485 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdec066320 msgr2=0x7fbdec0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdec066320 0x7fbdec0687d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe000cd5e0 tx=0x7fbdf0009040 comp rx=0 tx=0).stop 2023-07-21T19:08:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 msgr2=0x7fbe00158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe00158cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0090b0 tx=0x7fbdfc004770 comp rx=0 tx=0).stop 2023-07-21T19:08:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 shutdown_connections 2023-07-21T19:08:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdec066320 0x7fbdec0687d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cb100 0x7fbe0014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe00158370 0x7fbe0014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 --2- 172.21.15.123:0/3424429218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe000c86b0 0x7fbe00158cc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 >> 172.21.15.123:0/3424429218 conn(0x7fbe0006e960 msgr2=0x7fbe000ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 shutdown_connections 2023-07-21T19:08:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.476+0000 7fbe058b7700 1 -- 172.21.15.123:0/3424429218 wait complete. 2023-07-21T19:08:09.509 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T19:08:09.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T19:08:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.668+0000 7f26229d2700 1 Processor -- start 2023-07-21T19:08:09.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.668+0000 7f26229d2700 1 -- start start 2023-07-21T19:08:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26229d2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 0x7f261c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26229d2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f261c0ce060 0x7f261c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26229d2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0cbf80 con 0x7f261c158370 2023-07-21T19:08:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26229d2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0cbc30 con 0x7f261c0ce060 2023-07-21T19:08:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26229d2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15c4d0 con 0x7f261c0cb100 2023-07-21T19:08:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26219d0700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f261c158370 0x7f261c15bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38052/0 (socket says 172.21.15.123:38052) 2023-07-21T19:08:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26219d0700 1 -- 172.21.15.123:0/27777513 learned_addr learned my addr 172.21.15.123:0/27777513 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 0x7f261c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26221d1700 1 --2- 172.21.15.123:0/27777513 >> v2:172.21.15.145:3300/0 conn(0x7f261c0ce060 0x7f261c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593740305 0 0) 0x7f261c0cbf80 con 0x7f261c158370 2023-07-21T19:08:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26080035d0 con 0x7f261c158370 2023-07-21T19:08:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3314848169 0 0) 0x7f26080035d0 con 0x7f261c158370 2023-07-21T19:08:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 msgr2=0x7f261c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 0x7f261c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 >> v2:172.21.15.145:3300/0 conn(0x7f261c0ce060 msgr2=0x7f261c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 --2- 172.21.15.123:0/27777513 >> v2:172.21.15.145:3300/0 conn(0x7f261c0ce060 0x7f261c0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c15c7b0 con 0x7f261c158370 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f2618001670 con 0x7f261c158370 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 >> v1:172.21.15.123:6789/0 conn(0x7f261c158370 legacy=0x7f261c15bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2608003a50 0x7f2608003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2608004870 0x7f2608004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 0x7f2608005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0cbc30 con 0x7f2608004870 2023-07-21T19:08:09.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15c4d0 con 0x7f2608003a50 2023-07-21T19:08:09.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260800ba30 con 0x7f261c0cb100 2023-07-21T19:08:09.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2608004870 0x7f2608004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 -- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 msgr2=0x7f2608005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c0cb100 0x7f2608005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 -- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2608003a50 msgr2=0x7f2608003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2608003a50 0x7f2608003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 -- 172.21.15.123:0/27777513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080035d0 con 0x7f2608004870 2023-07-21T19:08:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26211cf700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2608004870 0x7f2608004ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f260c009b40 tx=0x7f26080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4f61d2a2041065 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00e6c0 con 0x7f2608004870 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00e820 con 0x7f2608004870 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.672+0000 7f26209ce700 1 -- 172.21.15.123:0/27777513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00eb90 con 0x7f2608004870 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 -- 172.21.15.123:0/27777513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2608004870 msgr2=0x7f2608004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 --2- 172.21.15.123:0/27777513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2608004870 0x7f2608004ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f260c009b40 tx=0x7f26080058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26221d1700 1 -- 172.21.15.123:0/27777513 reap_dead start 2023-07-21T19:08:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 -- 172.21.15.123:0/27777513 shutdown_connections 2023-07-21T19:08:09.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 -- 172.21.15.123:0/27777513 >> 172.21.15.123:0/27777513 conn(0x7f261c06e960 msgr2=0x7f261c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:09.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 -- 172.21.15.123:0/27777513 shutdown_connections 2023-07-21T19:08:09.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 -- 172.21.15.123:0/27777513 wait complete. 2023-07-21T19:08:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.676+0000 7f26229d2700 1 Processor -- start 2023-07-21T19:08:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 -- start start 2023-07-21T19:08:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 0x7f261c0c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c145040 0x7f261c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261c148ec0 0x7f261c144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c144e70 con 0x7f261c148af0 2023-07-21T19:08:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c146940 con 0x7f261c148ec0 2023-07-21T19:08:09.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b2ef0 con 0x7f261c145040 2023-07-21T19:08:09.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 0x7f261c0c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 0x7f261c0c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58844/0 (socket says 172.21.15.123:58844) 2023-07-21T19:08:09.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 -- 172.21.15.123:0/2322862655 learned_addr learned my addr 172.21.15.123:0/2322862655 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:09.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26211cf700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c145040 0x7f261c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26221d1700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261c148ec0 0x7f261c144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 -- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c145040 msgr2=0x7f261c1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c145040 0x7f261c1443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 -- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261c148ec0 msgr2=0x7f261c144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261c148ec0 0x7f261c144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 -- 172.21.15.123:0/2322862655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0b31d0 con 0x7f261c148af0 2023-07-21T19:08:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26219d0700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 0x7f261c0c5310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f261800ca70 tx=0x7f261800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800cea0 con 0x7f261c148af0 2023-07-21T19:08:09.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618004d60 con 0x7f261c148af0 2023-07-21T19:08:09.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c146bb0 con 0x7f261c148af0 2023-07-21T19:08:09.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618007310 con 0x7f261c148af0 2023-07-21T19:08:09.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.680+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c0b34b0 con 0x7f261c148af0 2023-07-21T19:08:09.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.684+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c1470d0 con 0x7f261c148af0 2023-07-21T19:08:09.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.684+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2618007470 con 0x7f261c148af0 2023-07-21T19:08:09.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.688+0000 7f26127fc700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f26000662f0 0x7f26000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:09.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.688+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f26180836d0 con 0x7f261c148af0 2023-07-21T19:08:09.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.688+0000 7f26211cf700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f26000662f0 0x7f26000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:09.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.688+0000 7f26211cf700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f26000662f0 0x7f26000687a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f261c04f520 tx=0x7f260c01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:09.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.692+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f261c1470d0 con 0x7f261c148af0 2023-07-21T19:08:09.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.864+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 --> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f261c15ca60 con 0x7f26000662f0 2023-07-21T19:08:09.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.884+0000 7f26127fc700 1 -- 172.21.15.123:0/2322862655 <== mgr.4104 v2:172.21.15.123:6832/1650121890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367168 (secure 0 0 0) 0x7f261c15ca60 con 0x7f26000662f0 2023-07-21T19:08:09.900 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:09.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f26000662f0 msgr2=0x7f26000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f26000662f0 0x7f26000687a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f261c04f520 tx=0x7f260c01f040 comp rx=0 tx=0).stop 2023-07-21T19:08:09.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 msgr2=0x7f261c0c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:09.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 0x7f261c0c5310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f261800ca70 tx=0x7f261800cd80 comp rx=0 tx=0).stop 2023-07-21T19:08:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 shutdown_connections 2023-07-21T19:08:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f26000662f0 0x7f26000687a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f261c148ec0 0x7f261c144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f261c145040 0x7f261c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 --2- 172.21.15.123:0/2322862655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f261c148af0 0x7f261c0c5310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:09.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 >> 172.21.15.123:0/2322862655 conn(0x7f261c06e960 msgr2=0x7f261c0cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:09.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 shutdown_connections 2023-07-21T19:08:09.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:09.892+0000 7f26229d2700 1 -- 172.21.15.123:0/2322862655 wait complete. 2023-07-21T19:08:09.909 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-07-21T19:08:09.928 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-07-21T19:08:07.884299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594818,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223304,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751416,"statfs":{"total":773094113280,"available":772865449984,"internally_reserved":0,"allocated":3678208,"data_stored":2186212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004390"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837152+0000","last_change":"2023-07-21T19:07:52.526013+0000","last_active":"2023-07-21T19:07:53.837152+0000","last_peered":"2023-07-21T19:07:53.837152+0000","last_clean":"2023-07-21T19:07:53.837152+0000","last_became_active":"2023-07-21T19:07:52.525619+0000","last_became_peered":"2023-07-21T19:07:52.525619+0000","last_unstale":"2023-07-21T19:07:53.837152+0000","last_undegraded":"2023-07-21T19:07:53.837152+0000","last_fullsized":"2023-07-21T19:07:53.837152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:21.893772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525160+0000","last_change":"2023-07-21T19:07:47.420098+0000","last_active":"2023-07-21T19:07:53.525160+0000","last_peered":"2023-07-21T19:07:53.525160+0000","last_clean":"2023-07-21T19:07:53.525160+0000","last_became_active":"2023-07-21T19:07:47.419764+0000","last_became_peered":"2023-07-21T19:07:47.419764+0000","last_unstale":"2023-07-21T19:07:53.525160+0000","last_undegraded":"2023-07-21T19:07:53.525160+0000","last_fullsized":"2023-07-21T19:07:53.525160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522584+0000","last_change":"2023-07-21T19:07:48.458192+0000","last_active":"2023-07-21T19:07:53.522584+0000","last_peered":"2023-07-21T19:07:53.522584+0000","last_clean":"2023-07-21T19:07:53.522584+0000","last_became_active":"2023-07-21T19:07:48.457841+0000","last_became_peered":"2023-07-21T19:07:48.457841+0000","last_unstale":"2023-07-21T19:07:53.522584+0000","last_undegraded":"2023-07-21T19:07:53.522584+0000","last_fullsized":"2023-07-21T19:07:53.522584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:34.793452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522466+0000","last_change":"2023-07-21T19:07:52.521292+0000","last_active":"2023-07-21T19:07:53.522466+0000","last_peered":"2023-07-21T19:07:53.522466+0000","last_clean":"2023-07-21T19:07:53.522466+0000","last_became_active":"2023-07-21T19:07:52.512373+0000","last_became_peered":"2023-07-21T19:07:52.512373+0000","last_unstale":"2023-07-21T19:07:53.522466+0000","last_undegraded":"2023-07-21T19:07:53.522466+0000","last_fullsized":"2023-07-21T19:07:53.522466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:16.920553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834575+0000","last_change":"2023-07-21T19:07:47.418823+0000","last_active":"2023-07-21T19:07:53.834575+0000","last_peered":"2023-07-21T19:07:53.834575+0000","last_clean":"2023-07-21T19:07:53.834575+0000","last_became_active":"2023-07-21T19:07:47.418529+0000","last_became_peered":"2023-07-21T19:07:47.418529+0000","last_unstale":"2023-07-21T19:07:53.834575+0000","last_undegraded":"2023-07-21T19:07:53.834575+0000","last_fullsized":"2023-07-21T19:07:53.834575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834847+0000","last_change":"2023-07-21T19:07:48.460406+0000","last_active":"2023-07-21T19:07:53.834847+0000","last_peered":"2023-07-21T19:07:53.834847+0000","last_clean":"2023-07-21T19:07:53.834847+0000","last_became_active":"2023-07-21T19:07:48.459868+0000","last_became_peered":"2023-07-21T19:07:48.459868+0000","last_unstale":"2023-07-21T19:07:53.834847+0000","last_undegraded":"2023-07-21T19:07:53.834847+0000","last_fullsized":"2023-07-21T19:07:53.834847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523950+0000","last_change":"2023-07-21T19:07:52.514421+0000","last_active":"2023-07-21T19:07:53.523950+0000","last_peered":"2023-07-21T19:07:53.523950+0000","last_clean":"2023-07-21T19:07:53.523950+0000","last_became_active":"2023-07-21T19:07:52.514037+0000","last_became_peered":"2023-07-21T19:07:52.514037+0000","last_unstale":"2023-07-21T19:07:53.523950+0000","last_undegraded":"2023-07-21T19:07:53.523950+0000","last_fullsized":"2023-07-21T19:07:53.523950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:16.918863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525195+0000","last_change":"2023-07-21T19:07:47.429875+0000","last_active":"2023-07-21T19:07:53.525195+0000","last_peered":"2023-07-21T19:07:53.525195+0000","last_clean":"2023-07-21T19:07:53.525195+0000","last_became_active":"2023-07-21T19:07:47.429597+0000","last_became_peered":"2023-07-21T19:07:47.429597+0000","last_unstale":"2023-07-21T19:07:53.525195+0000","last_undegraded":"2023-07-21T19:07:53.525195+0000","last_fullsized":"2023-07-21T19:07:53.525195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523434+0000","last_change":"2023-07-21T19:07:48.445883+0000","last_active":"2023-07-21T19:07:53.523434+0000","last_peered":"2023-07-21T19:07:53.523434+0000","last_clean":"2023-07-21T19:07:53.523434+0000","last_became_active":"2023-07-21T19:07:48.445660+0000","last_became_peered":"2023-07-21T19:07:48.445660+0000","last_unstale":"2023-07-21T19:07:53.523434+0000","last_undegraded":"2023-07-21T19:07:53.523434+0000","last_fullsized":"2023-07-21T19:07:53.523434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:52.906045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832775+0000","last_change":"2023-07-21T19:07:52.524081+0000","last_active":"2023-07-21T19:07:53.832775+0000","last_peered":"2023-07-21T19:07:53.832775+0000","last_clean":"2023-07-21T19:07:53.832775+0000","last_became_active":"2023-07-21T19:07:52.523354+0000","last_became_peered":"2023-07-21T19:07:52.523354+0000","last_unstale":"2023-07-21T19:07:53.832775+0000","last_undegraded":"2023-07-21T19:07:53.832775+0000","last_fullsized":"2023-07-21T19:07:53.832775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524027+0000","last_change":"2023-07-21T19:07:47.429333+0000","last_active":"2023-07-21T19:07:53.524027+0000","last_peered":"2023-07-21T19:07:53.524027+0000","last_clean":"2023-07-21T19:07:53.524027+0000","last_became_active":"2023-07-21T19:07:47.428959+0000","last_became_peered":"2023-07-21T19:07:47.428959+0000","last_unstale":"2023-07-21T19:07:53.524027+0000","last_undegraded":"2023-07-21T19:07:53.524027+0000","last_fullsized":"2023-07-21T19:07:53.524027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524172+0000","last_change":"2023-07-21T19:07:48.454559+0000","last_active":"2023-07-21T19:07:53.524172+0000","last_peered":"2023-07-21T19:07:53.524172+0000","last_clean":"2023-07-21T19:07:53.524172+0000","last_became_active":"2023-07-21T19:07:48.454270+0000","last_became_peered":"2023-07-21T19:07:48.454270+0000","last_unstale":"2023-07-21T19:07:53.524172+0000","last_undegraded":"2023-07-21T19:07:53.524172+0000","last_fullsized":"2023-07-21T19:07:53.524172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:14.890349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838309+0000","last_change":"2023-07-21T19:07:52.521872+0000","last_active":"2023-07-21T19:07:53.838309+0000","last_peered":"2023-07-21T19:07:53.838309+0000","last_clean":"2023-07-21T19:07:53.838309+0000","last_became_active":"2023-07-21T19:07:52.521417+0000","last_became_peered":"2023-07-21T19:07:52.521417+0000","last_unstale":"2023-07-21T19:07:53.838309+0000","last_undegraded":"2023-07-21T19:07:53.838309+0000","last_fullsized":"2023-07-21T19:07:53.838309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:57.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524569+0000","last_change":"2023-07-21T19:07:47.435498+0000","last_active":"2023-07-21T19:07:53.524569+0000","last_peered":"2023-07-21T19:07:53.524569+0000","last_clean":"2023-07-21T19:07:53.524569+0000","last_became_active":"2023-07-21T19:07:47.435167+0000","last_became_peered":"2023-07-21T19:07:47.435167+0000","last_unstale":"2023-07-21T19:07:53.524569+0000","last_undegraded":"2023-07-21T19:07:53.524569+0000","last_fullsized":"2023-07-21T19:07:53.524569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:28.227019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838212+0000","last_change":"2023-07-21T19:07:48.464638+0000","last_active":"2023-07-21T19:07:53.838212+0000","last_peered":"2023-07-21T19:07:53.838212+0000","last_clean":"2023-07-21T19:07:53.838212+0000","last_became_active":"2023-07-21T19:07:48.463719+0000","last_became_peered":"2023-07-21T19:07:48.463719+0000","last_unstale":"2023-07-21T19:07:53.838212+0000","last_undegraded":"2023-07-21T19:07:53.838212+0000","last_fullsized":"2023-07-21T19:07:53.838212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:59.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524735+0000","last_change":"2023-07-21T19:07:52.520166+0000","last_active":"2023-07-21T19:07:53.524735+0000","last_peered":"2023-07-21T19:07:53.524735+0000","last_clean":"2023-07-21T19:07:53.524735+0000","last_became_active":"2023-07-21T19:07:52.519664+0000","last_became_peered":"2023-07-21T19:07:52.519664+0000","last_unstale":"2023-07-21T19:07:53.524735+0000","last_undegraded":"2023-07-21T19:07:53.524735+0000","last_fullsized":"2023-07-21T19:07:53.524735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:12.671068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523715+0000","last_change":"2023-07-21T19:07:47.428335+0000","last_active":"2023-07-21T19:07:53.523715+0000","last_peered":"2023-07-21T19:07:53.523715+0000","last_clean":"2023-07-21T19:07:53.523715+0000","last_became_active":"2023-07-21T19:07:47.428024+0000","last_became_peered":"2023-07-21T19:07:47.428024+0000","last_unstale":"2023-07-21T19:07:53.523715+0000","last_undegraded":"2023-07-21T19:07:53.523715+0000","last_fullsized":"2023-07-21T19:07:53.523715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:06.868264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835070+0000","last_change":"2023-07-21T19:07:48.460771+0000","last_active":"2023-07-21T19:07:53.835070+0000","last_peered":"2023-07-21T19:07:53.835070+0000","last_clean":"2023-07-21T19:07:53.835070+0000","last_became_active":"2023-07-21T19:07:48.460408+0000","last_became_peered":"2023-07-21T19:07:48.460408+0000","last_unstale":"2023-07-21T19:07:53.835070+0000","last_undegraded":"2023-07-21T19:07:53.835070+0000","last_fullsized":"2023-07-21T19:07:53.835070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834859+0000","last_change":"2023-07-21T19:07:52.515758+0000","last_active":"2023-07-21T19:07:53.834859+0000","last_peered":"2023-07-21T19:07:53.834859+0000","last_clean":"2023-07-21T19:07:53.834859+0000","last_became_active":"2023-07-21T19:07:52.515364+0000","last_became_peered":"2023-07-21T19:07:52.515364+0000","last_unstale":"2023-07-21T19:07:53.834859+0000","last_undegraded":"2023-07-21T19:07:53.834859+0000","last_fullsized":"2023-07-21T19:07:53.834859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:32.112276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838565+0000","last_change":"2023-07-21T19:07:47.432465+0000","last_active":"2023-07-21T19:07:53.838565+0000","last_peered":"2023-07-21T19:07:53.838565+0000","last_clean":"2023-07-21T19:07:53.838565+0000","last_became_active":"2023-07-21T19:07:47.432078+0000","last_became_peered":"2023-07-21T19:07:47.432078+0000","last_unstale":"2023-07-21T19:07:53.838565+0000","last_undegraded":"2023-07-21T19:07:53.838565+0000","last_fullsized":"2023-07-21T19:07:53.838565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524687+0000","last_change":"2023-07-21T19:07:48.460469+0000","last_active":"2023-07-21T19:07:53.524687+0000","last_peered":"2023-07-21T19:07:53.524687+0000","last_clean":"2023-07-21T19:07:53.524687+0000","last_became_active":"2023-07-21T19:07:48.460211+0000","last_became_peered":"2023-07-21T19:07:48.460211+0000","last_unstale":"2023-07-21T19:07:53.524687+0000","last_undegraded":"2023-07-21T19:07:53.524687+0000","last_fullsized":"2023-07-21T19:07:53.524687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525137+0000","last_change":"2023-07-21T19:07:52.515243+0000","last_active":"2023-07-21T19:07:53.525137+0000","last_peered":"2023-07-21T19:07:53.525137+0000","last_clean":"2023-07-21T19:07:53.525137+0000","last_became_active":"2023-07-21T19:07:52.514858+0000","last_became_peered":"2023-07-21T19:07:52.514858+0000","last_unstale":"2023-07-21T19:07:53.525137+0000","last_undegraded":"2023-07-21T19:07:53.525137+0000","last_fullsized":"2023-07-21T19:07:53.525137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:48.667564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834262+0000","last_change":"2023-07-21T19:07:47.423653+0000","last_active":"2023-07-21T19:07:53.834262+0000","last_peered":"2023-07-21T19:07:53.834262+0000","last_clean":"2023-07-21T19:07:53.834262+0000","last_became_active":"2023-07-21T19:07:47.423336+0000","last_became_peered":"2023-07-21T19:07:47.423336+0000","last_unstale":"2023-07-21T19:07:53.834262+0000","last_undegraded":"2023-07-21T19:07:53.834262+0000","last_fullsized":"2023-07-21T19:07:53.834262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:43.201925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835020+0000","last_change":"2023-07-21T19:07:48.453898+0000","last_active":"2023-07-21T19:07:53.835020+0000","last_peered":"2023-07-21T19:07:53.835020+0000","last_clean":"2023-07-21T19:07:53.835020+0000","last_became_active":"2023-07-21T19:07:48.453048+0000","last_became_peered":"2023-07-21T19:07:48.453048+0000","last_unstale":"2023-07-21T19:07:53.835020+0000","last_undegraded":"2023-07-21T19:07:53.835020+0000","last_fullsized":"2023-07-21T19:07:53.835020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:02.564475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833703+0000","last_change":"2023-07-21T19:07:48.467565+0000","last_active":"2023-07-21T19:07:53.833703+0000","last_peered":"2023-07-21T19:07:53.833703+0000","last_clean":"2023-07-21T19:07:53.833703+0000","last_became_active":"2023-07-21T19:07:48.467121+0000","last_became_peered":"2023-07-21T19:07:48.467121+0000","last_unstale":"2023-07-21T19:07:53.833703+0000","last_undegraded":"2023-07-21T19:07:53.833703+0000","last_fullsized":"2023-07-21T19:07:53.833703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525240+0000","last_change":"2023-07-21T19:07:47.419807+0000","last_active":"2023-07-21T19:07:53.525240+0000","last_peered":"2023-07-21T19:07:53.525240+0000","last_clean":"2023-07-21T19:07:53.525240+0000","last_became_active":"2023-07-21T19:07:47.419458+0000","last_became_peered":"2023-07-21T19:07:47.419458+0000","last_unstale":"2023-07-21T19:07:53.525240+0000","last_undegraded":"2023-07-21T19:07:53.525240+0000","last_fullsized":"2023-07-21T19:07:53.525240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832798+0000","last_change":"2023-07-21T19:07:52.512833+0000","last_active":"2023-07-21T19:07:53.832798+0000","last_peered":"2023-07-21T19:07:53.832798+0000","last_clean":"2023-07-21T19:07:53.832798+0000","last_became_active":"2023-07-21T19:07:52.512452+0000","last_became_peered":"2023-07-21T19:07:52.512452+0000","last_unstale":"2023-07-21T19:07:53.832798+0000","last_undegraded":"2023-07-21T19:07:53.832798+0000","last_fullsized":"2023-07-21T19:07:53.832798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:18.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834692+0000","last_change":"2023-07-21T19:07:48.455667+0000","last_active":"2023-07-21T19:07:53.834692+0000","last_peered":"2023-07-21T19:07:53.834692+0000","last_clean":"2023-07-21T19:07:53.834692+0000","last_became_active":"2023-07-21T19:07:48.455414+0000","last_became_peered":"2023-07-21T19:07:48.455414+0000","last_unstale":"2023-07-21T19:07:53.834692+0000","last_undegraded":"2023-07-21T19:07:53.834692+0000","last_fullsized":"2023-07-21T19:07:53.834692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:59.756485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524944+0000","last_change":"2023-07-21T19:07:47.419752+0000","last_active":"2023-07-21T19:07:53.524944+0000","last_peered":"2023-07-21T19:07:53.524944+0000","last_clean":"2023-07-21T19:07:53.524944+0000","last_became_active":"2023-07-21T19:07:47.419344+0000","last_became_peered":"2023-07-21T19:07:47.419344+0000","last_unstale":"2023-07-21T19:07:53.524944+0000","last_undegraded":"2023-07-21T19:07:53.524944+0000","last_fullsized":"2023-07-21T19:07:53.524944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:35.799862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833166+0000","last_change":"2023-07-21T19:07:52.535682+0000","last_active":"2023-07-21T19:07:53.833166+0000","last_peered":"2023-07-21T19:07:53.833166+0000","last_clean":"2023-07-21T19:07:53.833166+0000","last_became_active":"2023-07-21T19:07:52.534938+0000","last_became_peered":"2023-07-21T19:07:52.534938+0000","last_unstale":"2023-07-21T19:07:53.833166+0000","last_undegraded":"2023-07-21T19:07:53.833166+0000","last_fullsized":"2023-07-21T19:07:53.833166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833508+0000","last_change":"2023-07-21T19:07:47.428893+0000","last_active":"2023-07-21T19:07:53.833508+0000","last_peered":"2023-07-21T19:07:53.833508+0000","last_clean":"2023-07-21T19:07:53.833508+0000","last_became_active":"2023-07-21T19:07:47.428562+0000","last_became_peered":"2023-07-21T19:07:47.428562+0000","last_unstale":"2023-07-21T19:07:53.833508+0000","last_undegraded":"2023-07-21T19:07:53.833508+0000","last_fullsized":"2023-07-21T19:07:53.833508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:26.575918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838495+0000","last_change":"2023-07-21T19:07:48.458970+0000","last_active":"2023-07-21T19:07:53.838495+0000","last_peered":"2023-07-21T19:07:53.838495+0000","last_clean":"2023-07-21T19:07:53.838495+0000","last_became_active":"2023-07-21T19:07:48.458737+0000","last_became_peered":"2023-07-21T19:07:48.458737+0000","last_unstale":"2023-07-21T19:07:53.838495+0000","last_undegraded":"2023-07-21T19:07:53.838495+0000","last_fullsized":"2023-07-21T19:07:53.838495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833652+0000","last_change":"2023-07-21T19:07:52.529054+0000","last_active":"2023-07-21T19:07:53.833652+0000","last_peered":"2023-07-21T19:07:53.833652+0000","last_clean":"2023-07-21T19:07:53.833652+0000","last_became_active":"2023-07-21T19:07:52.528619+0000","last_became_peered":"2023-07-21T19:07:52.528619+0000","last_unstale":"2023-07-21T19:07:53.833652+0000","last_undegraded":"2023-07-21T19:07:53.833652+0000","last_fullsized":"2023-07-21T19:07:53.833652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:44.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:58.159490+0000","last_change":"2023-07-21T19:07:47.424409+0000","last_active":"2023-07-21T19:07:58.159490+0000","last_peered":"2023-07-21T19:07:58.159490+0000","last_clean":"2023-07-21T19:07:58.159490+0000","last_became_active":"2023-07-21T19:07:47.424101+0000","last_became_peered":"2023-07-21T19:07:47.424101+0000","last_unstale":"2023-07-21T19:07:58.159490+0000","last_undegraded":"2023-07-21T19:07:58.159490+0000","last_fullsized":"2023-07-21T19:07:58.159490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:06:04.934694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524300+0000","last_change":"2023-07-21T19:07:48.458540+0000","last_active":"2023-07-21T19:07:53.524300+0000","last_peered":"2023-07-21T19:07:53.524300+0000","last_clean":"2023-07-21T19:07:53.524300+0000","last_became_active":"2023-07-21T19:07:48.458216+0000","last_became_peered":"2023-07-21T19:07:48.458216+0000","last_unstale":"2023-07-21T19:07:53.524300+0000","last_undegraded":"2023-07-21T19:07:53.524300+0000","last_fullsized":"2023-07-21T19:07:53.524300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:04.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838155+0000","last_change":"2023-07-21T19:07:52.525973+0000","last_active":"2023-07-21T19:07:53.838155+0000","last_peered":"2023-07-21T19:07:53.838155+0000","last_clean":"2023-07-21T19:07:53.838155+0000","last_became_active":"2023-07-21T19:07:52.525557+0000","last_became_peered":"2023-07-21T19:07:52.525557+0000","last_unstale":"2023-07-21T19:07:53.838155+0000","last_undegraded":"2023-07-21T19:07:53.838155+0000","last_fullsized":"2023-07-21T19:07:53.838155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:04.238744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522891+0000","last_change":"2023-07-21T19:07:48.450182+0000","last_active":"2023-07-21T19:07:53.522891+0000","last_peered":"2023-07-21T19:07:53.522891+0000","last_clean":"2023-07-21T19:07:53.522891+0000","last_became_active":"2023-07-21T19:07:48.449903+0000","last_became_peered":"2023-07-21T19:07:48.449903+0000","last_unstale":"2023-07-21T19:07:53.522891+0000","last_undegraded":"2023-07-21T19:07:53.522891+0000","last_fullsized":"2023-07-21T19:07:53.522891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:58.318651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835029+0000","last_change":"2023-07-21T19:07:42.363227+0000","last_active":"2023-07-21T19:07:53.835029+0000","last_peered":"2023-07-21T19:07:53.835029+0000","last_clean":"2023-07-21T19:07:53.835029+0000","last_became_active":"2023-07-21T19:07:42.362873+0000","last_became_peered":"2023-07-21T19:07:42.362873+0000","last_unstale":"2023-07-21T19:07:53.835029+0000","last_undegraded":"2023-07-21T19:07:53.835029+0000","last_fullsized":"2023-07-21T19:07:53.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:40.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525002+0000","last_change":"2023-07-21T19:07:47.423281+0000","last_active":"2023-07-21T19:07:53.525002+0000","last_peered":"2023-07-21T19:07:53.525002+0000","last_clean":"2023-07-21T19:07:53.525002+0000","last_became_active":"2023-07-21T19:07:47.422972+0000","last_became_peered":"2023-07-21T19:07:47.422972+0000","last_unstale":"2023-07-21T19:07:53.525002+0000","last_undegraded":"2023-07-21T19:07:53.525002+0000","last_fullsized":"2023-07-21T19:07:53.525002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833700+0000","last_change":"2023-07-21T19:07:52.538404+0000","last_active":"2023-07-21T19:07:53.833700+0000","last_peered":"2023-07-21T19:07:53.833700+0000","last_clean":"2023-07-21T19:07:53.833700+0000","last_became_active":"2023-07-21T19:07:52.537940+0000","last_became_peered":"2023-07-21T19:07:52.537940+0000","last_unstale":"2023-07-21T19:07:53.833700+0000","last_undegraded":"2023-07-21T19:07:53.833700+0000","last_fullsized":"2023-07-21T19:07:53.833700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833968+0000","last_change":"2023-07-21T19:07:48.462660+0000","last_active":"2023-07-21T19:07:53.833968+0000","last_peered":"2023-07-21T19:07:53.833968+0000","last_clean":"2023-07-21T19:07:53.833968+0000","last_became_active":"2023-07-21T19:07:48.461577+0000","last_became_peered":"2023-07-21T19:07:48.461577+0000","last_unstale":"2023-07-21T19:07:53.833968+0000","last_undegraded":"2023-07-21T19:07:53.833968+0000","last_fullsized":"2023-07-21T19:07:53.833968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838321+0000","last_change":"2023-07-21T19:07:42.367585+0000","last_active":"2023-07-21T19:07:53.838321+0000","last_peered":"2023-07-21T19:07:53.838321+0000","last_clean":"2023-07-21T19:07:53.838321+0000","last_became_active":"2023-07-21T19:07:42.367246+0000","last_became_peered":"2023-07-21T19:07:42.367246+0000","last_unstale":"2023-07-21T19:07:53.838321+0000","last_undegraded":"2023-07-21T19:07:53.838321+0000","last_fullsized":"2023-07-21T19:07:53.838321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:03.305963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835676+0000","last_change":"2023-07-21T19:07:47.423871+0000","last_active":"2023-07-21T19:07:53.835676+0000","last_peered":"2023-07-21T19:07:53.835676+0000","last_clean":"2023-07-21T19:07:53.835676+0000","last_became_active":"2023-07-21T19:07:47.423601+0000","last_became_peered":"2023-07-21T19:07:47.423601+0000","last_unstale":"2023-07-21T19:07:53.835676+0000","last_undegraded":"2023-07-21T19:07:53.835676+0000","last_fullsized":"2023-07-21T19:07:53.835676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522467+0000","last_change":"2023-07-21T19:07:52.520565+0000","last_active":"2023-07-21T19:07:53.522467+0000","last_peered":"2023-07-21T19:07:53.522467+0000","last_clean":"2023-07-21T19:07:53.522467+0000","last_became_active":"2023-07-21T19:07:52.519706+0000","last_became_peered":"2023-07-21T19:07:52.519706+0000","last_unstale":"2023-07-21T19:07:53.522467+0000","last_undegraded":"2023-07-21T19:07:53.522467+0000","last_fullsized":"2023-07-21T19:07:53.522467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:16.197136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523919+0000","last_change":"2023-07-21T19:07:48.453983+0000","last_active":"2023-07-21T19:07:53.523919+0000","last_peered":"2023-07-21T19:07:53.523919+0000","last_clean":"2023-07-21T19:07:53.523919+0000","last_became_active":"2023-07-21T19:07:48.453574+0000","last_became_peered":"2023-07-21T19:07:48.453574+0000","last_unstale":"2023-07-21T19:07:53.523919+0000","last_undegraded":"2023-07-21T19:07:53.523919+0000","last_fullsized":"2023-07-21T19:07:53.523919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833947+0000","last_change":"2023-07-21T19:07:42.365391+0000","last_active":"2023-07-21T19:07:53.833947+0000","last_peered":"2023-07-21T19:07:53.833947+0000","last_clean":"2023-07-21T19:07:53.833947+0000","last_became_active":"2023-07-21T19:07:42.364406+0000","last_became_peered":"2023-07-21T19:07:42.364406+0000","last_unstale":"2023-07-21T19:07:53.833947+0000","last_undegraded":"2023-07-21T19:07:53.833947+0000","last_fullsized":"2023-07-21T19:07:53.833947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:30.769824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837437+0000","last_change":"2023-07-21T19:07:47.425674+0000","last_active":"2023-07-21T19:07:53.837437+0000","last_peered":"2023-07-21T19:07:53.837437+0000","last_clean":"2023-07-21T19:07:53.837437+0000","last_became_active":"2023-07-21T19:07:47.425400+0000","last_became_peered":"2023-07-21T19:07:47.425400+0000","last_unstale":"2023-07-21T19:07:53.837437+0000","last_undegraded":"2023-07-21T19:07:53.837437+0000","last_fullsized":"2023-07-21T19:07:53.837437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:35.849154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832757+0000","last_change":"2023-07-21T19:07:52.521137+0000","last_active":"2023-07-21T19:07:53.832757+0000","last_peered":"2023-07-21T19:07:53.832757+0000","last_clean":"2023-07-21T19:07:53.832757+0000","last_became_active":"2023-07-21T19:07:52.520674+0000","last_became_peered":"2023-07-21T19:07:52.520674+0000","last_unstale":"2023-07-21T19:07:53.832757+0000","last_undegraded":"2023-07-21T19:07:53.832757+0000","last_fullsized":"2023-07-21T19:07:53.832757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:00.674447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838395+0000","last_change":"2023-07-21T19:07:48.456486+0000","last_active":"2023-07-21T19:07:53.838395+0000","last_peered":"2023-07-21T19:07:53.838395+0000","last_clean":"2023-07-21T19:07:53.838395+0000","last_became_active":"2023-07-21T19:07:48.456220+0000","last_became_peered":"2023-07-21T19:07:48.456220+0000","last_unstale":"2023-07-21T19:07:53.838395+0000","last_undegraded":"2023-07-21T19:07:53.838395+0000","last_fullsized":"2023-07-21T19:07:53.838395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837749+0000","last_change":"2023-07-21T19:07:42.367917+0000","last_active":"2023-07-21T19:07:53.837749+0000","last_peered":"2023-07-21T19:07:53.837749+0000","last_clean":"2023-07-21T19:07:53.837749+0000","last_became_active":"2023-07-21T19:07:42.367308+0000","last_became_peered":"2023-07-21T19:07:42.367308+0000","last_unstale":"2023-07-21T19:07:53.837749+0000","last_undegraded":"2023-07-21T19:07:53.837749+0000","last_fullsized":"2023-07-21T19:07:53.837749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:35.449270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525321+0000","last_change":"2023-07-21T19:07:47.423617+0000","last_active":"2023-07-21T19:07:53.525321+0000","last_peered":"2023-07-21T19:07:53.525321+0000","last_clean":"2023-07-21T19:07:53.525321+0000","last_became_active":"2023-07-21T19:07:47.423355+0000","last_became_peered":"2023-07-21T19:07:47.423355+0000","last_unstale":"2023-07-21T19:07:53.525321+0000","last_undegraded":"2023-07-21T19:07:53.525321+0000","last_fullsized":"2023-07-21T19:07:53.525321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523743+0000","last_change":"2023-07-21T19:07:52.528456+0000","last_active":"2023-07-21T19:07:53.523743+0000","last_peered":"2023-07-21T19:07:53.523743+0000","last_clean":"2023-07-21T19:07:53.523743+0000","last_became_active":"2023-07-21T19:07:52.528085+0000","last_became_peered":"2023-07-21T19:07:52.528085+0000","last_unstale":"2023-07-21T19:07:53.523743+0000","last_undegraded":"2023-07-21T19:07:53.523743+0000","last_fullsized":"2023-07-21T19:07:53.523743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:25.346160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837279+0000","last_change":"2023-07-21T19:07:48.467636+0000","last_active":"2023-07-21T19:07:53.837279+0000","last_peered":"2023-07-21T19:07:53.837279+0000","last_clean":"2023-07-21T19:07:53.837279+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.837279+0000","last_undegraded":"2023-07-21T19:07:53.837279+0000","last_fullsized":"2023-07-21T19:07:53.837279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:21.256996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524424+0000","last_change":"2023-07-21T19:07:47.424470+0000","last_active":"2023-07-21T19:07:53.524424+0000","last_peered":"2023-07-21T19:07:53.524424+0000","last_clean":"2023-07-21T19:07:53.524424+0000","last_became_active":"2023-07-21T19:07:47.424180+0000","last_became_peered":"2023-07-21T19:07:47.424180+0000","last_unstale":"2023-07-21T19:07:53.524424+0000","last_undegraded":"2023-07-21T19:07:53.524424+0000","last_fullsized":"2023-07-21T19:07:53.524424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:06.662020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523611+0000","last_change":"2023-07-21T19:07:42.362561+0000","last_active":"2023-07-21T19:07:53.523611+0000","last_peered":"2023-07-21T19:07:53.523611+0000","last_clean":"2023-07-21T19:07:53.523611+0000","last_became_active":"2023-07-21T19:07:42.362127+0000","last_became_peered":"2023-07-21T19:07:42.362127+0000","last_unstale":"2023-07-21T19:07:53.523611+0000","last_undegraded":"2023-07-21T19:07:53.523611+0000","last_fullsized":"2023-07-21T19:07:53.523611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:35.933835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524354+0000","last_change":"2023-07-21T19:07:52.516158+0000","last_active":"2023-07-21T19:07:53.524354+0000","last_peered":"2023-07-21T19:07:53.524354+0000","last_clean":"2023-07-21T19:07:53.524354+0000","last_became_active":"2023-07-21T19:07:52.515733+0000","last_became_peered":"2023-07-21T19:07:52.515733+0000","last_unstale":"2023-07-21T19:07:53.524354+0000","last_undegraded":"2023-07-21T19:07:53.524354+0000","last_fullsized":"2023-07-21T19:07:53.524354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837125+0000","last_change":"2023-07-21T19:07:48.456327+0000","last_active":"2023-07-21T19:07:53.837125+0000","last_peered":"2023-07-21T19:07:53.837125+0000","last_clean":"2023-07-21T19:07:53.837125+0000","last_became_active":"2023-07-21T19:07:48.456006+0000","last_became_peered":"2023-07-21T19:07:48.456006+0000","last_unstale":"2023-07-21T19:07:53.837125+0000","last_undegraded":"2023-07-21T19:07:53.837125+0000","last_fullsized":"2023-07-21T19:07:53.837125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:29.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836564+0000","last_change":"2023-07-21T19:07:47.421721+0000","last_active":"2023-07-21T19:07:53.836564+0000","last_peered":"2023-07-21T19:07:53.836564+0000","last_clean":"2023-07-21T19:07:53.836564+0000","last_became_active":"2023-07-21T19:07:47.421381+0000","last_became_peered":"2023-07-21T19:07:47.421381+0000","last_unstale":"2023-07-21T19:07:53.836564+0000","last_undegraded":"2023-07-21T19:07:53.836564+0000","last_fullsized":"2023-07-21T19:07:53.836564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:39.711801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836660+0000","last_change":"2023-07-21T19:07:42.603235+0000","last_active":"2023-07-21T19:07:53.836660+0000","last_peered":"2023-07-21T19:07:53.836660+0000","last_clean":"2023-07-21T19:07:53.836660+0000","last_became_active":"2023-07-21T19:07:42.602762+0000","last_became_peered":"2023-07-21T19:07:42.602762+0000","last_unstale":"2023-07-21T19:07:53.836660+0000","last_undegraded":"2023-07-21T19:07:53.836660+0000","last_fullsized":"2023-07-21T19:07:53.836660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:30:32.377809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838524+0000","last_change":"2023-07-21T19:07:52.527041+0000","last_active":"2023-07-21T19:07:53.838524+0000","last_peered":"2023-07-21T19:07:53.838524+0000","last_clean":"2023-07-21T19:07:53.838524+0000","last_became_active":"2023-07-21T19:07:52.526709+0000","last_became_peered":"2023-07-21T19:07:52.526709+0000","last_unstale":"2023-07-21T19:07:53.838524+0000","last_undegraded":"2023-07-21T19:07:53.838524+0000","last_fullsized":"2023-07-21T19:07:53.838524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:39.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524830+0000","last_change":"2023-07-21T19:07:48.463144+0000","last_active":"2023-07-21T19:07:53.524830+0000","last_peered":"2023-07-21T19:07:53.524830+0000","last_clean":"2023-07-21T19:07:53.524830+0000","last_became_active":"2023-07-21T19:07:48.462845+0000","last_became_peered":"2023-07-21T19:07:48.462845+0000","last_unstale":"2023-07-21T19:07:53.524830+0000","last_undegraded":"2023-07-21T19:07:53.524830+0000","last_fullsized":"2023-07-21T19:07:53.524830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:09.348453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523238+0000","last_change":"2023-07-21T19:07:47.431757+0000","last_active":"2023-07-21T19:07:53.523238+0000","last_peered":"2023-07-21T19:07:53.523238+0000","last_clean":"2023-07-21T19:07:53.523238+0000","last_became_active":"2023-07-21T19:07:47.431418+0000","last_became_peered":"2023-07-21T19:07:47.431418+0000","last_unstale":"2023-07-21T19:07:53.523238+0000","last_undegraded":"2023-07-21T19:07:53.523238+0000","last_fullsized":"2023-07-21T19:07:53.523238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:29.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832922+0000","last_change":"2023-07-21T19:07:42.365054+0000","last_active":"2023-07-21T19:07:53.832922+0000","last_peered":"2023-07-21T19:07:53.832922+0000","last_clean":"2023-07-21T19:07:53.832922+0000","last_became_active":"2023-07-21T19:07:42.364497+0000","last_became_peered":"2023-07-21T19:07:42.364497+0000","last_unstale":"2023-07-21T19:07:53.832922+0000","last_undegraded":"2023-07-21T19:07:53.832922+0000","last_fullsized":"2023-07-21T19:07:53.832922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:14.792794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525146+0000","last_change":"2023-07-21T19:07:52.521002+0000","last_active":"2023-07-21T19:07:53.525146+0000","last_peered":"2023-07-21T19:07:53.525146+0000","last_clean":"2023-07-21T19:07:53.525146+0000","last_became_active":"2023-07-21T19:07:52.520183+0000","last_became_peered":"2023-07-21T19:07:52.520183+0000","last_unstale":"2023-07-21T19:07:53.525146+0000","last_undegraded":"2023-07-21T19:07:53.525146+0000","last_fullsized":"2023-07-21T19:07:53.525146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:04.157404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835018+0000","last_change":"2023-07-21T19:07:48.450486+0000","last_active":"2023-07-21T19:07:53.835018+0000","last_peered":"2023-07-21T19:07:53.835018+0000","last_clean":"2023-07-21T19:07:53.835018+0000","last_became_active":"2023-07-21T19:07:48.450113+0000","last_became_peered":"2023-07-21T19:07:48.450113+0000","last_unstale":"2023-07-21T19:07:53.835018+0000","last_undegraded":"2023-07-21T19:07:53.835018+0000","last_fullsized":"2023-07-21T19:07:53.835018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:42.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834245+0000","last_change":"2023-07-21T19:07:47.423195+0000","last_active":"2023-07-21T19:07:53.834245+0000","last_peered":"2023-07-21T19:07:53.834245+0000","last_clean":"2023-07-21T19:07:53.834245+0000","last_became_active":"2023-07-21T19:07:47.422860+0000","last_became_peered":"2023-07-21T19:07:47.422860+0000","last_unstale":"2023-07-21T19:07:53.834245+0000","last_undegraded":"2023-07-21T19:07:53.834245+0000","last_fullsized":"2023-07-21T19:07:53.834245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:55.435800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524131+0000","last_change":"2023-07-21T19:07:42.362560+0000","last_active":"2023-07-21T19:07:53.524131+0000","last_peered":"2023-07-21T19:07:53.524131+0000","last_clean":"2023-07-21T19:07:53.524131+0000","last_became_active":"2023-07-21T19:07:42.362066+0000","last_became_peered":"2023-07-21T19:07:42.362066+0000","last_unstale":"2023-07-21T19:07:53.524131+0000","last_undegraded":"2023-07-21T19:07:53.524131+0000","last_fullsized":"2023-07-21T19:07:53.524131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:45.371360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833450+0000","last_change":"2023-07-21T19:07:37.495346+0000","last_active":"2023-07-21T19:07:53.833450+0000","last_peered":"2023-07-21T19:07:53.833450+0000","last_clean":"2023-07-21T19:07:53.833450+0000","last_became_active":"2023-07-21T19:07:37.492842+0000","last_became_peered":"2023-07-21T19:07:37.492842+0000","last_unstale":"2023-07-21T19:07:53.833450+0000","last_undegraded":"2023-07-21T19:07:53.833450+0000","last_fullsized":"2023-07-21T19:07:53.833450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_clean_scrub_stamp":"2023-07-21T19:07:36.226507+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:43.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833439+0000","last_change":"2023-07-21T19:07:52.522487+0000","last_active":"2023-07-21T19:07:53.833439+0000","last_peered":"2023-07-21T19:07:53.833439+0000","last_clean":"2023-07-21T19:07:53.833439+0000","last_became_active":"2023-07-21T19:07:52.522124+0000","last_became_peered":"2023-07-21T19:07:52.522124+0000","last_unstale":"2023-07-21T19:07:53.833439+0000","last_undegraded":"2023-07-21T19:07:53.833439+0000","last_fullsized":"2023-07-21T19:07:53.833439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836991+0000","last_change":"2023-07-21T19:07:48.464190+0000","last_active":"2023-07-21T19:07:53.836991+0000","last_peered":"2023-07-21T19:07:53.836991+0000","last_clean":"2023-07-21T19:07:53.836991+0000","last_became_active":"2023-07-21T19:07:48.463260+0000","last_became_peered":"2023-07-21T19:07:48.463260+0000","last_unstale":"2023-07-21T19:07:53.836991+0000","last_undegraded":"2023-07-21T19:07:53.836991+0000","last_fullsized":"2023-07-21T19:07:53.836991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:30.223087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834539+0000","last_change":"2023-07-21T19:07:47.423593+0000","last_active":"2023-07-21T19:07:53.834539+0000","last_peered":"2023-07-21T19:07:53.834539+0000","last_clean":"2023-07-21T19:07:53.834539+0000","last_became_active":"2023-07-21T19:07:47.423276+0000","last_became_peered":"2023-07-21T19:07:47.423276+0000","last_unstale":"2023-07-21T19:07:53.834539+0000","last_undegraded":"2023-07-21T19:07:53.834539+0000","last_fullsized":"2023-07-21T19:07:53.834539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525405+0000","last_change":"2023-07-21T19:07:52.529461+0000","last_active":"2023-07-21T19:07:53.525405+0000","last_peered":"2023-07-21T19:07:53.525405+0000","last_clean":"2023-07-21T19:07:53.525405+0000","last_became_active":"2023-07-21T19:07:52.528852+0000","last_became_peered":"2023-07-21T19:07:52.528852+0000","last_unstale":"2023-07-21T19:07:53.525405+0000","last_undegraded":"2023-07-21T19:07:53.525405+0000","last_fullsized":"2023-07-21T19:07:53.525405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:30.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525377+0000","last_change":"2023-07-21T19:07:48.458201+0000","last_active":"2023-07-21T19:07:53.525377+0000","last_peered":"2023-07-21T19:07:53.525377+0000","last_clean":"2023-07-21T19:07:53.525377+0000","last_became_active":"2023-07-21T19:07:48.457846+0000","last_became_peered":"2023-07-21T19:07:48.457846+0000","last_unstale":"2023-07-21T19:07:53.525377+0000","last_undegraded":"2023-07-21T19:07:53.525377+0000","last_fullsized":"2023-07-21T19:07:53.525377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:09.687359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522942+0000","last_change":"2023-07-21T19:07:47.425071+0000","last_active":"2023-07-21T19:07:53.522942+0000","last_peered":"2023-07-21T19:07:53.522942+0000","last_clean":"2023-07-21T19:07:53.522942+0000","last_became_active":"2023-07-21T19:07:47.424794+0000","last_became_peered":"2023-07-21T19:07:47.424794+0000","last_unstale":"2023-07-21T19:07:53.522942+0000","last_undegraded":"2023-07-21T19:07:53.522942+0000","last_fullsized":"2023-07-21T19:07:53.522942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:51:34.225679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524727+0000","last_change":"2023-07-21T19:07:52.521246+0000","last_active":"2023-07-21T19:07:53.524727+0000","last_peered":"2023-07-21T19:07:53.524727+0000","last_clean":"2023-07-21T19:07:53.524727+0000","last_became_active":"2023-07-21T19:07:52.520645+0000","last_became_peered":"2023-07-21T19:07:52.520645+0000","last_unstale":"2023-07-21T19:07:53.524727+0000","last_undegraded":"2023-07-21T19:07:53.524727+0000","last_fullsized":"2023-07-21T19:07:53.524727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524230+0000","last_change":"2023-07-21T19:07:48.461186+0000","last_active":"2023-07-21T19:07:53.524230+0000","last_peered":"2023-07-21T19:07:53.524230+0000","last_clean":"2023-07-21T19:07:53.524230+0000","last_became_active":"2023-07-21T19:07:48.460686+0000","last_became_peered":"2023-07-21T19:07:48.460686+0000","last_unstale":"2023-07-21T19:07:53.524230+0000","last_undegraded":"2023-07-21T19:07:53.524230+0000","last_fullsized":"2023-07-21T19:07:53.524230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:34.225618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834185+0000","last_change":"2023-07-21T19:07:47.429361+0000","last_active":"2023-07-21T19:07:53.834185+0000","last_peered":"2023-07-21T19:07:53.834185+0000","last_clean":"2023-07-21T19:07:53.834185+0000","last_became_active":"2023-07-21T19:07:47.429045+0000","last_became_peered":"2023-07-21T19:07:47.429045+0000","last_unstale":"2023-07-21T19:07:53.834185+0000","last_undegraded":"2023-07-21T19:07:53.834185+0000","last_fullsized":"2023-07-21T19:07:53.834185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:46.738002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836869+0000","last_change":"2023-07-21T19:07:52.519252+0000","last_active":"2023-07-21T19:07:53.836869+0000","last_peered":"2023-07-21T19:07:53.836869+0000","last_clean":"2023-07-21T19:07:53.836869+0000","last_became_active":"2023-07-21T19:07:52.518688+0000","last_became_peered":"2023-07-21T19:07:52.518688+0000","last_unstale":"2023-07-21T19:07:53.836869+0000","last_undegraded":"2023-07-21T19:07:53.836869+0000","last_fullsized":"2023-07-21T19:07:53.836869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:50.938236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525123+0000","last_change":"2023-07-21T19:07:48.447289+0000","last_active":"2023-07-21T19:07:53.525123+0000","last_peered":"2023-07-21T19:07:53.525123+0000","last_clean":"2023-07-21T19:07:53.525123+0000","last_became_active":"2023-07-21T19:07:48.446841+0000","last_became_peered":"2023-07-21T19:07:48.446841+0000","last_unstale":"2023-07-21T19:07:53.525123+0000","last_undegraded":"2023-07-21T19:07:53.525123+0000","last_fullsized":"2023-07-21T19:07:53.525123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:02.284757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834212+0000","last_change":"2023-07-21T19:07:47.428249+0000","last_active":"2023-07-21T19:07:53.834212+0000","last_peered":"2023-07-21T19:07:53.834212+0000","last_clean":"2023-07-21T19:07:53.834212+0000","last_became_active":"2023-07-21T19:07:47.425547+0000","last_became_peered":"2023-07-21T19:07:47.425547+0000","last_unstale":"2023-07-21T19:07:53.834212+0000","last_undegraded":"2023-07-21T19:07:53.834212+0000","last_fullsized":"2023-07-21T19:07:53.834212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:08.336001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836450+0000","last_change":"2023-07-21T19:07:52.527359+0000","last_active":"2023-07-21T19:07:53.836450+0000","last_peered":"2023-07-21T19:07:53.836450+0000","last_clean":"2023-07-21T19:07:53.836450+0000","last_became_active":"2023-07-21T19:07:52.526874+0000","last_became_peered":"2023-07-21T19:07:52.526874+0000","last_unstale":"2023-07-21T19:07:53.836450+0000","last_undegraded":"2023-07-21T19:07:53.836450+0000","last_fullsized":"2023-07-21T19:07:53.836450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:31:40.974408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523734+0000","last_change":"2023-07-21T19:07:48.455173+0000","last_active":"2023-07-21T19:07:53.523734+0000","last_peered":"2023-07-21T19:07:53.523734+0000","last_clean":"2023-07-21T19:07:53.523734+0000","last_became_active":"2023-07-21T19:07:48.454831+0000","last_became_peered":"2023-07-21T19:07:48.454831+0000","last_unstale":"2023-07-21T19:07:53.523734+0000","last_undegraded":"2023-07-21T19:07:53.523734+0000","last_fullsized":"2023-07-21T19:07:53.523734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:36.861607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524469+0000","last_change":"2023-07-21T19:07:47.423659+0000","last_active":"2023-07-21T19:07:53.524469+0000","last_peered":"2023-07-21T19:07:53.524469+0000","last_clean":"2023-07-21T19:07:53.524469+0000","last_became_active":"2023-07-21T19:07:47.423361+0000","last_became_peered":"2023-07-21T19:07:47.423361+0000","last_unstale":"2023-07-21T19:07:53.524469+0000","last_undegraded":"2023-07-21T19:07:53.524469+0000","last_fullsized":"2023-07-21T19:07:53.524469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:39.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837028+0000","last_change":"2023-07-21T19:07:52.521996+0000","last_active":"2023-07-21T19:07:53.837028+0000","last_peered":"2023-07-21T19:07:53.837028+0000","last_clean":"2023-07-21T19:07:53.837028+0000","last_became_active":"2023-07-21T19:07:52.521602+0000","last_became_peered":"2023-07-21T19:07:52.521602+0000","last_unstale":"2023-07-21T19:07:53.837028+0000","last_undegraded":"2023-07-21T19:07:53.837028+0000","last_fullsized":"2023-07-21T19:07:53.837028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:10.532572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833328+0000","last_change":"2023-07-21T19:07:48.467352+0000","last_active":"2023-07-21T19:07:53.833328+0000","last_peered":"2023-07-21T19:07:53.833328+0000","last_clean":"2023-07-21T19:07:53.833328+0000","last_became_active":"2023-07-21T19:07:48.467124+0000","last_became_peered":"2023-07-21T19:07:48.467124+0000","last_unstale":"2023-07-21T19:07:53.833328+0000","last_undegraded":"2023-07-21T19:07:53.833328+0000","last_fullsized":"2023-07-21T19:07:53.833328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:00:50.853377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833618+0000","last_change":"2023-07-21T19:07:47.419617+0000","last_active":"2023-07-21T19:07:53.833618+0000","last_peered":"2023-07-21T19:07:53.833618+0000","last_clean":"2023-07-21T19:07:53.833618+0000","last_became_active":"2023-07-21T19:07:47.419364+0000","last_became_peered":"2023-07-21T19:07:47.419364+0000","last_unstale":"2023-07-21T19:07:53.833618+0000","last_undegraded":"2023-07-21T19:07:53.833618+0000","last_fullsized":"2023-07-21T19:07:53.833618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:09.580592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837324+0000","last_change":"2023-07-21T19:07:52.529056+0000","last_active":"2023-07-21T19:07:53.837324+0000","last_peered":"2023-07-21T19:07:53.837324+0000","last_clean":"2023-07-21T19:07:53.837324+0000","last_became_active":"2023-07-21T19:07:52.528625+0000","last_became_peered":"2023-07-21T19:07:52.528625+0000","last_unstale":"2023-07-21T19:07:53.837324+0000","last_undegraded":"2023-07-21T19:07:53.837324+0000","last_fullsized":"2023-07-21T19:07:53.837324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:18:02.894869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522766+0000","last_change":"2023-07-21T19:07:48.448246+0000","last_active":"2023-07-21T19:07:53.522766+0000","last_peered":"2023-07-21T19:07:53.522766+0000","last_clean":"2023-07-21T19:07:53.522766+0000","last_became_active":"2023-07-21T19:07:48.447965+0000","last_became_peered":"2023-07-21T19:07:48.447965+0000","last_unstale":"2023-07-21T19:07:53.522766+0000","last_undegraded":"2023-07-21T19:07:53.522766+0000","last_fullsized":"2023-07-21T19:07:53.522766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:21.169814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833962+0000","last_change":"2023-07-21T19:07:47.431735+0000","last_active":"2023-07-21T19:07:53.833962+0000","last_peered":"2023-07-21T19:07:53.833962+0000","last_clean":"2023-07-21T19:07:53.833962+0000","last_became_active":"2023-07-21T19:07:47.431420+0000","last_became_peered":"2023-07-21T19:07:47.431420+0000","last_unstale":"2023-07-21T19:07:53.833962+0000","last_undegraded":"2023-07-21T19:07:53.833962+0000","last_fullsized":"2023-07-21T19:07:53.833962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:00.446483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836462+0000","last_change":"2023-07-21T19:07:52.516923+0000","last_active":"2023-07-21T19:07:53.836462+0000","last_peered":"2023-07-21T19:07:53.836462+0000","last_clean":"2023-07-21T19:07:53.836462+0000","last_became_active":"2023-07-21T19:07:52.516533+0000","last_became_peered":"2023-07-21T19:07:52.516533+0000","last_unstale":"2023-07-21T19:07:53.836462+0000","last_undegraded":"2023-07-21T19:07:53.836462+0000","last_fullsized":"2023-07-21T19:07:53.836462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:22.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523297+0000","last_change":"2023-07-21T19:07:48.459424+0000","last_active":"2023-07-21T19:07:53.523297+0000","last_peered":"2023-07-21T19:07:53.523297+0000","last_clean":"2023-07-21T19:07:53.523297+0000","last_became_active":"2023-07-21T19:07:48.459144+0000","last_became_peered":"2023-07-21T19:07:48.459144+0000","last_unstale":"2023-07-21T19:07:53.523297+0000","last_undegraded":"2023-07-21T19:07:53.523297+0000","last_fullsized":"2023-07-21T19:07:53.523297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834289+0000","last_change":"2023-07-21T19:07:47.429355+0000","last_active":"2023-07-21T19:07:53.834289+0000","last_peered":"2023-07-21T19:07:53.834289+0000","last_clean":"2023-07-21T19:07:53.834289+0000","last_became_active":"2023-07-21T19:07:47.429099+0000","last_became_peered":"2023-07-21T19:07:47.429099+0000","last_unstale":"2023-07-21T19:07:53.834289+0000","last_undegraded":"2023-07-21T19:07:53.834289+0000","last_fullsized":"2023-07-21T19:07:53.834289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833072+0000","last_change":"2023-07-21T19:07:52.535684+0000","last_active":"2023-07-21T19:07:53.833072+0000","last_peered":"2023-07-21T19:07:53.833072+0000","last_clean":"2023-07-21T19:07:53.833072+0000","last_became_active":"2023-07-21T19:07:52.534977+0000","last_became_peered":"2023-07-21T19:07:52.534977+0000","last_unstale":"2023-07-21T19:07:53.833072+0000","last_undegraded":"2023-07-21T19:07:53.833072+0000","last_fullsized":"2023-07-21T19:07:53.833072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:55.503014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524655+0000","last_change":"2023-07-21T19:07:52.524161+0000","last_active":"2023-07-21T19:07:53.524655+0000","last_peered":"2023-07-21T19:07:53.524655+0000","last_clean":"2023-07-21T19:07:53.524655+0000","last_became_active":"2023-07-21T19:07:52.521210+0000","last_became_peered":"2023-07-21T19:07:52.521210+0000","last_unstale":"2023-07-21T19:07:53.524655+0000","last_undegraded":"2023-07-21T19:07:53.524655+0000","last_fullsized":"2023-07-21T19:07:53.524655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833020+0000","last_change":"2023-07-21T19:07:47.415004+0000","last_active":"2023-07-21T19:07:53.833020+0000","last_peered":"2023-07-21T19:07:53.833020+0000","last_clean":"2023-07-21T19:07:53.833020+0000","last_became_active":"2023-07-21T19:07:47.414722+0000","last_became_peered":"2023-07-21T19:07:47.414722+0000","last_unstale":"2023-07-21T19:07:53.833020+0000","last_undegraded":"2023-07-21T19:07:53.833020+0000","last_fullsized":"2023-07-21T19:07:53.833020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:24.856635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835510+0000","last_change":"2023-07-21T19:07:48.455578+0000","last_active":"2023-07-21T19:07:53.835510+0000","last_peered":"2023-07-21T19:07:53.835510+0000","last_clean":"2023-07-21T19:07:53.835510+0000","last_became_active":"2023-07-21T19:07:48.455308+0000","last_became_peered":"2023-07-21T19:07:48.455308+0000","last_unstale":"2023-07-21T19:07:53.835510+0000","last_undegraded":"2023-07-21T19:07:53.835510+0000","last_fullsized":"2023-07-21T19:07:53.835510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835286+0000","last_change":"2023-07-21T19:07:52.523627+0000","last_active":"2023-07-21T19:07:53.835286+0000","last_peered":"2023-07-21T19:07:53.835286+0000","last_clean":"2023-07-21T19:07:53.835286+0000","last_became_active":"2023-07-21T19:07:52.523029+0000","last_became_peered":"2023-07-21T19:07:52.523029+0000","last_unstale":"2023-07-21T19:07:53.835286+0000","last_undegraded":"2023-07-21T19:07:53.835286+0000","last_fullsized":"2023-07-21T19:07:53.835286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833239+0000","last_change":"2023-07-21T19:07:47.431726+0000","last_active":"2023-07-21T19:07:53.833239+0000","last_peered":"2023-07-21T19:07:53.833239+0000","last_clean":"2023-07-21T19:07:53.833239+0000","last_became_active":"2023-07-21T19:07:47.431482+0000","last_became_peered":"2023-07-21T19:07:47.431482+0000","last_unstale":"2023-07-21T19:07:53.833239+0000","last_undegraded":"2023-07-21T19:07:53.833239+0000","last_fullsized":"2023-07-21T19:07:53.833239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:43.739221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524914+0000","last_change":"2023-07-21T19:07:48.451700+0000","last_active":"2023-07-21T19:07:53.524914+0000","last_peered":"2023-07-21T19:07:53.524914+0000","last_clean":"2023-07-21T19:07:53.524914+0000","last_became_active":"2023-07-21T19:07:48.451403+0000","last_became_peered":"2023-07-21T19:07:48.451403+0000","last_unstale":"2023-07-21T19:07:53.524914+0000","last_undegraded":"2023-07-21T19:07:53.524914+0000","last_fullsized":"2023-07-21T19:07:53.524914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523591+0000","last_change":"2023-07-21T19:07:47.423135+0000","last_active":"2023-07-21T19:07:53.523591+0000","last_peered":"2023-07-21T19:07:53.523591+0000","last_clean":"2023-07-21T19:07:53.523591+0000","last_became_active":"2023-07-21T19:07:47.422803+0000","last_became_peered":"2023-07-21T19:07:47.422803+0000","last_unstale":"2023-07-21T19:07:53.523591+0000","last_undegraded":"2023-07-21T19:07:53.523591+0000","last_fullsized":"2023-07-21T19:07:53.523591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:28.397260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525042+0000","last_change":"2023-07-21T19:07:48.457131+0000","last_active":"2023-07-21T19:07:53.525042+0000","last_peered":"2023-07-21T19:07:53.525042+0000","last_clean":"2023-07-21T19:07:53.525042+0000","last_became_active":"2023-07-21T19:07:48.456793+0000","last_became_peered":"2023-07-21T19:07:48.456793+0000","last_unstale":"2023-07-21T19:07:53.525042+0000","last_undegraded":"2023-07-21T19:07:53.525042+0000","last_fullsized":"2023-07-21T19:07:53.525042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:01.458935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834400+0000","last_change":"2023-07-21T19:07:52.518169+0000","last_active":"2023-07-21T19:07:53.834400+0000","last_peered":"2023-07-21T19:07:53.834400+0000","last_clean":"2023-07-21T19:07:53.834400+0000","last_became_active":"2023-07-21T19:07:52.517772+0000","last_became_peered":"2023-07-21T19:07:52.517772+0000","last_unstale":"2023-07-21T19:07:53.834400+0000","last_undegraded":"2023-07-21T19:07:53.834400+0000","last_fullsized":"2023-07-21T19:07:53.834400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:51.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834407+0000","last_change":"2023-07-21T19:07:47.432451+0000","last_active":"2023-07-21T19:07:53.834407+0000","last_peered":"2023-07-21T19:07:53.834407+0000","last_clean":"2023-07-21T19:07:53.834407+0000","last_became_active":"2023-07-21T19:07:47.432158+0000","last_became_peered":"2023-07-21T19:07:47.432158+0000","last_unstale":"2023-07-21T19:07:53.834407+0000","last_undegraded":"2023-07-21T19:07:53.834407+0000","last_fullsized":"2023-07-21T19:07:53.834407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834759+0000","last_change":"2023-07-21T19:07:48.468705+0000","last_active":"2023-07-21T19:07:53.834759+0000","last_peered":"2023-07-21T19:07:53.834759+0000","last_clean":"2023-07-21T19:07:53.834759+0000","last_became_active":"2023-07-21T19:07:48.467669+0000","last_became_peered":"2023-07-21T19:07:48.467669+0000","last_unstale":"2023-07-21T19:07:53.834759+0000","last_undegraded":"2023-07-21T19:07:53.834759+0000","last_fullsized":"2023-07-21T19:07:53.834759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524694+0000","last_change":"2023-07-21T19:07:52.520703+0000","last_active":"2023-07-21T19:07:53.524694+0000","last_peered":"2023-07-21T19:07:53.524694+0000","last_clean":"2023-07-21T19:07:53.524694+0000","last_became_active":"2023-07-21T19:07:52.520253+0000","last_became_peered":"2023-07-21T19:07:52.520253+0000","last_unstale":"2023-07-21T19:07:53.524694+0000","last_undegraded":"2023-07-21T19:07:53.524694+0000","last_fullsized":"2023-07-21T19:07:53.524694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:48.840837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832788+0000","last_change":"2023-07-21T19:07:48.450536+0000","last_active":"2023-07-21T19:07:53.832788+0000","last_peered":"2023-07-21T19:07:53.832788+0000","last_clean":"2023-07-21T19:07:53.832788+0000","last_became_active":"2023-07-21T19:07:48.450167+0000","last_became_peered":"2023-07-21T19:07:48.450167+0000","last_unstale":"2023-07-21T19:07:53.832788+0000","last_undegraded":"2023-07-21T19:07:53.832788+0000","last_fullsized":"2023-07-21T19:07:53.832788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:38.287958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834518+0000","last_change":"2023-07-21T19:07:48.468556+0000","last_active":"2023-07-21T19:07:53.834518+0000","last_peered":"2023-07-21T19:07:53.834518+0000","last_clean":"2023-07-21T19:07:53.834518+0000","last_became_active":"2023-07-21T19:07:48.468254+0000","last_became_peered":"2023-07-21T19:07:48.468254+0000","last_unstale":"2023-07-21T19:07:53.834518+0000","last_undegraded":"2023-07-21T19:07:53.834518+0000","last_fullsized":"2023-07-21T19:07:53.834518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:44.578401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523567+0000","last_change":"2023-07-21T19:07:48.458141+0000","last_active":"2023-07-21T19:07:53.523567+0000","last_peered":"2023-07-21T19:07:53.523567+0000","last_clean":"2023-07-21T19:07:53.523567+0000","last_became_active":"2023-07-21T19:07:48.457777+0000","last_became_peered":"2023-07-21T19:07:48.457777+0000","last_unstale":"2023-07-21T19:07:53.523567+0000","last_undegraded":"2023-07-21T19:07:53.523567+0000","last_fullsized":"2023-07-21T19:07:53.523567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:26.864071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834004+0000","last_change":"2023-07-21T19:07:48.461028+0000","last_active":"2023-07-21T19:07:53.834004+0000","last_peered":"2023-07-21T19:07:53.834004+0000","last_clean":"2023-07-21T19:07:53.834004+0000","last_became_active":"2023-07-21T19:07:48.460706+0000","last_became_peered":"2023-07-21T19:07:48.460706+0000","last_unstale":"2023-07-21T19:07:53.834004+0000","last_undegraded":"2023-07-21T19:07:53.834004+0000","last_fullsized":"2023-07-21T19:07:53.834004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837596+0000","last_change":"2023-07-21T19:07:48.465807+0000","last_active":"2023-07-21T19:07:53.837596+0000","last_peered":"2023-07-21T19:07:53.837596+0000","last_clean":"2023-07-21T19:07:53.837596+0000","last_became_active":"2023-07-21T19:07:48.465438+0000","last_became_peered":"2023-07-21T19:07:48.465438+0000","last_unstale":"2023-07-21T19:07:53.837596+0000","last_undegraded":"2023-07-21T19:07:53.837596+0000","last_fullsized":"2023-07-21T19:07:53.837596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524894+0000","last_change":"2023-07-21T19:07:48.457206+0000","last_active":"2023-07-21T19:07:53.524894+0000","last_peered":"2023-07-21T19:07:53.524894+0000","last_clean":"2023-07-21T19:07:53.524894+0000","last_became_active":"2023-07-21T19:07:48.456904+0000","last_became_peered":"2023-07-21T19:07:48.456904+0000","last_unstale":"2023-07-21T19:07:53.524894+0000","last_undegraded":"2023-07-21T19:07:53.524894+0000","last_fullsized":"2023-07-21T19:07:53.524894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:27.588370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838192+0000","last_change":"2023-07-21T19:07:48.466649+0000","last_active":"2023-07-21T19:07:53.838192+0000","last_peered":"2023-07-21T19:07:53.838192+0000","last_clean":"2023-07-21T19:07:53.838192+0000","last_became_active":"2023-07-21T19:07:48.466399+0000","last_became_peered":"2023-07-21T19:07:48.466399+0000","last_unstale":"2023-07-21T19:07:53.838192+0000","last_undegraded":"2023-07-21T19:07:53.838192+0000","last_fullsized":"2023-07-21T19:07:53.838192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836840+0000","last_change":"2023-07-21T19:07:48.457556+0000","last_active":"2023-07-21T19:07:53.836840+0000","last_peered":"2023-07-21T19:07:53.836840+0000","last_clean":"2023-07-21T19:07:53.836840+0000","last_became_active":"2023-07-21T19:07:48.457008+0000","last_became_peered":"2023-07-21T19:07:48.457008+0000","last_unstale":"2023-07-21T19:07:53.836840+0000","last_undegraded":"2023-07-21T19:07:53.836840+0000","last_fullsized":"2023-07-21T19:07:53.836840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832601+0000","last_change":"2023-07-21T19:07:48.459157+0000","last_active":"2023-07-21T19:07:53.832601+0000","last_peered":"2023-07-21T19:07:53.832601+0000","last_clean":"2023-07-21T19:07:53.832601+0000","last_became_active":"2023-07-21T19:07:48.458742+0000","last_became_peered":"2023-07-21T19:07:48.458742+0000","last_unstale":"2023-07-21T19:07:53.832601+0000","last_undegraded":"2023-07-21T19:07:53.832601+0000","last_fullsized":"2023-07-21T19:07:53.832601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834329+0000","last_change":"2023-07-21T19:07:48.460206+0000","last_active":"2023-07-21T19:07:53.834329+0000","last_peered":"2023-07-21T19:07:53.834329+0000","last_clean":"2023-07-21T19:07:53.834329+0000","last_became_active":"2023-07-21T19:07:48.459889+0000","last_became_peered":"2023-07-21T19:07:48.459889+0000","last_unstale":"2023-07-21T19:07:53.834329+0000","last_undegraded":"2023-07-21T19:07:53.834329+0000","last_fullsized":"2023-07-21T19:07:53.834329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523456+0000","last_change":"2023-07-21T19:07:48.467621+0000","last_active":"2023-07-21T19:07:53.523456+0000","last_peered":"2023-07-21T19:07:53.523456+0000","last_clean":"2023-07-21T19:07:53.523456+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.523456+0000","last_undegraded":"2023-07-21T19:07:53.523456+0000","last_fullsized":"2023-07-21T19:07:53.523456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:17.804609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834253+0000","last_change":"2023-07-21T19:07:48.460711+0000","last_active":"2023-07-21T19:07:53.834253+0000","last_peered":"2023-07-21T19:07:53.834253+0000","last_clean":"2023-07-21T19:07:53.834253+0000","last_became_active":"2023-07-21T19:07:48.459973+0000","last_became_peered":"2023-07-21T19:07:48.459973+0000","last_unstale":"2023-07-21T19:07:53.834253+0000","last_undegraded":"2023-07-21T19:07:53.834253+0000","last_fullsized":"2023-07-21T19:07:53.834253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:00.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524979+0000","last_change":"2023-07-21T19:07:48.458886+0000","last_active":"2023-07-21T19:07:53.524979+0000","last_peered":"2023-07-21T19:07:53.524979+0000","last_clean":"2023-07-21T19:07:53.524979+0000","last_became_active":"2023-07-21T19:07:48.458061+0000","last_became_peered":"2023-07-21T19:07:48.458061+0000","last_unstale":"2023-07-21T19:07:53.524979+0000","last_undegraded":"2023-07-21T19:07:53.524979+0000","last_fullsized":"2023-07-21T19:07:53.524979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:33.659391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836557+0000","last_change":"2023-07-21T19:07:48.462686+0000","last_active":"2023-07-21T19:07:53.836557+0000","last_peered":"2023-07-21T19:07:53.836557+0000","last_clean":"2023-07-21T19:07:53.836557+0000","last_became_active":"2023-07-21T19:07:48.462297+0000","last_became_peered":"2023-07-21T19:07:48.462297+0000","last_unstale":"2023-07-21T19:07:53.836557+0000","last_undegraded":"2023-07-21T19:07:53.836557+0000","last_fullsized":"2023-07-21T19:07:53.836557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:34:16.617396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523127+0000","last_change":"2023-07-21T19:07:48.447297+0000","last_active":"2023-07-21T19:07:53.523127+0000","last_peered":"2023-07-21T19:07:53.523127+0000","last_clean":"2023-07-21T19:07:53.523127+0000","last_became_active":"2023-07-21T19:07:48.446963+0000","last_became_peered":"2023-07-21T19:07:48.446963+0000","last_unstale":"2023-07-21T19:07:53.523127+0000","last_undegraded":"2023-07-21T19:07:53.523127+0000","last_fullsized":"2023-07-21T19:07:53.523127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:33.698602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525034+0000","last_change":"2023-07-21T19:07:48.459709+0000","last_active":"2023-07-21T19:07:53.525034+0000","last_peered":"2023-07-21T19:07:53.525034+0000","last_clean":"2023-07-21T19:07:53.525034+0000","last_became_active":"2023-07-21T19:07:48.459450+0000","last_became_peered":"2023-07-21T19:07:48.459450+0000","last_unstale":"2023-07-21T19:07:53.525034+0000","last_undegraded":"2023-07-21T19:07:53.525034+0000","last_fullsized":"2023-07-21T19:07:53.525034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522497+0000","last_change":"2023-07-21T19:07:48.451039+0000","last_active":"2023-07-21T19:07:53.522497+0000","last_peered":"2023-07-21T19:07:53.522497+0000","last_clean":"2023-07-21T19:07:53.522497+0000","last_became_active":"2023-07-21T19:07:48.450731+0000","last_became_peered":"2023-07-21T19:07:48.450731+0000","last_unstale":"2023-07-21T19:07:53.522497+0000","last_undegraded":"2023-07-21T19:07:53.522497+0000","last_fullsized":"2023-07-21T19:07:53.522497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:26:01.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833016+0000","last_change":"2023-07-21T19:07:48.472483+0000","last_active":"2023-07-21T19:07:53.833016+0000","last_peered":"2023-07-21T19:07:53.833016+0000","last_clean":"2023-07-21T19:07:53.833016+0000","last_became_active":"2023-07-21T19:07:48.472205+0000","last_became_peered":"2023-07-21T19:07:48.472205+0000","last_unstale":"2023-07-21T19:07:53.833016+0000","last_undegraded":"2023-07-21T19:07:53.833016+0000","last_fullsized":"2023-07-21T19:07:53.833016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:40.712184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523605+0000","last_change":"2023-07-21T19:07:48.450016+0000","last_active":"2023-07-21T19:07:53.523605+0000","last_peered":"2023-07-21T19:07:53.523605+0000","last_clean":"2023-07-21T19:07:53.523605+0000","last_became_active":"2023-07-21T19:07:48.449429+0000","last_became_peered":"2023-07-21T19:07:48.449429+0000","last_unstale":"2023-07-21T19:07:53.523605+0000","last_undegraded":"2023-07-21T19:07:53.523605+0000","last_fullsized":"2023-07-21T19:07:53.523605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837435+0000","last_change":"2023-07-21T19:07:48.458714+0000","last_active":"2023-07-21T19:07:53.837435+0000","last_peered":"2023-07-21T19:07:53.837435+0000","last_clean":"2023-07-21T19:07:53.837435+0000","last_became_active":"2023-07-21T19:07:48.458388+0000","last_became_peered":"2023-07-21T19:07:48.458388+0000","last_unstale":"2023-07-21T19:07:53.837435+0000","last_undegraded":"2023-07-21T19:07:53.837435+0000","last_fullsized":"2023-07-21T19:07:53.837435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:07.621195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838125+0000","last_change":"2023-07-21T19:07:48.449982+0000","last_active":"2023-07-21T19:07:53.838125+0000","last_peered":"2023-07-21T19:07:53.838125+0000","last_clean":"2023-07-21T19:07:53.838125+0000","last_became_active":"2023-07-21T19:07:48.449092+0000","last_became_peered":"2023-07-21T19:07:48.449092+0000","last_unstale":"2023-07-21T19:07:53.838125+0000","last_undegraded":"2023-07-21T19:07:53.838125+0000","last_fullsized":"2023-07-21T19:07:53.838125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:10.674404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524046+0000","last_change":"2023-07-21T19:07:48.460970+0000","last_active":"2023-07-21T19:07:53.524046+0000","last_peered":"2023-07-21T19:07:53.524046+0000","last_clean":"2023-07-21T19:07:53.524046+0000","last_became_active":"2023-07-21T19:07:48.460263+0000","last_became_peered":"2023-07-21T19:07:48.460263+0000","last_unstale":"2023-07-21T19:07:53.524046+0000","last_undegraded":"2023-07-21T19:07:53.524046+0000","last_fullsized":"2023-07-21T19:07:53.524046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:09.964570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524908+0000","last_change":"2023-07-21T19:07:48.460703+0000","last_active":"2023-07-21T19:07:53.524908+0000","last_peered":"2023-07-21T19:07:53.524908+0000","last_clean":"2023-07-21T19:07:53.524908+0000","last_became_active":"2023-07-21T19:07:48.460406+0000","last_became_peered":"2023-07-21T19:07:48.460406+0000","last_unstale":"2023-07-21T19:07:53.524908+0000","last_undegraded":"2023-07-21T19:07:53.524908+0000","last_fullsized":"2023-07-21T19:07:53.524908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:10.593044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524839+0000","last_change":"2023-07-21T19:07:48.452496+0000","last_active":"2023-07-21T19:07:53.524839+0000","last_peered":"2023-07-21T19:07:53.524839+0000","last_clean":"2023-07-21T19:07:53.524839+0000","last_became_active":"2023-07-21T19:07:48.452235+0000","last_became_peered":"2023-07-21T19:07:48.452235+0000","last_unstale":"2023-07-21T19:07:53.524839+0000","last_undegraded":"2023-07-21T19:07:53.524839+0000","last_fullsized":"2023-07-21T19:07:53.524839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523126+0000","last_change":"2023-07-21T19:07:48.445166+0000","last_active":"2023-07-21T19:07:53.523126+0000","last_peered":"2023-07-21T19:07:53.523126+0000","last_clean":"2023-07-21T19:07:53.523126+0000","last_became_active":"2023-07-21T19:07:48.444852+0000","last_became_peered":"2023-07-21T19:07:48.444852+0000","last_unstale":"2023-07-21T19:07:53.523126+0000","last_undegraded":"2023-07-21T19:07:53.523126+0000","last_fullsized":"2023-07-21T19:07:53.523126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832791+0000","last_change":"2023-07-21T19:07:48.468451+0000","last_active":"2023-07-21T19:07:53.832791+0000","last_peered":"2023-07-21T19:07:53.832791+0000","last_clean":"2023-07-21T19:07:53.832791+0000","last_became_active":"2023-07-21T19:07:48.468185+0000","last_became_peered":"2023-07-21T19:07:48.468185+0000","last_unstale":"2023-07-21T19:07:53.832791+0000","last_undegraded":"2023-07-21T19:07:53.832791+0000","last_fullsized":"2023-07-21T19:07:53.832791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523196+0000","last_change":"2023-07-21T19:07:48.449895+0000","last_active":"2023-07-21T19:07:53.523196+0000","last_peered":"2023-07-21T19:07:53.523196+0000","last_clean":"2023-07-21T19:07:53.523196+0000","last_became_active":"2023-07-21T19:07:48.449511+0000","last_became_peered":"2023-07-21T19:07:48.449511+0000","last_unstale":"2023-07-21T19:07:53.523196+0000","last_undegraded":"2023-07-21T19:07:53.523196+0000","last_fullsized":"2023-07-21T19:07:53.523196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:55.510661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524314+0000","last_change":"2023-07-21T19:07:48.458380+0000","last_active":"2023-07-21T19:07:53.524314+0000","last_peered":"2023-07-21T19:07:53.524314+0000","last_clean":"2023-07-21T19:07:53.524314+0000","last_became_active":"2023-07-21T19:07:48.458092+0000","last_became_peered":"2023-07-21T19:07:48.458092+0000","last_unstale":"2023-07-21T19:07:53.524314+0000","last_undegraded":"2023-07-21T19:07:53.524314+0000","last_fullsized":"2023-07-21T19:07:53.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834522+0000","last_change":"2023-07-21T19:07:48.458478+0000","last_active":"2023-07-21T19:07:53.834522+0000","last_peered":"2023-07-21T19:07:53.834522+0000","last_clean":"2023-07-21T19:07:53.834522+0000","last_became_active":"2023-07-21T19:07:48.458191+0000","last_became_peered":"2023-07-21T19:07:48.458191+0000","last_unstale":"2023-07-21T19:07:53.834522+0000","last_undegraded":"2023-07-21T19:07:53.834522+0000","last_fullsized":"2023-07-21T19:07:53.834522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:04.609626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523852+0000","last_change":"2023-07-21T19:07:48.456833+0000","last_active":"2023-07-21T19:07:53.523852+0000","last_peered":"2023-07-21T19:07:53.523852+0000","last_clean":"2023-07-21T19:07:53.523852+0000","last_became_active":"2023-07-21T19:07:48.456319+0000","last_became_peered":"2023-07-21T19:07:48.456319+0000","last_unstale":"2023-07-21T19:07:53.523852+0000","last_undegraded":"2023-07-21T19:07:53.523852+0000","last_fullsized":"2023-07-21T19:07:53.523852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:40.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524737+0000","last_change":"2023-07-21T19:07:48.453854+0000","last_active":"2023-07-21T19:07:53.524737+0000","last_peered":"2023-07-21T19:07:53.524737+0000","last_clean":"2023-07-21T19:07:53.524737+0000","last_became_active":"2023-07-21T19:07:48.453560+0000","last_became_peered":"2023-07-21T19:07:48.453560+0000","last_unstale":"2023-07-21T19:07:53.524737+0000","last_undegraded":"2023-07-21T19:07:53.524737+0000","last_fullsized":"2023-07-21T19:07:53.524737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:54.789012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838394+0000","last_change":"2023-07-21T19:07:48.451024+0000","last_active":"2023-07-21T19:07:53.838394+0000","last_peered":"2023-07-21T19:07:53.838394+0000","last_clean":"2023-07-21T19:07:53.838394+0000","last_became_active":"2023-07-21T19:07:48.450678+0000","last_became_peered":"2023-07-21T19:07:48.450678+0000","last_unstale":"2023-07-21T19:07:53.838394+0000","last_undegraded":"2023-07-21T19:07:53.838394+0000","last_fullsized":"2023-07-21T19:07:53.838394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:56:56.585283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4450,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T19:08:09.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T19:08:10.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.136+0000 7fc642c7b700 1 Processor -- start 2023-07-21T19:08:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc642c7b700 1 -- start start 2023-07-21T19:08:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc642c7b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc63c15ffa0 0x7fc63c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc642c7b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c0ca8a0 con 0x7fc63c06dc50 2023-07-21T19:08:10.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc642c7b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c0cbcd0 con 0x7fc63c0cb180 2023-07-21T19:08:10.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc642c7b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0cbf70 con 0x7fc63c15ffa0 2023-07-21T19:08:10.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc641478700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc63c06dc50 0x7fc63c0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38058/0 (socket says 172.21.15.123:38058) 2023-07-21T19:08:10.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc641478700 1 -- 172.21.15.123:0/354195029 learned_addr learned my addr 172.21.15.123:0/354195029 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:10.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc641c79700 1 --2- 172.21.15.123:0/354195029 >> v2:172.21.15.123:3300/0 conn(0x7fc63c15ffa0 0x7fc63c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.140+0000 7fc640c77700 1 -- 172.21.15.123:0/354195029 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261618985 0 0) 0x7fc62c001110 con 0x7fc63c06dc50 2023-07-21T19:08:10.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc640c77700 1 -- 172.21.15.123:0/354195029 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6280035d0 con 0x7fc63c06dc50 2023-07-21T19:08:10.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc641c79700 1 -- 172.21.15.123:0/354195029 >> v1:172.21.15.145:6789/0 conn(0x7fc63c0cb180 legacy=0x7fc63c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc641c79700 1 -- 172.21.15.123:0/354195029 >> v1:172.21.15.123:6789/0 conn(0x7fc63c06dc50 legacy=0x7fc63c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc641c79700 1 -- 172.21.15.123:0/354195029 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0cc250 con 0x7fc63c15ffa0 2023-07-21T19:08:10.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc641c79700 1 --2- 172.21.15.123:0/354195029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c06d710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc638009850 tx=0x7fc638009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eef8794c39f33ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:10.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc640c77700 1 -- 172.21.15.123:0/354195029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638011830 con 0x7fc63c15ffa0 2023-07-21T19:08:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc640c77700 1 -- 172.21.15.123:0/354195029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc638011990 con 0x7fc63c15ffa0 2023-07-21T19:08:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc640c77700 1 -- 172.21.15.123:0/354195029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638011d40 con 0x7fc63c15ffa0 2023-07-21T19:08:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 -- 172.21.15.123:0/354195029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 msgr2=0x7fc63c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 --2- 172.21.15.123:0/354195029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c06d710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc638009850 tx=0x7fc638009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 -- 172.21.15.123:0/354195029 shutdown_connections 2023-07-21T19:08:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 --2- 172.21.15.123:0/354195029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c06d710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 -- 172.21.15.123:0/354195029 >> 172.21.15.123:0/354195029 conn(0x7fc63c06e960 msgr2=0x7fc63c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 -- 172.21.15.123:0/354195029 shutdown_connections 2023-07-21T19:08:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.144+0000 7fc642c7b700 1 -- 172.21.15.123:0/354195029 wait complete. 2023-07-21T19:08:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 Processor -- start 2023-07-21T19:08:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 -- start start 2023-07-21T19:08:10.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc63c06dc50 0x7fc63c0c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc63c0cb180 0x7fc63c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c0c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0c2a00 con 0x7fc63c15ffa0 2023-07-21T19:08:10.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0c2fc0 con 0x7fc63c06dc50 2023-07-21T19:08:10.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc642c7b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c15cfe0 con 0x7fc63c0cb180 2023-07-21T19:08:10.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc64247a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c0c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc64247a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c0c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58852/0 (socket says 172.21.15.123:58852) 2023-07-21T19:08:10.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc64247a700 1 -- 172.21.15.123:0/3164944665 learned_addr learned my addr 172.21.15.123:0/3164944665 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:10.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc641c79700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc63c06dc50 0x7fc63c0c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc641478700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc63c0cb180 0x7fc63c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc64247a700 1 -- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc63c0cb180 msgr2=0x7fc63c15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.148+0000 7fc64247a700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc63c0cb180 0x7fc63c15caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc64247a700 1 -- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc63c06dc50 msgr2=0x7fc63c0c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc64247a700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc63c06dc50 0x7fc63c0c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc64247a700 1 -- 172.21.15.123:0/3164944665 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380094b0 con 0x7fc63c15ffa0 2023-07-21T19:08:10.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc64247a700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c0c3c70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc63400cb80 tx=0x7fc63400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:10.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634003c20 con 0x7fc63c15ffa0 2023-07-21T19:08:10.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634003d80 con 0x7fc63c15ffa0 2023-07-21T19:08:10.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c0c4630 con 0x7fc63c15ffa0 2023-07-21T19:08:10.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400aaa0 con 0x7fc63c15ffa0 2023-07-21T19:08:10.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0c2c50 con 0x7fc63c15ffa0 2023-07-21T19:08:10.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c0c3130 con 0x7fc63c15ffa0 2023-07-21T19:08:10.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.152+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc63400ac00 con 0x7fc63c15ffa0 2023-07-21T19:08:10.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.156+0000 7fc6327fc700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc620066320 0x7fc6200687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.156+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc634083f00 con 0x7fc63c15ffa0 2023-07-21T19:08:10.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.156+0000 7fc641c79700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc620066320 0x7fc6200687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.156+0000 7fc641c79700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc620066320 0x7fc6200687d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6380090b0 tx=0x7fc63801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:10.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.160+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc634051080 con 0x7fc63c15ffa0 2023-07-21T19:08:10.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.324+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 --> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc63c0cc810 con 0x7fc620066320 2023-07-21T19:08:10.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.340+0000 7fc6327fc700 1 -- 172.21.15.123:0/3164944665 <== mgr.4104 v2:172.21.15.123:6832/1650121890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367168 (secure 0 0 0) 0x7fc638011b80 con 0x7fc620066320 2023-07-21T19:08:10.357 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc620066320 msgr2=0x7fc6200687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc620066320 0x7fc6200687d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6380090b0 tx=0x7fc63801c040 comp rx=0 tx=0).stop 2023-07-21T19:08:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 msgr2=0x7fc63c0c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c0c3c70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc63400cb80 tx=0x7fc63400ce90 comp rx=0 tx=0).stop 2023-07-21T19:08:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 shutdown_connections 2023-07-21T19:08:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc620066320 0x7fc6200687d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63c15ffa0 0x7fc63c0c3c70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc63c0cb180 0x7fc63c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 --2- 172.21.15.123:0/3164944665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc63c06dc50 0x7fc63c0c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 >> 172.21.15.123:0/3164944665 conn(0x7fc63c06e960 msgr2=0x7fc63c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 shutdown_connections 2023-07-21T19:08:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.348+0000 7fc642c7b700 1 -- 172.21.15.123:0/3164944665 wait complete. 2023-07-21T19:08:10.363 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-07-21T19:08:10.383 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-21T19:08:09.887930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594818,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223304,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751416,"statfs":{"total":773094113280,"available":772865449984,"internally_reserved":0,"allocated":3678208,"data_stored":2186212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007077"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837152+0000","last_change":"2023-07-21T19:07:52.526013+0000","last_active":"2023-07-21T19:07:53.837152+0000","last_peered":"2023-07-21T19:07:53.837152+0000","last_clean":"2023-07-21T19:07:53.837152+0000","last_became_active":"2023-07-21T19:07:52.525619+0000","last_became_peered":"2023-07-21T19:07:52.525619+0000","last_unstale":"2023-07-21T19:07:53.837152+0000","last_undegraded":"2023-07-21T19:07:53.837152+0000","last_fullsized":"2023-07-21T19:07:53.837152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:21.893772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525160+0000","last_change":"2023-07-21T19:07:47.420098+0000","last_active":"2023-07-21T19:07:53.525160+0000","last_peered":"2023-07-21T19:07:53.525160+0000","last_clean":"2023-07-21T19:07:53.525160+0000","last_became_active":"2023-07-21T19:07:47.419764+0000","last_became_peered":"2023-07-21T19:07:47.419764+0000","last_unstale":"2023-07-21T19:07:53.525160+0000","last_undegraded":"2023-07-21T19:07:53.525160+0000","last_fullsized":"2023-07-21T19:07:53.525160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522584+0000","last_change":"2023-07-21T19:07:48.458192+0000","last_active":"2023-07-21T19:07:53.522584+0000","last_peered":"2023-07-21T19:07:53.522584+0000","last_clean":"2023-07-21T19:07:53.522584+0000","last_became_active":"2023-07-21T19:07:48.457841+0000","last_became_peered":"2023-07-21T19:07:48.457841+0000","last_unstale":"2023-07-21T19:07:53.522584+0000","last_undegraded":"2023-07-21T19:07:53.522584+0000","last_fullsized":"2023-07-21T19:07:53.522584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:34.793452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522466+0000","last_change":"2023-07-21T19:07:52.521292+0000","last_active":"2023-07-21T19:07:53.522466+0000","last_peered":"2023-07-21T19:07:53.522466+0000","last_clean":"2023-07-21T19:07:53.522466+0000","last_became_active":"2023-07-21T19:07:52.512373+0000","last_became_peered":"2023-07-21T19:07:52.512373+0000","last_unstale":"2023-07-21T19:07:53.522466+0000","last_undegraded":"2023-07-21T19:07:53.522466+0000","last_fullsized":"2023-07-21T19:07:53.522466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:16.920553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834575+0000","last_change":"2023-07-21T19:07:47.418823+0000","last_active":"2023-07-21T19:07:53.834575+0000","last_peered":"2023-07-21T19:07:53.834575+0000","last_clean":"2023-07-21T19:07:53.834575+0000","last_became_active":"2023-07-21T19:07:47.418529+0000","last_became_peered":"2023-07-21T19:07:47.418529+0000","last_unstale":"2023-07-21T19:07:53.834575+0000","last_undegraded":"2023-07-21T19:07:53.834575+0000","last_fullsized":"2023-07-21T19:07:53.834575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834847+0000","last_change":"2023-07-21T19:07:48.460406+0000","last_active":"2023-07-21T19:07:53.834847+0000","last_peered":"2023-07-21T19:07:53.834847+0000","last_clean":"2023-07-21T19:07:53.834847+0000","last_became_active":"2023-07-21T19:07:48.459868+0000","last_became_peered":"2023-07-21T19:07:48.459868+0000","last_unstale":"2023-07-21T19:07:53.834847+0000","last_undegraded":"2023-07-21T19:07:53.834847+0000","last_fullsized":"2023-07-21T19:07:53.834847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523950+0000","last_change":"2023-07-21T19:07:52.514421+0000","last_active":"2023-07-21T19:07:53.523950+0000","last_peered":"2023-07-21T19:07:53.523950+0000","last_clean":"2023-07-21T19:07:53.523950+0000","last_became_active":"2023-07-21T19:07:52.514037+0000","last_became_peered":"2023-07-21T19:07:52.514037+0000","last_unstale":"2023-07-21T19:07:53.523950+0000","last_undegraded":"2023-07-21T19:07:53.523950+0000","last_fullsized":"2023-07-21T19:07:53.523950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:16.918863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525195+0000","last_change":"2023-07-21T19:07:47.429875+0000","last_active":"2023-07-21T19:07:53.525195+0000","last_peered":"2023-07-21T19:07:53.525195+0000","last_clean":"2023-07-21T19:07:53.525195+0000","last_became_active":"2023-07-21T19:07:47.429597+0000","last_became_peered":"2023-07-21T19:07:47.429597+0000","last_unstale":"2023-07-21T19:07:53.525195+0000","last_undegraded":"2023-07-21T19:07:53.525195+0000","last_fullsized":"2023-07-21T19:07:53.525195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523434+0000","last_change":"2023-07-21T19:07:48.445883+0000","last_active":"2023-07-21T19:07:53.523434+0000","last_peered":"2023-07-21T19:07:53.523434+0000","last_clean":"2023-07-21T19:07:53.523434+0000","last_became_active":"2023-07-21T19:07:48.445660+0000","last_became_peered":"2023-07-21T19:07:48.445660+0000","last_unstale":"2023-07-21T19:07:53.523434+0000","last_undegraded":"2023-07-21T19:07:53.523434+0000","last_fullsized":"2023-07-21T19:07:53.523434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:52.906045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832775+0000","last_change":"2023-07-21T19:07:52.524081+0000","last_active":"2023-07-21T19:07:53.832775+0000","last_peered":"2023-07-21T19:07:53.832775+0000","last_clean":"2023-07-21T19:07:53.832775+0000","last_became_active":"2023-07-21T19:07:52.523354+0000","last_became_peered":"2023-07-21T19:07:52.523354+0000","last_unstale":"2023-07-21T19:07:53.832775+0000","last_undegraded":"2023-07-21T19:07:53.832775+0000","last_fullsized":"2023-07-21T19:07:53.832775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524027+0000","last_change":"2023-07-21T19:07:47.429333+0000","last_active":"2023-07-21T19:07:53.524027+0000","last_peered":"2023-07-21T19:07:53.524027+0000","last_clean":"2023-07-21T19:07:53.524027+0000","last_became_active":"2023-07-21T19:07:47.428959+0000","last_became_peered":"2023-07-21T19:07:47.428959+0000","last_unstale":"2023-07-21T19:07:53.524027+0000","last_undegraded":"2023-07-21T19:07:53.524027+0000","last_fullsized":"2023-07-21T19:07:53.524027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524172+0000","last_change":"2023-07-21T19:07:48.454559+0000","last_active":"2023-07-21T19:07:53.524172+0000","last_peered":"2023-07-21T19:07:53.524172+0000","last_clean":"2023-07-21T19:07:53.524172+0000","last_became_active":"2023-07-21T19:07:48.454270+0000","last_became_peered":"2023-07-21T19:07:48.454270+0000","last_unstale":"2023-07-21T19:07:53.524172+0000","last_undegraded":"2023-07-21T19:07:53.524172+0000","last_fullsized":"2023-07-21T19:07:53.524172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:14.890349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838309+0000","last_change":"2023-07-21T19:07:52.521872+0000","last_active":"2023-07-21T19:07:53.838309+0000","last_peered":"2023-07-21T19:07:53.838309+0000","last_clean":"2023-07-21T19:07:53.838309+0000","last_became_active":"2023-07-21T19:07:52.521417+0000","last_became_peered":"2023-07-21T19:07:52.521417+0000","last_unstale":"2023-07-21T19:07:53.838309+0000","last_undegraded":"2023-07-21T19:07:53.838309+0000","last_fullsized":"2023-07-21T19:07:53.838309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:57.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524569+0000","last_change":"2023-07-21T19:07:47.435498+0000","last_active":"2023-07-21T19:07:53.524569+0000","last_peered":"2023-07-21T19:07:53.524569+0000","last_clean":"2023-07-21T19:07:53.524569+0000","last_became_active":"2023-07-21T19:07:47.435167+0000","last_became_peered":"2023-07-21T19:07:47.435167+0000","last_unstale":"2023-07-21T19:07:53.524569+0000","last_undegraded":"2023-07-21T19:07:53.524569+0000","last_fullsized":"2023-07-21T19:07:53.524569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:28.227019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838212+0000","last_change":"2023-07-21T19:07:48.464638+0000","last_active":"2023-07-21T19:07:53.838212+0000","last_peered":"2023-07-21T19:07:53.838212+0000","last_clean":"2023-07-21T19:07:53.838212+0000","last_became_active":"2023-07-21T19:07:48.463719+0000","last_became_peered":"2023-07-21T19:07:48.463719+0000","last_unstale":"2023-07-21T19:07:53.838212+0000","last_undegraded":"2023-07-21T19:07:53.838212+0000","last_fullsized":"2023-07-21T19:07:53.838212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:59.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524735+0000","last_change":"2023-07-21T19:07:52.520166+0000","last_active":"2023-07-21T19:07:53.524735+0000","last_peered":"2023-07-21T19:07:53.524735+0000","last_clean":"2023-07-21T19:07:53.524735+0000","last_became_active":"2023-07-21T19:07:52.519664+0000","last_became_peered":"2023-07-21T19:07:52.519664+0000","last_unstale":"2023-07-21T19:07:53.524735+0000","last_undegraded":"2023-07-21T19:07:53.524735+0000","last_fullsized":"2023-07-21T19:07:53.524735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:12.671068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523715+0000","last_change":"2023-07-21T19:07:47.428335+0000","last_active":"2023-07-21T19:07:53.523715+0000","last_peered":"2023-07-21T19:07:53.523715+0000","last_clean":"2023-07-21T19:07:53.523715+0000","last_became_active":"2023-07-21T19:07:47.428024+0000","last_became_peered":"2023-07-21T19:07:47.428024+0000","last_unstale":"2023-07-21T19:07:53.523715+0000","last_undegraded":"2023-07-21T19:07:53.523715+0000","last_fullsized":"2023-07-21T19:07:53.523715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:06.868264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835070+0000","last_change":"2023-07-21T19:07:48.460771+0000","last_active":"2023-07-21T19:07:53.835070+0000","last_peered":"2023-07-21T19:07:53.835070+0000","last_clean":"2023-07-21T19:07:53.835070+0000","last_became_active":"2023-07-21T19:07:48.460408+0000","last_became_peered":"2023-07-21T19:07:48.460408+0000","last_unstale":"2023-07-21T19:07:53.835070+0000","last_undegraded":"2023-07-21T19:07:53.835070+0000","last_fullsized":"2023-07-21T19:07:53.835070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834859+0000","last_change":"2023-07-21T19:07:52.515758+0000","last_active":"2023-07-21T19:07:53.834859+0000","last_peered":"2023-07-21T19:07:53.834859+0000","last_clean":"2023-07-21T19:07:53.834859+0000","last_became_active":"2023-07-21T19:07:52.515364+0000","last_became_peered":"2023-07-21T19:07:52.515364+0000","last_unstale":"2023-07-21T19:07:53.834859+0000","last_undegraded":"2023-07-21T19:07:53.834859+0000","last_fullsized":"2023-07-21T19:07:53.834859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:32.112276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838565+0000","last_change":"2023-07-21T19:07:47.432465+0000","last_active":"2023-07-21T19:07:53.838565+0000","last_peered":"2023-07-21T19:07:53.838565+0000","last_clean":"2023-07-21T19:07:53.838565+0000","last_became_active":"2023-07-21T19:07:47.432078+0000","last_became_peered":"2023-07-21T19:07:47.432078+0000","last_unstale":"2023-07-21T19:07:53.838565+0000","last_undegraded":"2023-07-21T19:07:53.838565+0000","last_fullsized":"2023-07-21T19:07:53.838565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524687+0000","last_change":"2023-07-21T19:07:48.460469+0000","last_active":"2023-07-21T19:07:53.524687+0000","last_peered":"2023-07-21T19:07:53.524687+0000","last_clean":"2023-07-21T19:07:53.524687+0000","last_became_active":"2023-07-21T19:07:48.460211+0000","last_became_peered":"2023-07-21T19:07:48.460211+0000","last_unstale":"2023-07-21T19:07:53.524687+0000","last_undegraded":"2023-07-21T19:07:53.524687+0000","last_fullsized":"2023-07-21T19:07:53.524687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525137+0000","last_change":"2023-07-21T19:07:52.515243+0000","last_active":"2023-07-21T19:07:53.525137+0000","last_peered":"2023-07-21T19:07:53.525137+0000","last_clean":"2023-07-21T19:07:53.525137+0000","last_became_active":"2023-07-21T19:07:52.514858+0000","last_became_peered":"2023-07-21T19:07:52.514858+0000","last_unstale":"2023-07-21T19:07:53.525137+0000","last_undegraded":"2023-07-21T19:07:53.525137+0000","last_fullsized":"2023-07-21T19:07:53.525137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:48.667564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834262+0000","last_change":"2023-07-21T19:07:47.423653+0000","last_active":"2023-07-21T19:07:53.834262+0000","last_peered":"2023-07-21T19:07:53.834262+0000","last_clean":"2023-07-21T19:07:53.834262+0000","last_became_active":"2023-07-21T19:07:47.423336+0000","last_became_peered":"2023-07-21T19:07:47.423336+0000","last_unstale":"2023-07-21T19:07:53.834262+0000","last_undegraded":"2023-07-21T19:07:53.834262+0000","last_fullsized":"2023-07-21T19:07:53.834262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:43.201925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835020+0000","last_change":"2023-07-21T19:07:48.453898+0000","last_active":"2023-07-21T19:07:53.835020+0000","last_peered":"2023-07-21T19:07:53.835020+0000","last_clean":"2023-07-21T19:07:53.835020+0000","last_became_active":"2023-07-21T19:07:48.453048+0000","last_became_peered":"2023-07-21T19:07:48.453048+0000","last_unstale":"2023-07-21T19:07:53.835020+0000","last_undegraded":"2023-07-21T19:07:53.835020+0000","last_fullsized":"2023-07-21T19:07:53.835020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:02.564475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833703+0000","last_change":"2023-07-21T19:07:48.467565+0000","last_active":"2023-07-21T19:07:53.833703+0000","last_peered":"2023-07-21T19:07:53.833703+0000","last_clean":"2023-07-21T19:07:53.833703+0000","last_became_active":"2023-07-21T19:07:48.467121+0000","last_became_peered":"2023-07-21T19:07:48.467121+0000","last_unstale":"2023-07-21T19:07:53.833703+0000","last_undegraded":"2023-07-21T19:07:53.833703+0000","last_fullsized":"2023-07-21T19:07:53.833703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525240+0000","last_change":"2023-07-21T19:07:47.419807+0000","last_active":"2023-07-21T19:07:53.525240+0000","last_peered":"2023-07-21T19:07:53.525240+0000","last_clean":"2023-07-21T19:07:53.525240+0000","last_became_active":"2023-07-21T19:07:47.419458+0000","last_became_peered":"2023-07-21T19:07:47.419458+0000","last_unstale":"2023-07-21T19:07:53.525240+0000","last_undegraded":"2023-07-21T19:07:53.525240+0000","last_fullsized":"2023-07-21T19:07:53.525240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832798+0000","last_change":"2023-07-21T19:07:52.512833+0000","last_active":"2023-07-21T19:07:53.832798+0000","last_peered":"2023-07-21T19:07:53.832798+0000","last_clean":"2023-07-21T19:07:53.832798+0000","last_became_active":"2023-07-21T19:07:52.512452+0000","last_became_peered":"2023-07-21T19:07:52.512452+0000","last_unstale":"2023-07-21T19:07:53.832798+0000","last_undegraded":"2023-07-21T19:07:53.832798+0000","last_fullsized":"2023-07-21T19:07:53.832798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:18.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834692+0000","last_change":"2023-07-21T19:07:48.455667+0000","last_active":"2023-07-21T19:07:53.834692+0000","last_peered":"2023-07-21T19:07:53.834692+0000","last_clean":"2023-07-21T19:07:53.834692+0000","last_became_active":"2023-07-21T19:07:48.455414+0000","last_became_peered":"2023-07-21T19:07:48.455414+0000","last_unstale":"2023-07-21T19:07:53.834692+0000","last_undegraded":"2023-07-21T19:07:53.834692+0000","last_fullsized":"2023-07-21T19:07:53.834692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:59.756485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524944+0000","last_change":"2023-07-21T19:07:47.419752+0000","last_active":"2023-07-21T19:07:53.524944+0000","last_peered":"2023-07-21T19:07:53.524944+0000","last_clean":"2023-07-21T19:07:53.524944+0000","last_became_active":"2023-07-21T19:07:47.419344+0000","last_became_peered":"2023-07-21T19:07:47.419344+0000","last_unstale":"2023-07-21T19:07:53.524944+0000","last_undegraded":"2023-07-21T19:07:53.524944+0000","last_fullsized":"2023-07-21T19:07:53.524944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:35.799862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833166+0000","last_change":"2023-07-21T19:07:52.535682+0000","last_active":"2023-07-21T19:07:53.833166+0000","last_peered":"2023-07-21T19:07:53.833166+0000","last_clean":"2023-07-21T19:07:53.833166+0000","last_became_active":"2023-07-21T19:07:52.534938+0000","last_became_peered":"2023-07-21T19:07:52.534938+0000","last_unstale":"2023-07-21T19:07:53.833166+0000","last_undegraded":"2023-07-21T19:07:53.833166+0000","last_fullsized":"2023-07-21T19:07:53.833166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833508+0000","last_change":"2023-07-21T19:07:47.428893+0000","last_active":"2023-07-21T19:07:53.833508+0000","last_peered":"2023-07-21T19:07:53.833508+0000","last_clean":"2023-07-21T19:07:53.833508+0000","last_became_active":"2023-07-21T19:07:47.428562+0000","last_became_peered":"2023-07-21T19:07:47.428562+0000","last_unstale":"2023-07-21T19:07:53.833508+0000","last_undegraded":"2023-07-21T19:07:53.833508+0000","last_fullsized":"2023-07-21T19:07:53.833508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:26.575918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838495+0000","last_change":"2023-07-21T19:07:48.458970+0000","last_active":"2023-07-21T19:07:53.838495+0000","last_peered":"2023-07-21T19:07:53.838495+0000","last_clean":"2023-07-21T19:07:53.838495+0000","last_became_active":"2023-07-21T19:07:48.458737+0000","last_became_peered":"2023-07-21T19:07:48.458737+0000","last_unstale":"2023-07-21T19:07:53.838495+0000","last_undegraded":"2023-07-21T19:07:53.838495+0000","last_fullsized":"2023-07-21T19:07:53.838495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833652+0000","last_change":"2023-07-21T19:07:52.529054+0000","last_active":"2023-07-21T19:07:53.833652+0000","last_peered":"2023-07-21T19:07:53.833652+0000","last_clean":"2023-07-21T19:07:53.833652+0000","last_became_active":"2023-07-21T19:07:52.528619+0000","last_became_peered":"2023-07-21T19:07:52.528619+0000","last_unstale":"2023-07-21T19:07:53.833652+0000","last_undegraded":"2023-07-21T19:07:53.833652+0000","last_fullsized":"2023-07-21T19:07:53.833652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:44.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:58.159490+0000","last_change":"2023-07-21T19:07:47.424409+0000","last_active":"2023-07-21T19:07:58.159490+0000","last_peered":"2023-07-21T19:07:58.159490+0000","last_clean":"2023-07-21T19:07:58.159490+0000","last_became_active":"2023-07-21T19:07:47.424101+0000","last_became_peered":"2023-07-21T19:07:47.424101+0000","last_unstale":"2023-07-21T19:07:58.159490+0000","last_undegraded":"2023-07-21T19:07:58.159490+0000","last_fullsized":"2023-07-21T19:07:58.159490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:06:04.934694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524300+0000","last_change":"2023-07-21T19:07:48.458540+0000","last_active":"2023-07-21T19:07:53.524300+0000","last_peered":"2023-07-21T19:07:53.524300+0000","last_clean":"2023-07-21T19:07:53.524300+0000","last_became_active":"2023-07-21T19:07:48.458216+0000","last_became_peered":"2023-07-21T19:07:48.458216+0000","last_unstale":"2023-07-21T19:07:53.524300+0000","last_undegraded":"2023-07-21T19:07:53.524300+0000","last_fullsized":"2023-07-21T19:07:53.524300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:04.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838155+0000","last_change":"2023-07-21T19:07:52.525973+0000","last_active":"2023-07-21T19:07:53.838155+0000","last_peered":"2023-07-21T19:07:53.838155+0000","last_clean":"2023-07-21T19:07:53.838155+0000","last_became_active":"2023-07-21T19:07:52.525557+0000","last_became_peered":"2023-07-21T19:07:52.525557+0000","last_unstale":"2023-07-21T19:07:53.838155+0000","last_undegraded":"2023-07-21T19:07:53.838155+0000","last_fullsized":"2023-07-21T19:07:53.838155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:04.238744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522891+0000","last_change":"2023-07-21T19:07:48.450182+0000","last_active":"2023-07-21T19:07:53.522891+0000","last_peered":"2023-07-21T19:07:53.522891+0000","last_clean":"2023-07-21T19:07:53.522891+0000","last_became_active":"2023-07-21T19:07:48.449903+0000","last_became_peered":"2023-07-21T19:07:48.449903+0000","last_unstale":"2023-07-21T19:07:53.522891+0000","last_undegraded":"2023-07-21T19:07:53.522891+0000","last_fullsized":"2023-07-21T19:07:53.522891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:58.318651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835029+0000","last_change":"2023-07-21T19:07:42.363227+0000","last_active":"2023-07-21T19:07:53.835029+0000","last_peered":"2023-07-21T19:07:53.835029+0000","last_clean":"2023-07-21T19:07:53.835029+0000","last_became_active":"2023-07-21T19:07:42.362873+0000","last_became_peered":"2023-07-21T19:07:42.362873+0000","last_unstale":"2023-07-21T19:07:53.835029+0000","last_undegraded":"2023-07-21T19:07:53.835029+0000","last_fullsized":"2023-07-21T19:07:53.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:40.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525002+0000","last_change":"2023-07-21T19:07:47.423281+0000","last_active":"2023-07-21T19:07:53.525002+0000","last_peered":"2023-07-21T19:07:53.525002+0000","last_clean":"2023-07-21T19:07:53.525002+0000","last_became_active":"2023-07-21T19:07:47.422972+0000","last_became_peered":"2023-07-21T19:07:47.422972+0000","last_unstale":"2023-07-21T19:07:53.525002+0000","last_undegraded":"2023-07-21T19:07:53.525002+0000","last_fullsized":"2023-07-21T19:07:53.525002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833700+0000","last_change":"2023-07-21T19:07:52.538404+0000","last_active":"2023-07-21T19:07:53.833700+0000","last_peered":"2023-07-21T19:07:53.833700+0000","last_clean":"2023-07-21T19:07:53.833700+0000","last_became_active":"2023-07-21T19:07:52.537940+0000","last_became_peered":"2023-07-21T19:07:52.537940+0000","last_unstale":"2023-07-21T19:07:53.833700+0000","last_undegraded":"2023-07-21T19:07:53.833700+0000","last_fullsized":"2023-07-21T19:07:53.833700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833968+0000","last_change":"2023-07-21T19:07:48.462660+0000","last_active":"2023-07-21T19:07:53.833968+0000","last_peered":"2023-07-21T19:07:53.833968+0000","last_clean":"2023-07-21T19:07:53.833968+0000","last_became_active":"2023-07-21T19:07:48.461577+0000","last_became_peered":"2023-07-21T19:07:48.461577+0000","last_unstale":"2023-07-21T19:07:53.833968+0000","last_undegraded":"2023-07-21T19:07:53.833968+0000","last_fullsized":"2023-07-21T19:07:53.833968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838321+0000","last_change":"2023-07-21T19:07:42.367585+0000","last_active":"2023-07-21T19:07:53.838321+0000","last_peered":"2023-07-21T19:07:53.838321+0000","last_clean":"2023-07-21T19:07:53.838321+0000","last_became_active":"2023-07-21T19:07:42.367246+0000","last_became_peered":"2023-07-21T19:07:42.367246+0000","last_unstale":"2023-07-21T19:07:53.838321+0000","last_undegraded":"2023-07-21T19:07:53.838321+0000","last_fullsized":"2023-07-21T19:07:53.838321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:03.305963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835676+0000","last_change":"2023-07-21T19:07:47.423871+0000","last_active":"2023-07-21T19:07:53.835676+0000","last_peered":"2023-07-21T19:07:53.835676+0000","last_clean":"2023-07-21T19:07:53.835676+0000","last_became_active":"2023-07-21T19:07:47.423601+0000","last_became_peered":"2023-07-21T19:07:47.423601+0000","last_unstale":"2023-07-21T19:07:53.835676+0000","last_undegraded":"2023-07-21T19:07:53.835676+0000","last_fullsized":"2023-07-21T19:07:53.835676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522467+0000","last_change":"2023-07-21T19:07:52.520565+0000","last_active":"2023-07-21T19:07:53.522467+0000","last_peered":"2023-07-21T19:07:53.522467+0000","last_clean":"2023-07-21T19:07:53.522467+0000","last_became_active":"2023-07-21T19:07:52.519706+0000","last_became_peered":"2023-07-21T19:07:52.519706+0000","last_unstale":"2023-07-21T19:07:53.522467+0000","last_undegraded":"2023-07-21T19:07:53.522467+0000","last_fullsized":"2023-07-21T19:07:53.522467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:16.197136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523919+0000","last_change":"2023-07-21T19:07:48.453983+0000","last_active":"2023-07-21T19:07:53.523919+0000","last_peered":"2023-07-21T19:07:53.523919+0000","last_clean":"2023-07-21T19:07:53.523919+0000","last_became_active":"2023-07-21T19:07:48.453574+0000","last_became_peered":"2023-07-21T19:07:48.453574+0000","last_unstale":"2023-07-21T19:07:53.523919+0000","last_undegraded":"2023-07-21T19:07:53.523919+0000","last_fullsized":"2023-07-21T19:07:53.523919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833947+0000","last_change":"2023-07-21T19:07:42.365391+0000","last_active":"2023-07-21T19:07:53.833947+0000","last_peered":"2023-07-21T19:07:53.833947+0000","last_clean":"2023-07-21T19:07:53.833947+0000","last_became_active":"2023-07-21T19:07:42.364406+0000","last_became_peered":"2023-07-21T19:07:42.364406+0000","last_unstale":"2023-07-21T19:07:53.833947+0000","last_undegraded":"2023-07-21T19:07:53.833947+0000","last_fullsized":"2023-07-21T19:07:53.833947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:30.769824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837437+0000","last_change":"2023-07-21T19:07:47.425674+0000","last_active":"2023-07-21T19:07:53.837437+0000","last_peered":"2023-07-21T19:07:53.837437+0000","last_clean":"2023-07-21T19:07:53.837437+0000","last_became_active":"2023-07-21T19:07:47.425400+0000","last_became_peered":"2023-07-21T19:07:47.425400+0000","last_unstale":"2023-07-21T19:07:53.837437+0000","last_undegraded":"2023-07-21T19:07:53.837437+0000","last_fullsized":"2023-07-21T19:07:53.837437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:35.849154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832757+0000","last_change":"2023-07-21T19:07:52.521137+0000","last_active":"2023-07-21T19:07:53.832757+0000","last_peered":"2023-07-21T19:07:53.832757+0000","last_clean":"2023-07-21T19:07:53.832757+0000","last_became_active":"2023-07-21T19:07:52.520674+0000","last_became_peered":"2023-07-21T19:07:52.520674+0000","last_unstale":"2023-07-21T19:07:53.832757+0000","last_undegraded":"2023-07-21T19:07:53.832757+0000","last_fullsized":"2023-07-21T19:07:53.832757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:00.674447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838395+0000","last_change":"2023-07-21T19:07:48.456486+0000","last_active":"2023-07-21T19:07:53.838395+0000","last_peered":"2023-07-21T19:07:53.838395+0000","last_clean":"2023-07-21T19:07:53.838395+0000","last_became_active":"2023-07-21T19:07:48.456220+0000","last_became_peered":"2023-07-21T19:07:48.456220+0000","last_unstale":"2023-07-21T19:07:53.838395+0000","last_undegraded":"2023-07-21T19:07:53.838395+0000","last_fullsized":"2023-07-21T19:07:53.838395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837749+0000","last_change":"2023-07-21T19:07:42.367917+0000","last_active":"2023-07-21T19:07:53.837749+0000","last_peered":"2023-07-21T19:07:53.837749+0000","last_clean":"2023-07-21T19:07:53.837749+0000","last_became_active":"2023-07-21T19:07:42.367308+0000","last_became_peered":"2023-07-21T19:07:42.367308+0000","last_unstale":"2023-07-21T19:07:53.837749+0000","last_undegraded":"2023-07-21T19:07:53.837749+0000","last_fullsized":"2023-07-21T19:07:53.837749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:35.449270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525321+0000","last_change":"2023-07-21T19:07:47.423617+0000","last_active":"2023-07-21T19:07:53.525321+0000","last_peered":"2023-07-21T19:07:53.525321+0000","last_clean":"2023-07-21T19:07:53.525321+0000","last_became_active":"2023-07-21T19:07:47.423355+0000","last_became_peered":"2023-07-21T19:07:47.423355+0000","last_unstale":"2023-07-21T19:07:53.525321+0000","last_undegraded":"2023-07-21T19:07:53.525321+0000","last_fullsized":"2023-07-21T19:07:53.525321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523743+0000","last_change":"2023-07-21T19:07:52.528456+0000","last_active":"2023-07-21T19:07:53.523743+0000","last_peered":"2023-07-21T19:07:53.523743+0000","last_clean":"2023-07-21T19:07:53.523743+0000","last_became_active":"2023-07-21T19:07:52.528085+0000","last_became_peered":"2023-07-21T19:07:52.528085+0000","last_unstale":"2023-07-21T19:07:53.523743+0000","last_undegraded":"2023-07-21T19:07:53.523743+0000","last_fullsized":"2023-07-21T19:07:53.523743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:25.346160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837279+0000","last_change":"2023-07-21T19:07:48.467636+0000","last_active":"2023-07-21T19:07:53.837279+0000","last_peered":"2023-07-21T19:07:53.837279+0000","last_clean":"2023-07-21T19:07:53.837279+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.837279+0000","last_undegraded":"2023-07-21T19:07:53.837279+0000","last_fullsized":"2023-07-21T19:07:53.837279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:21.256996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524424+0000","last_change":"2023-07-21T19:07:47.424470+0000","last_active":"2023-07-21T19:07:53.524424+0000","last_peered":"2023-07-21T19:07:53.524424+0000","last_clean":"2023-07-21T19:07:53.524424+0000","last_became_active":"2023-07-21T19:07:47.424180+0000","last_became_peered":"2023-07-21T19:07:47.424180+0000","last_unstale":"2023-07-21T19:07:53.524424+0000","last_undegraded":"2023-07-21T19:07:53.524424+0000","last_fullsized":"2023-07-21T19:07:53.524424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:06.662020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523611+0000","last_change":"2023-07-21T19:07:42.362561+0000","last_active":"2023-07-21T19:07:53.523611+0000","last_peered":"2023-07-21T19:07:53.523611+0000","last_clean":"2023-07-21T19:07:53.523611+0000","last_became_active":"2023-07-21T19:07:42.362127+0000","last_became_peered":"2023-07-21T19:07:42.362127+0000","last_unstale":"2023-07-21T19:07:53.523611+0000","last_undegraded":"2023-07-21T19:07:53.523611+0000","last_fullsized":"2023-07-21T19:07:53.523611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:35.933835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524354+0000","last_change":"2023-07-21T19:07:52.516158+0000","last_active":"2023-07-21T19:07:53.524354+0000","last_peered":"2023-07-21T19:07:53.524354+0000","last_clean":"2023-07-21T19:07:53.524354+0000","last_became_active":"2023-07-21T19:07:52.515733+0000","last_became_peered":"2023-07-21T19:07:52.515733+0000","last_unstale":"2023-07-21T19:07:53.524354+0000","last_undegraded":"2023-07-21T19:07:53.524354+0000","last_fullsized":"2023-07-21T19:07:53.524354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837125+0000","last_change":"2023-07-21T19:07:48.456327+0000","last_active":"2023-07-21T19:07:53.837125+0000","last_peered":"2023-07-21T19:07:53.837125+0000","last_clean":"2023-07-21T19:07:53.837125+0000","last_became_active":"2023-07-21T19:07:48.456006+0000","last_became_peered":"2023-07-21T19:07:48.456006+0000","last_unstale":"2023-07-21T19:07:53.837125+0000","last_undegraded":"2023-07-21T19:07:53.837125+0000","last_fullsized":"2023-07-21T19:07:53.837125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:29.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836564+0000","last_change":"2023-07-21T19:07:47.421721+0000","last_active":"2023-07-21T19:07:53.836564+0000","last_peered":"2023-07-21T19:07:53.836564+0000","last_clean":"2023-07-21T19:07:53.836564+0000","last_became_active":"2023-07-21T19:07:47.421381+0000","last_became_peered":"2023-07-21T19:07:47.421381+0000","last_unstale":"2023-07-21T19:07:53.836564+0000","last_undegraded":"2023-07-21T19:07:53.836564+0000","last_fullsized":"2023-07-21T19:07:53.836564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:39.711801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836660+0000","last_change":"2023-07-21T19:07:42.603235+0000","last_active":"2023-07-21T19:07:53.836660+0000","last_peered":"2023-07-21T19:07:53.836660+0000","last_clean":"2023-07-21T19:07:53.836660+0000","last_became_active":"2023-07-21T19:07:42.602762+0000","last_became_peered":"2023-07-21T19:07:42.602762+0000","last_unstale":"2023-07-21T19:07:53.836660+0000","last_undegraded":"2023-07-21T19:07:53.836660+0000","last_fullsized":"2023-07-21T19:07:53.836660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:30:32.377809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838524+0000","last_change":"2023-07-21T19:07:52.527041+0000","last_active":"2023-07-21T19:07:53.838524+0000","last_peered":"2023-07-21T19:07:53.838524+0000","last_clean":"2023-07-21T19:07:53.838524+0000","last_became_active":"2023-07-21T19:07:52.526709+0000","last_became_peered":"2023-07-21T19:07:52.526709+0000","last_unstale":"2023-07-21T19:07:53.838524+0000","last_undegraded":"2023-07-21T19:07:53.838524+0000","last_fullsized":"2023-07-21T19:07:53.838524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:39.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524830+0000","last_change":"2023-07-21T19:07:48.463144+0000","last_active":"2023-07-21T19:07:53.524830+0000","last_peered":"2023-07-21T19:07:53.524830+0000","last_clean":"2023-07-21T19:07:53.524830+0000","last_became_active":"2023-07-21T19:07:48.462845+0000","last_became_peered":"2023-07-21T19:07:48.462845+0000","last_unstale":"2023-07-21T19:07:53.524830+0000","last_undegraded":"2023-07-21T19:07:53.524830+0000","last_fullsized":"2023-07-21T19:07:53.524830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:09.348453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523238+0000","last_change":"2023-07-21T19:07:47.431757+0000","last_active":"2023-07-21T19:07:53.523238+0000","last_peered":"2023-07-21T19:07:53.523238+0000","last_clean":"2023-07-21T19:07:53.523238+0000","last_became_active":"2023-07-21T19:07:47.431418+0000","last_became_peered":"2023-07-21T19:07:47.431418+0000","last_unstale":"2023-07-21T19:07:53.523238+0000","last_undegraded":"2023-07-21T19:07:53.523238+0000","last_fullsized":"2023-07-21T19:07:53.523238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:29.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832922+0000","last_change":"2023-07-21T19:07:42.365054+0000","last_active":"2023-07-21T19:07:53.832922+0000","last_peered":"2023-07-21T19:07:53.832922+0000","last_clean":"2023-07-21T19:07:53.832922+0000","last_became_active":"2023-07-21T19:07:42.364497+0000","last_became_peered":"2023-07-21T19:07:42.364497+0000","last_unstale":"2023-07-21T19:07:53.832922+0000","last_undegraded":"2023-07-21T19:07:53.832922+0000","last_fullsized":"2023-07-21T19:07:53.832922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:14.792794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525146+0000","last_change":"2023-07-21T19:07:52.521002+0000","last_active":"2023-07-21T19:07:53.525146+0000","last_peered":"2023-07-21T19:07:53.525146+0000","last_clean":"2023-07-21T19:07:53.525146+0000","last_became_active":"2023-07-21T19:07:52.520183+0000","last_became_peered":"2023-07-21T19:07:52.520183+0000","last_unstale":"2023-07-21T19:07:53.525146+0000","last_undegraded":"2023-07-21T19:07:53.525146+0000","last_fullsized":"2023-07-21T19:07:53.525146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:04.157404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835018+0000","last_change":"2023-07-21T19:07:48.450486+0000","last_active":"2023-07-21T19:07:53.835018+0000","last_peered":"2023-07-21T19:07:53.835018+0000","last_clean":"2023-07-21T19:07:53.835018+0000","last_became_active":"2023-07-21T19:07:48.450113+0000","last_became_peered":"2023-07-21T19:07:48.450113+0000","last_unstale":"2023-07-21T19:07:53.835018+0000","last_undegraded":"2023-07-21T19:07:53.835018+0000","last_fullsized":"2023-07-21T19:07:53.835018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:42.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834245+0000","last_change":"2023-07-21T19:07:47.423195+0000","last_active":"2023-07-21T19:07:53.834245+0000","last_peered":"2023-07-21T19:07:53.834245+0000","last_clean":"2023-07-21T19:07:53.834245+0000","last_became_active":"2023-07-21T19:07:47.422860+0000","last_became_peered":"2023-07-21T19:07:47.422860+0000","last_unstale":"2023-07-21T19:07:53.834245+0000","last_undegraded":"2023-07-21T19:07:53.834245+0000","last_fullsized":"2023-07-21T19:07:53.834245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:55.435800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524131+0000","last_change":"2023-07-21T19:07:42.362560+0000","last_active":"2023-07-21T19:07:53.524131+0000","last_peered":"2023-07-21T19:07:53.524131+0000","last_clean":"2023-07-21T19:07:53.524131+0000","last_became_active":"2023-07-21T19:07:42.362066+0000","last_became_peered":"2023-07-21T19:07:42.362066+0000","last_unstale":"2023-07-21T19:07:53.524131+0000","last_undegraded":"2023-07-21T19:07:53.524131+0000","last_fullsized":"2023-07-21T19:07:53.524131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:45.371360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833450+0000","last_change":"2023-07-21T19:07:37.495346+0000","last_active":"2023-07-21T19:07:53.833450+0000","last_peered":"2023-07-21T19:07:53.833450+0000","last_clean":"2023-07-21T19:07:53.833450+0000","last_became_active":"2023-07-21T19:07:37.492842+0000","last_became_peered":"2023-07-21T19:07:37.492842+0000","last_unstale":"2023-07-21T19:07:53.833450+0000","last_undegraded":"2023-07-21T19:07:53.833450+0000","last_fullsized":"2023-07-21T19:07:53.833450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_clean_scrub_stamp":"2023-07-21T19:07:36.226507+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:43.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833439+0000","last_change":"2023-07-21T19:07:52.522487+0000","last_active":"2023-07-21T19:07:53.833439+0000","last_peered":"2023-07-21T19:07:53.833439+0000","last_clean":"2023-07-21T19:07:53.833439+0000","last_became_active":"2023-07-21T19:07:52.522124+0000","last_became_peered":"2023-07-21T19:07:52.522124+0000","last_unstale":"2023-07-21T19:07:53.833439+0000","last_undegraded":"2023-07-21T19:07:53.833439+0000","last_fullsized":"2023-07-21T19:07:53.833439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836991+0000","last_change":"2023-07-21T19:07:48.464190+0000","last_active":"2023-07-21T19:07:53.836991+0000","last_peered":"2023-07-21T19:07:53.836991+0000","last_clean":"2023-07-21T19:07:53.836991+0000","last_became_active":"2023-07-21T19:07:48.463260+0000","last_became_peered":"2023-07-21T19:07:48.463260+0000","last_unstale":"2023-07-21T19:07:53.836991+0000","last_undegraded":"2023-07-21T19:07:53.836991+0000","last_fullsized":"2023-07-21T19:07:53.836991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:30.223087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834539+0000","last_change":"2023-07-21T19:07:47.423593+0000","last_active":"2023-07-21T19:07:53.834539+0000","last_peered":"2023-07-21T19:07:53.834539+0000","last_clean":"2023-07-21T19:07:53.834539+0000","last_became_active":"2023-07-21T19:07:47.423276+0000","last_became_peered":"2023-07-21T19:07:47.423276+0000","last_unstale":"2023-07-21T19:07:53.834539+0000","last_undegraded":"2023-07-21T19:07:53.834539+0000","last_fullsized":"2023-07-21T19:07:53.834539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525405+0000","last_change":"2023-07-21T19:07:52.529461+0000","last_active":"2023-07-21T19:07:53.525405+0000","last_peered":"2023-07-21T19:07:53.525405+0000","last_clean":"2023-07-21T19:07:53.525405+0000","last_became_active":"2023-07-21T19:07:52.528852+0000","last_became_peered":"2023-07-21T19:07:52.528852+0000","last_unstale":"2023-07-21T19:07:53.525405+0000","last_undegraded":"2023-07-21T19:07:53.525405+0000","last_fullsized":"2023-07-21T19:07:53.525405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:30.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525377+0000","last_change":"2023-07-21T19:07:48.458201+0000","last_active":"2023-07-21T19:07:53.525377+0000","last_peered":"2023-07-21T19:07:53.525377+0000","last_clean":"2023-07-21T19:07:53.525377+0000","last_became_active":"2023-07-21T19:07:48.457846+0000","last_became_peered":"2023-07-21T19:07:48.457846+0000","last_unstale":"2023-07-21T19:07:53.525377+0000","last_undegraded":"2023-07-21T19:07:53.525377+0000","last_fullsized":"2023-07-21T19:07:53.525377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:09.687359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522942+0000","last_change":"2023-07-21T19:07:47.425071+0000","last_active":"2023-07-21T19:07:53.522942+0000","last_peered":"2023-07-21T19:07:53.522942+0000","last_clean":"2023-07-21T19:07:53.522942+0000","last_became_active":"2023-07-21T19:07:47.424794+0000","last_became_peered":"2023-07-21T19:07:47.424794+0000","last_unstale":"2023-07-21T19:07:53.522942+0000","last_undegraded":"2023-07-21T19:07:53.522942+0000","last_fullsized":"2023-07-21T19:07:53.522942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:51:34.225679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524727+0000","last_change":"2023-07-21T19:07:52.521246+0000","last_active":"2023-07-21T19:07:53.524727+0000","last_peered":"2023-07-21T19:07:53.524727+0000","last_clean":"2023-07-21T19:07:53.524727+0000","last_became_active":"2023-07-21T19:07:52.520645+0000","last_became_peered":"2023-07-21T19:07:52.520645+0000","last_unstale":"2023-07-21T19:07:53.524727+0000","last_undegraded":"2023-07-21T19:07:53.524727+0000","last_fullsized":"2023-07-21T19:07:53.524727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524230+0000","last_change":"2023-07-21T19:07:48.461186+0000","last_active":"2023-07-21T19:07:53.524230+0000","last_peered":"2023-07-21T19:07:53.524230+0000","last_clean":"2023-07-21T19:07:53.524230+0000","last_became_active":"2023-07-21T19:07:48.460686+0000","last_became_peered":"2023-07-21T19:07:48.460686+0000","last_unstale":"2023-07-21T19:07:53.524230+0000","last_undegraded":"2023-07-21T19:07:53.524230+0000","last_fullsized":"2023-07-21T19:07:53.524230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:34.225618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834185+0000","last_change":"2023-07-21T19:07:47.429361+0000","last_active":"2023-07-21T19:07:53.834185+0000","last_peered":"2023-07-21T19:07:53.834185+0000","last_clean":"2023-07-21T19:07:53.834185+0000","last_became_active":"2023-07-21T19:07:47.429045+0000","last_became_peered":"2023-07-21T19:07:47.429045+0000","last_unstale":"2023-07-21T19:07:53.834185+0000","last_undegraded":"2023-07-21T19:07:53.834185+0000","last_fullsized":"2023-07-21T19:07:53.834185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:46.738002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836869+0000","last_change":"2023-07-21T19:07:52.519252+0000","last_active":"2023-07-21T19:07:53.836869+0000","last_peered":"2023-07-21T19:07:53.836869+0000","last_clean":"2023-07-21T19:07:53.836869+0000","last_became_active":"2023-07-21T19:07:52.518688+0000","last_became_peered":"2023-07-21T19:07:52.518688+0000","last_unstale":"2023-07-21T19:07:53.836869+0000","last_undegraded":"2023-07-21T19:07:53.836869+0000","last_fullsized":"2023-07-21T19:07:53.836869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:50.938236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525123+0000","last_change":"2023-07-21T19:07:48.447289+0000","last_active":"2023-07-21T19:07:53.525123+0000","last_peered":"2023-07-21T19:07:53.525123+0000","last_clean":"2023-07-21T19:07:53.525123+0000","last_became_active":"2023-07-21T19:07:48.446841+0000","last_became_peered":"2023-07-21T19:07:48.446841+0000","last_unstale":"2023-07-21T19:07:53.525123+0000","last_undegraded":"2023-07-21T19:07:53.525123+0000","last_fullsized":"2023-07-21T19:07:53.525123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:02.284757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834212+0000","last_change":"2023-07-21T19:07:47.428249+0000","last_active":"2023-07-21T19:07:53.834212+0000","last_peered":"2023-07-21T19:07:53.834212+0000","last_clean":"2023-07-21T19:07:53.834212+0000","last_became_active":"2023-07-21T19:07:47.425547+0000","last_became_peered":"2023-07-21T19:07:47.425547+0000","last_unstale":"2023-07-21T19:07:53.834212+0000","last_undegraded":"2023-07-21T19:07:53.834212+0000","last_fullsized":"2023-07-21T19:07:53.834212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:08.336001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836450+0000","last_change":"2023-07-21T19:07:52.527359+0000","last_active":"2023-07-21T19:07:53.836450+0000","last_peered":"2023-07-21T19:07:53.836450+0000","last_clean":"2023-07-21T19:07:53.836450+0000","last_became_active":"2023-07-21T19:07:52.526874+0000","last_became_peered":"2023-07-21T19:07:52.526874+0000","last_unstale":"2023-07-21T19:07:53.836450+0000","last_undegraded":"2023-07-21T19:07:53.836450+0000","last_fullsized":"2023-07-21T19:07:53.836450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:31:40.974408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523734+0000","last_change":"2023-07-21T19:07:48.455173+0000","last_active":"2023-07-21T19:07:53.523734+0000","last_peered":"2023-07-21T19:07:53.523734+0000","last_clean":"2023-07-21T19:07:53.523734+0000","last_became_active":"2023-07-21T19:07:48.454831+0000","last_became_peered":"2023-07-21T19:07:48.454831+0000","last_unstale":"2023-07-21T19:07:53.523734+0000","last_undegraded":"2023-07-21T19:07:53.523734+0000","last_fullsized":"2023-07-21T19:07:53.523734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:36.861607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524469+0000","last_change":"2023-07-21T19:07:47.423659+0000","last_active":"2023-07-21T19:07:53.524469+0000","last_peered":"2023-07-21T19:07:53.524469+0000","last_clean":"2023-07-21T19:07:53.524469+0000","last_became_active":"2023-07-21T19:07:47.423361+0000","last_became_peered":"2023-07-21T19:07:47.423361+0000","last_unstale":"2023-07-21T19:07:53.524469+0000","last_undegraded":"2023-07-21T19:07:53.524469+0000","last_fullsized":"2023-07-21T19:07:53.524469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:39.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837028+0000","last_change":"2023-07-21T19:07:52.521996+0000","last_active":"2023-07-21T19:07:53.837028+0000","last_peered":"2023-07-21T19:07:53.837028+0000","last_clean":"2023-07-21T19:07:53.837028+0000","last_became_active":"2023-07-21T19:07:52.521602+0000","last_became_peered":"2023-07-21T19:07:52.521602+0000","last_unstale":"2023-07-21T19:07:53.837028+0000","last_undegraded":"2023-07-21T19:07:53.837028+0000","last_fullsized":"2023-07-21T19:07:53.837028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:10.532572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833328+0000","last_change":"2023-07-21T19:07:48.467352+0000","last_active":"2023-07-21T19:07:53.833328+0000","last_peered":"2023-07-21T19:07:53.833328+0000","last_clean":"2023-07-21T19:07:53.833328+0000","last_became_active":"2023-07-21T19:07:48.467124+0000","last_became_peered":"2023-07-21T19:07:48.467124+0000","last_unstale":"2023-07-21T19:07:53.833328+0000","last_undegraded":"2023-07-21T19:07:53.833328+0000","last_fullsized":"2023-07-21T19:07:53.833328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:00:50.853377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833618+0000","last_change":"2023-07-21T19:07:47.419617+0000","last_active":"2023-07-21T19:07:53.833618+0000","last_peered":"2023-07-21T19:07:53.833618+0000","last_clean":"2023-07-21T19:07:53.833618+0000","last_became_active":"2023-07-21T19:07:47.419364+0000","last_became_peered":"2023-07-21T19:07:47.419364+0000","last_unstale":"2023-07-21T19:07:53.833618+0000","last_undegraded":"2023-07-21T19:07:53.833618+0000","last_fullsized":"2023-07-21T19:07:53.833618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:09.580592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837324+0000","last_change":"2023-07-21T19:07:52.529056+0000","last_active":"2023-07-21T19:07:53.837324+0000","last_peered":"2023-07-21T19:07:53.837324+0000","last_clean":"2023-07-21T19:07:53.837324+0000","last_became_active":"2023-07-21T19:07:52.528625+0000","last_became_peered":"2023-07-21T19:07:52.528625+0000","last_unstale":"2023-07-21T19:07:53.837324+0000","last_undegraded":"2023-07-21T19:07:53.837324+0000","last_fullsized":"2023-07-21T19:07:53.837324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:18:02.894869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522766+0000","last_change":"2023-07-21T19:07:48.448246+0000","last_active":"2023-07-21T19:07:53.522766+0000","last_peered":"2023-07-21T19:07:53.522766+0000","last_clean":"2023-07-21T19:07:53.522766+0000","last_became_active":"2023-07-21T19:07:48.447965+0000","last_became_peered":"2023-07-21T19:07:48.447965+0000","last_unstale":"2023-07-21T19:07:53.522766+0000","last_undegraded":"2023-07-21T19:07:53.522766+0000","last_fullsized":"2023-07-21T19:07:53.522766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:21.169814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833962+0000","last_change":"2023-07-21T19:07:47.431735+0000","last_active":"2023-07-21T19:07:53.833962+0000","last_peered":"2023-07-21T19:07:53.833962+0000","last_clean":"2023-07-21T19:07:53.833962+0000","last_became_active":"2023-07-21T19:07:47.431420+0000","last_became_peered":"2023-07-21T19:07:47.431420+0000","last_unstale":"2023-07-21T19:07:53.833962+0000","last_undegraded":"2023-07-21T19:07:53.833962+0000","last_fullsized":"2023-07-21T19:07:53.833962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:00.446483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836462+0000","last_change":"2023-07-21T19:07:52.516923+0000","last_active":"2023-07-21T19:07:53.836462+0000","last_peered":"2023-07-21T19:07:53.836462+0000","last_clean":"2023-07-21T19:07:53.836462+0000","last_became_active":"2023-07-21T19:07:52.516533+0000","last_became_peered":"2023-07-21T19:07:52.516533+0000","last_unstale":"2023-07-21T19:07:53.836462+0000","last_undegraded":"2023-07-21T19:07:53.836462+0000","last_fullsized":"2023-07-21T19:07:53.836462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:22.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523297+0000","last_change":"2023-07-21T19:07:48.459424+0000","last_active":"2023-07-21T19:07:53.523297+0000","last_peered":"2023-07-21T19:07:53.523297+0000","last_clean":"2023-07-21T19:07:53.523297+0000","last_became_active":"2023-07-21T19:07:48.459144+0000","last_became_peered":"2023-07-21T19:07:48.459144+0000","last_unstale":"2023-07-21T19:07:53.523297+0000","last_undegraded":"2023-07-21T19:07:53.523297+0000","last_fullsized":"2023-07-21T19:07:53.523297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834289+0000","last_change":"2023-07-21T19:07:47.429355+0000","last_active":"2023-07-21T19:07:53.834289+0000","last_peered":"2023-07-21T19:07:53.834289+0000","last_clean":"2023-07-21T19:07:53.834289+0000","last_became_active":"2023-07-21T19:07:47.429099+0000","last_became_peered":"2023-07-21T19:07:47.429099+0000","last_unstale":"2023-07-21T19:07:53.834289+0000","last_undegraded":"2023-07-21T19:07:53.834289+0000","last_fullsized":"2023-07-21T19:07:53.834289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833072+0000","last_change":"2023-07-21T19:07:52.535684+0000","last_active":"2023-07-21T19:07:53.833072+0000","last_peered":"2023-07-21T19:07:53.833072+0000","last_clean":"2023-07-21T19:07:53.833072+0000","last_became_active":"2023-07-21T19:07:52.534977+0000","last_became_peered":"2023-07-21T19:07:52.534977+0000","last_unstale":"2023-07-21T19:07:53.833072+0000","last_undegraded":"2023-07-21T19:07:53.833072+0000","last_fullsized":"2023-07-21T19:07:53.833072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:55.503014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524655+0000","last_change":"2023-07-21T19:07:52.524161+0000","last_active":"2023-07-21T19:07:53.524655+0000","last_peered":"2023-07-21T19:07:53.524655+0000","last_clean":"2023-07-21T19:07:53.524655+0000","last_became_active":"2023-07-21T19:07:52.521210+0000","last_became_peered":"2023-07-21T19:07:52.521210+0000","last_unstale":"2023-07-21T19:07:53.524655+0000","last_undegraded":"2023-07-21T19:07:53.524655+0000","last_fullsized":"2023-07-21T19:07:53.524655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833020+0000","last_change":"2023-07-21T19:07:47.415004+0000","last_active":"2023-07-21T19:07:53.833020+0000","last_peered":"2023-07-21T19:07:53.833020+0000","last_clean":"2023-07-21T19:07:53.833020+0000","last_became_active":"2023-07-21T19:07:47.414722+0000","last_became_peered":"2023-07-21T19:07:47.414722+0000","last_unstale":"2023-07-21T19:07:53.833020+0000","last_undegraded":"2023-07-21T19:07:53.833020+0000","last_fullsized":"2023-07-21T19:07:53.833020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:24.856635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835510+0000","last_change":"2023-07-21T19:07:48.455578+0000","last_active":"2023-07-21T19:07:53.835510+0000","last_peered":"2023-07-21T19:07:53.835510+0000","last_clean":"2023-07-21T19:07:53.835510+0000","last_became_active":"2023-07-21T19:07:48.455308+0000","last_became_peered":"2023-07-21T19:07:48.455308+0000","last_unstale":"2023-07-21T19:07:53.835510+0000","last_undegraded":"2023-07-21T19:07:53.835510+0000","last_fullsized":"2023-07-21T19:07:53.835510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835286+0000","last_change":"2023-07-21T19:07:52.523627+0000","last_active":"2023-07-21T19:07:53.835286+0000","last_peered":"2023-07-21T19:07:53.835286+0000","last_clean":"2023-07-21T19:07:53.835286+0000","last_became_active":"2023-07-21T19:07:52.523029+0000","last_became_peered":"2023-07-21T19:07:52.523029+0000","last_unstale":"2023-07-21T19:07:53.835286+0000","last_undegraded":"2023-07-21T19:07:53.835286+0000","last_fullsized":"2023-07-21T19:07:53.835286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833239+0000","last_change":"2023-07-21T19:07:47.431726+0000","last_active":"2023-07-21T19:07:53.833239+0000","last_peered":"2023-07-21T19:07:53.833239+0000","last_clean":"2023-07-21T19:07:53.833239+0000","last_became_active":"2023-07-21T19:07:47.431482+0000","last_became_peered":"2023-07-21T19:07:47.431482+0000","last_unstale":"2023-07-21T19:07:53.833239+0000","last_undegraded":"2023-07-21T19:07:53.833239+0000","last_fullsized":"2023-07-21T19:07:53.833239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:43.739221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524914+0000","last_change":"2023-07-21T19:07:48.451700+0000","last_active":"2023-07-21T19:07:53.524914+0000","last_peered":"2023-07-21T19:07:53.524914+0000","last_clean":"2023-07-21T19:07:53.524914+0000","last_became_active":"2023-07-21T19:07:48.451403+0000","last_became_peered":"2023-07-21T19:07:48.451403+0000","last_unstale":"2023-07-21T19:07:53.524914+0000","last_undegraded":"2023-07-21T19:07:53.524914+0000","last_fullsized":"2023-07-21T19:07:53.524914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523591+0000","last_change":"2023-07-21T19:07:47.423135+0000","last_active":"2023-07-21T19:07:53.523591+0000","last_peered":"2023-07-21T19:07:53.523591+0000","last_clean":"2023-07-21T19:07:53.523591+0000","last_became_active":"2023-07-21T19:07:47.422803+0000","last_became_peered":"2023-07-21T19:07:47.422803+0000","last_unstale":"2023-07-21T19:07:53.523591+0000","last_undegraded":"2023-07-21T19:07:53.523591+0000","last_fullsized":"2023-07-21T19:07:53.523591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:28.397260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525042+0000","last_change":"2023-07-21T19:07:48.457131+0000","last_active":"2023-07-21T19:07:53.525042+0000","last_peered":"2023-07-21T19:07:53.525042+0000","last_clean":"2023-07-21T19:07:53.525042+0000","last_became_active":"2023-07-21T19:07:48.456793+0000","last_became_peered":"2023-07-21T19:07:48.456793+0000","last_unstale":"2023-07-21T19:07:53.525042+0000","last_undegraded":"2023-07-21T19:07:53.525042+0000","last_fullsized":"2023-07-21T19:07:53.525042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:01.458935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834400+0000","last_change":"2023-07-21T19:07:52.518169+0000","last_active":"2023-07-21T19:07:53.834400+0000","last_peered":"2023-07-21T19:07:53.834400+0000","last_clean":"2023-07-21T19:07:53.834400+0000","last_became_active":"2023-07-21T19:07:52.517772+0000","last_became_peered":"2023-07-21T19:07:52.517772+0000","last_unstale":"2023-07-21T19:07:53.834400+0000","last_undegraded":"2023-07-21T19:07:53.834400+0000","last_fullsized":"2023-07-21T19:07:53.834400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:51.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834407+0000","last_change":"2023-07-21T19:07:47.432451+0000","last_active":"2023-07-21T19:07:53.834407+0000","last_peered":"2023-07-21T19:07:53.834407+0000","last_clean":"2023-07-21T19:07:53.834407+0000","last_became_active":"2023-07-21T19:07:47.432158+0000","last_became_peered":"2023-07-21T19:07:47.432158+0000","last_unstale":"2023-07-21T19:07:53.834407+0000","last_undegraded":"2023-07-21T19:07:53.834407+0000","last_fullsized":"2023-07-21T19:07:53.834407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834759+0000","last_change":"2023-07-21T19:07:48.468705+0000","last_active":"2023-07-21T19:07:53.834759+0000","last_peered":"2023-07-21T19:07:53.834759+0000","last_clean":"2023-07-21T19:07:53.834759+0000","last_became_active":"2023-07-21T19:07:48.467669+0000","last_became_peered":"2023-07-21T19:07:48.467669+0000","last_unstale":"2023-07-21T19:07:53.834759+0000","last_undegraded":"2023-07-21T19:07:53.834759+0000","last_fullsized":"2023-07-21T19:07:53.834759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524694+0000","last_change":"2023-07-21T19:07:52.520703+0000","last_active":"2023-07-21T19:07:53.524694+0000","last_peered":"2023-07-21T19:07:53.524694+0000","last_clean":"2023-07-21T19:07:53.524694+0000","last_became_active":"2023-07-21T19:07:52.520253+0000","last_became_peered":"2023-07-21T19:07:52.520253+0000","last_unstale":"2023-07-21T19:07:53.524694+0000","last_undegraded":"2023-07-21T19:07:53.524694+0000","last_fullsized":"2023-07-21T19:07:53.524694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:48.840837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832788+0000","last_change":"2023-07-21T19:07:48.450536+0000","last_active":"2023-07-21T19:07:53.832788+0000","last_peered":"2023-07-21T19:07:53.832788+0000","last_clean":"2023-07-21T19:07:53.832788+0000","last_became_active":"2023-07-21T19:07:48.450167+0000","last_became_peered":"2023-07-21T19:07:48.450167+0000","last_unstale":"2023-07-21T19:07:53.832788+0000","last_undegraded":"2023-07-21T19:07:53.832788+0000","last_fullsized":"2023-07-21T19:07:53.832788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:38.287958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834518+0000","last_change":"2023-07-21T19:07:48.468556+0000","last_active":"2023-07-21T19:07:53.834518+0000","last_peered":"2023-07-21T19:07:53.834518+0000","last_clean":"2023-07-21T19:07:53.834518+0000","last_became_active":"2023-07-21T19:07:48.468254+0000","last_became_peered":"2023-07-21T19:07:48.468254+0000","last_unstale":"2023-07-21T19:07:53.834518+0000","last_undegraded":"2023-07-21T19:07:53.834518+0000","last_fullsized":"2023-07-21T19:07:53.834518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:44.578401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523567+0000","last_change":"2023-07-21T19:07:48.458141+0000","last_active":"2023-07-21T19:07:53.523567+0000","last_peered":"2023-07-21T19:07:53.523567+0000","last_clean":"2023-07-21T19:07:53.523567+0000","last_became_active":"2023-07-21T19:07:48.457777+0000","last_became_peered":"2023-07-21T19:07:48.457777+0000","last_unstale":"2023-07-21T19:07:53.523567+0000","last_undegraded":"2023-07-21T19:07:53.523567+0000","last_fullsized":"2023-07-21T19:07:53.523567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:26.864071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834004+0000","last_change":"2023-07-21T19:07:48.461028+0000","last_active":"2023-07-21T19:07:53.834004+0000","last_peered":"2023-07-21T19:07:53.834004+0000","last_clean":"2023-07-21T19:07:53.834004+0000","last_became_active":"2023-07-21T19:07:48.460706+0000","last_became_peered":"2023-07-21T19:07:48.460706+0000","last_unstale":"2023-07-21T19:07:53.834004+0000","last_undegraded":"2023-07-21T19:07:53.834004+0000","last_fullsized":"2023-07-21T19:07:53.834004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837596+0000","last_change":"2023-07-21T19:07:48.465807+0000","last_active":"2023-07-21T19:07:53.837596+0000","last_peered":"2023-07-21T19:07:53.837596+0000","last_clean":"2023-07-21T19:07:53.837596+0000","last_became_active":"2023-07-21T19:07:48.465438+0000","last_became_peered":"2023-07-21T19:07:48.465438+0000","last_unstale":"2023-07-21T19:07:53.837596+0000","last_undegraded":"2023-07-21T19:07:53.837596+0000","last_fullsized":"2023-07-21T19:07:53.837596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524894+0000","last_change":"2023-07-21T19:07:48.457206+0000","last_active":"2023-07-21T19:07:53.524894+0000","last_peered":"2023-07-21T19:07:53.524894+0000","last_clean":"2023-07-21T19:07:53.524894+0000","last_became_active":"2023-07-21T19:07:48.456904+0000","last_became_peered":"2023-07-21T19:07:48.456904+0000","last_unstale":"2023-07-21T19:07:53.524894+0000","last_undegraded":"2023-07-21T19:07:53.524894+0000","last_fullsized":"2023-07-21T19:07:53.524894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:27.588370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838192+0000","last_change":"2023-07-21T19:07:48.466649+0000","last_active":"2023-07-21T19:07:53.838192+0000","last_peered":"2023-07-21T19:07:53.838192+0000","last_clean":"2023-07-21T19:07:53.838192+0000","last_became_active":"2023-07-21T19:07:48.466399+0000","last_became_peered":"2023-07-21T19:07:48.466399+0000","last_unstale":"2023-07-21T19:07:53.838192+0000","last_undegraded":"2023-07-21T19:07:53.838192+0000","last_fullsized":"2023-07-21T19:07:53.838192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836840+0000","last_change":"2023-07-21T19:07:48.457556+0000","last_active":"2023-07-21T19:07:53.836840+0000","last_peered":"2023-07-21T19:07:53.836840+0000","last_clean":"2023-07-21T19:07:53.836840+0000","last_became_active":"2023-07-21T19:07:48.457008+0000","last_became_peered":"2023-07-21T19:07:48.457008+0000","last_unstale":"2023-07-21T19:07:53.836840+0000","last_undegraded":"2023-07-21T19:07:53.836840+0000","last_fullsized":"2023-07-21T19:07:53.836840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832601+0000","last_change":"2023-07-21T19:07:48.459157+0000","last_active":"2023-07-21T19:07:53.832601+0000","last_peered":"2023-07-21T19:07:53.832601+0000","last_clean":"2023-07-21T19:07:53.832601+0000","last_became_active":"2023-07-21T19:07:48.458742+0000","last_became_peered":"2023-07-21T19:07:48.458742+0000","last_unstale":"2023-07-21T19:07:53.832601+0000","last_undegraded":"2023-07-21T19:07:53.832601+0000","last_fullsized":"2023-07-21T19:07:53.832601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834329+0000","last_change":"2023-07-21T19:07:48.460206+0000","last_active":"2023-07-21T19:07:53.834329+0000","last_peered":"2023-07-21T19:07:53.834329+0000","last_clean":"2023-07-21T19:07:53.834329+0000","last_became_active":"2023-07-21T19:07:48.459889+0000","last_became_peered":"2023-07-21T19:07:48.459889+0000","last_unstale":"2023-07-21T19:07:53.834329+0000","last_undegraded":"2023-07-21T19:07:53.834329+0000","last_fullsized":"2023-07-21T19:07:53.834329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523456+0000","last_change":"2023-07-21T19:07:48.467621+0000","last_active":"2023-07-21T19:07:53.523456+0000","last_peered":"2023-07-21T19:07:53.523456+0000","last_clean":"2023-07-21T19:07:53.523456+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.523456+0000","last_undegraded":"2023-07-21T19:07:53.523456+0000","last_fullsized":"2023-07-21T19:07:53.523456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:17.804609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834253+0000","last_change":"2023-07-21T19:07:48.460711+0000","last_active":"2023-07-21T19:07:53.834253+0000","last_peered":"2023-07-21T19:07:53.834253+0000","last_clean":"2023-07-21T19:07:53.834253+0000","last_became_active":"2023-07-21T19:07:48.459973+0000","last_became_peered":"2023-07-21T19:07:48.459973+0000","last_unstale":"2023-07-21T19:07:53.834253+0000","last_undegraded":"2023-07-21T19:07:53.834253+0000","last_fullsized":"2023-07-21T19:07:53.834253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:00.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524979+0000","last_change":"2023-07-21T19:07:48.458886+0000","last_active":"2023-07-21T19:07:53.524979+0000","last_peered":"2023-07-21T19:07:53.524979+0000","last_clean":"2023-07-21T19:07:53.524979+0000","last_became_active":"2023-07-21T19:07:48.458061+0000","last_became_peered":"2023-07-21T19:07:48.458061+0000","last_unstale":"2023-07-21T19:07:53.524979+0000","last_undegraded":"2023-07-21T19:07:53.524979+0000","last_fullsized":"2023-07-21T19:07:53.524979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:33.659391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836557+0000","last_change":"2023-07-21T19:07:48.462686+0000","last_active":"2023-07-21T19:07:53.836557+0000","last_peered":"2023-07-21T19:07:53.836557+0000","last_clean":"2023-07-21T19:07:53.836557+0000","last_became_active":"2023-07-21T19:07:48.462297+0000","last_became_peered":"2023-07-21T19:07:48.462297+0000","last_unstale":"2023-07-21T19:07:53.836557+0000","last_undegraded":"2023-07-21T19:07:53.836557+0000","last_fullsized":"2023-07-21T19:07:53.836557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:34:16.617396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523127+0000","last_change":"2023-07-21T19:07:48.447297+0000","last_active":"2023-07-21T19:07:53.523127+0000","last_peered":"2023-07-21T19:07:53.523127+0000","last_clean":"2023-07-21T19:07:53.523127+0000","last_became_active":"2023-07-21T19:07:48.446963+0000","last_became_peered":"2023-07-21T19:07:48.446963+0000","last_unstale":"2023-07-21T19:07:53.523127+0000","last_undegraded":"2023-07-21T19:07:53.523127+0000","last_fullsized":"2023-07-21T19:07:53.523127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:33.698602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525034+0000","last_change":"2023-07-21T19:07:48.459709+0000","last_active":"2023-07-21T19:07:53.525034+0000","last_peered":"2023-07-21T19:07:53.525034+0000","last_clean":"2023-07-21T19:07:53.525034+0000","last_became_active":"2023-07-21T19:07:48.459450+0000","last_became_peered":"2023-07-21T19:07:48.459450+0000","last_unstale":"2023-07-21T19:07:53.525034+0000","last_undegraded":"2023-07-21T19:07:53.525034+0000","last_fullsized":"2023-07-21T19:07:53.525034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522497+0000","last_change":"2023-07-21T19:07:48.451039+0000","last_active":"2023-07-21T19:07:53.522497+0000","last_peered":"2023-07-21T19:07:53.522497+0000","last_clean":"2023-07-21T19:07:53.522497+0000","last_became_active":"2023-07-21T19:07:48.450731+0000","last_became_peered":"2023-07-21T19:07:48.450731+0000","last_unstale":"2023-07-21T19:07:53.522497+0000","last_undegraded":"2023-07-21T19:07:53.522497+0000","last_fullsized":"2023-07-21T19:07:53.522497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:26:01.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833016+0000","last_change":"2023-07-21T19:07:48.472483+0000","last_active":"2023-07-21T19:07:53.833016+0000","last_peered":"2023-07-21T19:07:53.833016+0000","last_clean":"2023-07-21T19:07:53.833016+0000","last_became_active":"2023-07-21T19:07:48.472205+0000","last_became_peered":"2023-07-21T19:07:48.472205+0000","last_unstale":"2023-07-21T19:07:53.833016+0000","last_undegraded":"2023-07-21T19:07:53.833016+0000","last_fullsized":"2023-07-21T19:07:53.833016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:40.712184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523605+0000","last_change":"2023-07-21T19:07:48.450016+0000","last_active":"2023-07-21T19:07:53.523605+0000","last_peered":"2023-07-21T19:07:53.523605+0000","last_clean":"2023-07-21T19:07:53.523605+0000","last_became_active":"2023-07-21T19:07:48.449429+0000","last_became_peered":"2023-07-21T19:07:48.449429+0000","last_unstale":"2023-07-21T19:07:53.523605+0000","last_undegraded":"2023-07-21T19:07:53.523605+0000","last_fullsized":"2023-07-21T19:07:53.523605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837435+0000","last_change":"2023-07-21T19:07:48.458714+0000","last_active":"2023-07-21T19:07:53.837435+0000","last_peered":"2023-07-21T19:07:53.837435+0000","last_clean":"2023-07-21T19:07:53.837435+0000","last_became_active":"2023-07-21T19:07:48.458388+0000","last_became_peered":"2023-07-21T19:07:48.458388+0000","last_unstale":"2023-07-21T19:07:53.837435+0000","last_undegraded":"2023-07-21T19:07:53.837435+0000","last_fullsized":"2023-07-21T19:07:53.837435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:07.621195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838125+0000","last_change":"2023-07-21T19:07:48.449982+0000","last_active":"2023-07-21T19:07:53.838125+0000","last_peered":"2023-07-21T19:07:53.838125+0000","last_clean":"2023-07-21T19:07:53.838125+0000","last_became_active":"2023-07-21T19:07:48.449092+0000","last_became_peered":"2023-07-21T19:07:48.449092+0000","last_unstale":"2023-07-21T19:07:53.838125+0000","last_undegraded":"2023-07-21T19:07:53.838125+0000","last_fullsized":"2023-07-21T19:07:53.838125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:10.674404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524046+0000","last_change":"2023-07-21T19:07:48.460970+0000","last_active":"2023-07-21T19:07:53.524046+0000","last_peered":"2023-07-21T19:07:53.524046+0000","last_clean":"2023-07-21T19:07:53.524046+0000","last_became_active":"2023-07-21T19:07:48.460263+0000","last_became_peered":"2023-07-21T19:07:48.460263+0000","last_unstale":"2023-07-21T19:07:53.524046+0000","last_undegraded":"2023-07-21T19:07:53.524046+0000","last_fullsized":"2023-07-21T19:07:53.524046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:09.964570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524908+0000","last_change":"2023-07-21T19:07:48.460703+0000","last_active":"2023-07-21T19:07:53.524908+0000","last_peered":"2023-07-21T19:07:53.524908+0000","last_clean":"2023-07-21T19:07:53.524908+0000","last_became_active":"2023-07-21T19:07:48.460406+0000","last_became_peered":"2023-07-21T19:07:48.460406+0000","last_unstale":"2023-07-21T19:07:53.524908+0000","last_undegraded":"2023-07-21T19:07:53.524908+0000","last_fullsized":"2023-07-21T19:07:53.524908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:10.593044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524839+0000","last_change":"2023-07-21T19:07:48.452496+0000","last_active":"2023-07-21T19:07:53.524839+0000","last_peered":"2023-07-21T19:07:53.524839+0000","last_clean":"2023-07-21T19:07:53.524839+0000","last_became_active":"2023-07-21T19:07:48.452235+0000","last_became_peered":"2023-07-21T19:07:48.452235+0000","last_unstale":"2023-07-21T19:07:53.524839+0000","last_undegraded":"2023-07-21T19:07:53.524839+0000","last_fullsized":"2023-07-21T19:07:53.524839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523126+0000","last_change":"2023-07-21T19:07:48.445166+0000","last_active":"2023-07-21T19:07:53.523126+0000","last_peered":"2023-07-21T19:07:53.523126+0000","last_clean":"2023-07-21T19:07:53.523126+0000","last_became_active":"2023-07-21T19:07:48.444852+0000","last_became_peered":"2023-07-21T19:07:48.444852+0000","last_unstale":"2023-07-21T19:07:53.523126+0000","last_undegraded":"2023-07-21T19:07:53.523126+0000","last_fullsized":"2023-07-21T19:07:53.523126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832791+0000","last_change":"2023-07-21T19:07:48.468451+0000","last_active":"2023-07-21T19:07:53.832791+0000","last_peered":"2023-07-21T19:07:53.832791+0000","last_clean":"2023-07-21T19:07:53.832791+0000","last_became_active":"2023-07-21T19:07:48.468185+0000","last_became_peered":"2023-07-21T19:07:48.468185+0000","last_unstale":"2023-07-21T19:07:53.832791+0000","last_undegraded":"2023-07-21T19:07:53.832791+0000","last_fullsized":"2023-07-21T19:07:53.832791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523196+0000","last_change":"2023-07-21T19:07:48.449895+0000","last_active":"2023-07-21T19:07:53.523196+0000","last_peered":"2023-07-21T19:07:53.523196+0000","last_clean":"2023-07-21T19:07:53.523196+0000","last_became_active":"2023-07-21T19:07:48.449511+0000","last_became_peered":"2023-07-21T19:07:48.449511+0000","last_unstale":"2023-07-21T19:07:53.523196+0000","last_undegraded":"2023-07-21T19:07:53.523196+0000","last_fullsized":"2023-07-21T19:07:53.523196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:55.510661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524314+0000","last_change":"2023-07-21T19:07:48.458380+0000","last_active":"2023-07-21T19:07:53.524314+0000","last_peered":"2023-07-21T19:07:53.524314+0000","last_clean":"2023-07-21T19:07:53.524314+0000","last_became_active":"2023-07-21T19:07:48.458092+0000","last_became_peered":"2023-07-21T19:07:48.458092+0000","last_unstale":"2023-07-21T19:07:53.524314+0000","last_undegraded":"2023-07-21T19:07:53.524314+0000","last_fullsized":"2023-07-21T19:07:53.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834522+0000","last_change":"2023-07-21T19:07:48.458478+0000","last_active":"2023-07-21T19:07:53.834522+0000","last_peered":"2023-07-21T19:07:53.834522+0000","last_clean":"2023-07-21T19:07:53.834522+0000","last_became_active":"2023-07-21T19:07:48.458191+0000","last_became_peered":"2023-07-21T19:07:48.458191+0000","last_unstale":"2023-07-21T19:07:53.834522+0000","last_undegraded":"2023-07-21T19:07:53.834522+0000","last_fullsized":"2023-07-21T19:07:53.834522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:04.609626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523852+0000","last_change":"2023-07-21T19:07:48.456833+0000","last_active":"2023-07-21T19:07:53.523852+0000","last_peered":"2023-07-21T19:07:53.523852+0000","last_clean":"2023-07-21T19:07:53.523852+0000","last_became_active":"2023-07-21T19:07:48.456319+0000","last_became_peered":"2023-07-21T19:07:48.456319+0000","last_unstale":"2023-07-21T19:07:53.523852+0000","last_undegraded":"2023-07-21T19:07:53.523852+0000","last_fullsized":"2023-07-21T19:07:53.523852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:40.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524737+0000","last_change":"2023-07-21T19:07:48.453854+0000","last_active":"2023-07-21T19:07:53.524737+0000","last_peered":"2023-07-21T19:07:53.524737+0000","last_clean":"2023-07-21T19:07:53.524737+0000","last_became_active":"2023-07-21T19:07:48.453560+0000","last_became_peered":"2023-07-21T19:07:48.453560+0000","last_unstale":"2023-07-21T19:07:53.524737+0000","last_undegraded":"2023-07-21T19:07:53.524737+0000","last_fullsized":"2023-07-21T19:07:53.524737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:54.789012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838394+0000","last_change":"2023-07-21T19:07:48.451024+0000","last_active":"2023-07-21T19:07:53.838394+0000","last_peered":"2023-07-21T19:07:53.838394+0000","last_clean":"2023-07-21T19:07:53.838394+0000","last_became_active":"2023-07-21T19:07:48.450678+0000","last_became_peered":"2023-07-21T19:07:48.450678+0000","last_unstale":"2023-07-21T19:07:53.838394+0000","last_undegraded":"2023-07-21T19:07:53.838394+0000","last_fullsized":"2023-07-21T19:07:53.838394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:56:56.585283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4450,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T19:08:10.392 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T19:08:10.392 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-21T19:08:10.393 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-21T19:08:10.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-21T19:08:10.393 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-21T19:08:10.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 Processor -- start 2023-07-21T19:08:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 -- start start 2023-07-21T19:08:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 0x7fb85806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8580cb180 0x7fb8580ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8580ca8a0 con 0x7fb85806dc50 2023-07-21T19:08:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580cbcd0 con 0x7fb85815ffa0 2023-07-21T19:08:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.588+0000 7fb85ce40700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580cbf70 con 0x7fb8580cb180 2023-07-21T19:08:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8577fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 0x7fb85806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8577fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 0x7fb85806d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44102/0 (socket says 172.21.15.123:44102) 2023-07-21T19:08:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8577fe700 1 -- 172.21.15.123:0/3267499158 learned_addr learned my addr 172.21.15.123:0/3267499158 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb857fff700 1 --2- 172.21.15.123:0/3267499158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8580cb180 0x7fb8580ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb857fff700 1 -- 172.21.15.123:0/3267499158 >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 msgr2=0x7fb85806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb857fff700 1 --2- 172.21.15.123:0/3267499158 >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 0x7fb85806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb857fff700 1 -- 172.21.15.123:0/3267499158 >> v1:172.21.15.145:6789/0 conn(0x7fb85806dc50 legacy=0x7fb8580caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb857fff700 1 -- 172.21.15.123:0/3267499158 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580cc250 con 0x7fb8580cb180 2023-07-21T19:08:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8577fe700 1 --2- 172.21.15.123:0/3267499158 >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 0x7fb85806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb857fff700 1 --2- 172.21.15.123:0/3267499158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8580cb180 0x7fb8580ce340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb850009d90 tx=0x7fb85000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768c0d1cef33633a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:10.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8567fc700 1 -- 172.21.15.123:0/3267499158 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000e070 con 0x7fb8580cb180 2023-07-21T19:08:10.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8567fc700 1 -- 172.21.15.123:0/3267499158 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000bb20 con 0x7fb8580cb180 2023-07-21T19:08:10.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb8567fc700 1 -- 172.21.15.123:0/3267499158 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850012430 con 0x7fb8580cb180 2023-07-21T19:08:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb85ce40700 1 -- 172.21.15.123:0/3267499158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8580cb180 msgr2=0x7fb8580ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb85ce40700 1 --2- 172.21.15.123:0/3267499158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8580cb180 0x7fb8580ce340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb850009d90 tx=0x7fb85000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb85ce40700 1 -- 172.21.15.123:0/3267499158 shutdown_connections 2023-07-21T19:08:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb85ce40700 1 --2- 172.21.15.123:0/3267499158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8580cb180 0x7fb8580ce340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb85ce40700 1 --2- 172.21.15.123:0/3267499158 >> v2:172.21.15.145:3300/0 conn(0x7fb85815ffa0 0x7fb85806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.592+0000 7fb85ce40700 1 -- 172.21.15.123:0/3267499158 >> 172.21.15.123:0/3267499158 conn(0x7fb85806e960 msgr2=0x7fb85806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:10.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.596+0000 7fb85ce40700 1 -- 172.21.15.123:0/3267499158 shutdown_connections 2023-07-21T19:08:10.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.596+0000 7fb85ce40700 1 -- 172.21.15.123:0/3267499158 wait complete. 2023-07-21T19:08:10.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.596+0000 7fb85ce40700 1 Processor -- start 2023-07-21T19:08:10.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.596+0000 7fb85ce40700 1 -- start start 2023-07-21T19:08:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 0x7fb85814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8580cb180 0x7fb8580bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb85815ffa0 0x7fb8580bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c7b60 con 0x7fb85806dc50 2023-07-21T19:08:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85814be70 con 0x7fb8580cb180 2023-07-21T19:08:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580bed30 con 0x7fb85815ffa0 2023-07-21T19:08:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 0x7fb85814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 0x7fb85814ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58858/0 (socket says 172.21.15.123:58858) 2023-07-21T19:08:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 -- 172.21.15.123:0/279115392 learned_addr learned my addr 172.21.15.123:0/279115392 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:10.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb857fff700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb85815ffa0 0x7fb8580bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb856ffd700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8580cb180 0x7fb8580bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 -- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb85815ffa0 msgr2=0x7fb8580bd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb85815ffa0 0x7fb8580bd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 -- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8580cb180 msgr2=0x7fb8580bcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8580cb180 0x7fb8580bcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 -- 172.21.15.123:0/279115392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009570 con 0x7fb85806dc50 2023-07-21T19:08:10.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb8577fe700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 0x7fb85814ae50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb84800ec10 tx=0x7fb84800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:10.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800c850 con 0x7fb85806dc50 2023-07-21T19:08:10.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800c9b0 con 0x7fb85806dc50 2023-07-21T19:08:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb850009a70 con 0x7fb85806dc50 2023-07-21T19:08:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800cd20 con 0x7fb85806dc50 2023-07-21T19:08:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.600+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8580c7880 con 0x7fb85806dc50 2023-07-21T19:08:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.604+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb858071620 con 0x7fb85806dc50 2023-07-21T19:08:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.604+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb848013470 con 0x7fb85806dc50 2023-07-21T19:08:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.608+0000 7fb83ffff700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb844066320 0x7fb8440687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.608+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb848083df0 con 0x7fb85806dc50 2023-07-21T19:08:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.608+0000 7fb856ffd700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb844066320 0x7fb8440687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.608+0000 7fb856ffd700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb844066320 0x7fb8440687d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb85815f090 tx=0x7fb84c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:10.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.612+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb848050e50 con 0x7fb85806dc50 2023-07-21T19:08:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.832+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb85804e500 con 0x7fb85806dc50 2023-07-21T19:08:10.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.836+0000 7fb83ffff700 1 -- 172.21.15.123:0/279115392 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164248 (secure 0 0 0) 0x7fb848017090 con 0x7fb85806dc50 2023-07-21T19:08:10.853 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb844066320 msgr2=0x7fb8440687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb844066320 0x7fb8440687d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb85815f090 tx=0x7fb84c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 msgr2=0x7fb85814ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 0x7fb85814ae50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb84800ec10 tx=0x7fb84800ef20 comp rx=0 tx=0).stop 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 shutdown_connections 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb844066320 0x7fb8440687d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8580cb180 0x7fb8580bcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb85815ffa0 0x7fb8580bd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 --2- 172.21.15.123:0/279115392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85806dc50 0x7fb85814ae50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:10.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 >> 172.21.15.123:0/279115392 conn(0x7fb85806e960 msgr2=0x7fb8580b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:10.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 shutdown_connections 2023-07-21T19:08:10.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:10.844+0000 7fb85ce40700 1 -- 172.21.15.123:0/279115392 wait complete. 2023-07-21T19:08:10.878 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1650121890},{"type":"v1","addr":"172.21.15.123:6833","nonce":1650121890}]},"active_addr":"172.21.15.123:6833/1650121890","active_change":"2023-07-21T19:07:27.854617+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1735667411}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2549017442}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1852380576}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":543315408}]}]} 2023-07-21T19:08:10.885 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-21T19:08:10.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-21T19:08:10.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:11.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.056+0000 7f25580d6700 1 Processor -- start 2023-07-21T19:08:11.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.056+0000 7f25580d6700 1 -- start start 2023-07-21T19:08:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f25580d6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f25500cddb0 0x7f2550070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f25580d6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2550070ea0 0x7f25500afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f25580d6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25500c8900 con 0x7f2550160640 2023-07-21T19:08:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f25580d6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500c8fc0 con 0x7f25500cddb0 2023-07-21T19:08:11.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f25580d6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2550070540 con 0x7f2550070ea0 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2555e72700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2550160640 0x7f2550164000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38060/0 (socket says 172.21.15.123:38060) 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2555e72700 1 -- 172.21.15.123:0/348266556 learned_addr learned my addr 172.21.15.123:0/348266556 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2556673700 1 --2- 172.21.15.123:0/348266556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2550070ea0 0x7f25500afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2555671700 1 --2- 172.21.15.123:0/348266556 >> v2:172.21.15.145:3300/0 conn(0x7f25500cddb0 0x7f2550070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2554e70700 1 -- 172.21.15.123:0/348266556 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118375475 0 0) 0x7f25500c8900 con 0x7f2550160640 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2554e70700 1 -- 172.21.15.123:0/348266556 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f253c0035d0 con 0x7f2550160640 2023-07-21T19:08:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2556673700 1 -- 172.21.15.123:0/348266556 >> v2:172.21.15.145:3300/0 conn(0x7f25500cddb0 msgr2=0x7f2550070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2556673700 1 --2- 172.21.15.123:0/348266556 >> v2:172.21.15.145:3300/0 conn(0x7f25500cddb0 0x7f2550070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2556673700 1 -- 172.21.15.123:0/348266556 >> v1:172.21.15.123:6789/0 conn(0x7f2550160640 legacy=0x7f2550164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2556673700 1 -- 172.21.15.123:0/348266556 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500caae0 con 0x7f2550070ea0 2023-07-21T19:08:11.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2555671700 1 --2- 172.21.15.123:0/348266556 >> v2:172.21.15.145:3300/0 conn(0x7f25500cddb0 0x7f2550070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:11.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.060+0000 7f2556673700 1 --2- 172.21.15.123:0/348266556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2550070ea0 0x7f25500afd30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2548009d90 tx=0x7f254800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310c3d53f0ec6be4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f2554e70700 1 -- 172.21.15.123:0/348266556 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254800e070 con 0x7f2550070ea0 2023-07-21T19:08:11.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f2554e70700 1 -- 172.21.15.123:0/348266556 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254800bb20 con 0x7f2550070ea0 2023-07-21T19:08:11.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f2554e70700 1 -- 172.21.15.123:0/348266556 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548012430 con 0x7f2550070ea0 2023-07-21T19:08:11.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 -- 172.21.15.123:0/348266556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2550070ea0 msgr2=0x7f25500afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 --2- 172.21.15.123:0/348266556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2550070ea0 0x7f25500afd30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2548009d90 tx=0x7f254800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:11.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 -- 172.21.15.123:0/348266556 shutdown_connections 2023-07-21T19:08:11.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 --2- 172.21.15.123:0/348266556 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2550070ea0 0x7f25500afd30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 --2- 172.21.15.123:0/348266556 >> v2:172.21.15.145:3300/0 conn(0x7f25500cddb0 0x7f2550070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 -- 172.21.15.123:0/348266556 >> 172.21.15.123:0/348266556 conn(0x7f25500cad30 msgr2=0x7f25500cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 -- 172.21.15.123:0/348266556 shutdown_connections 2023-07-21T19:08:11.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.064+0000 7f25580d6700 1 -- 172.21.15.123:0/348266556 wait complete. 2023-07-21T19:08:11.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 Processor -- start 2023-07-21T19:08:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 -- start start 2023-07-21T19:08:11.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2550070ea0 0x7f25500c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f25500cddb0 0x7f255014d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 0x7f25500c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c58d0 con 0x7f2550160640 2023-07-21T19:08:11.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c5bb0 con 0x7f2550070ea0 2023-07-21T19:08:11.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f25580d6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c5e90 con 0x7f25500cddb0 2023-07-21T19:08:11.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f2556673700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 0x7f25500c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f2556673700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 0x7f25500c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58862/0 (socket says 172.21.15.123:58862) 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.068+0000 7f2556673700 1 -- 172.21.15.123:0/1551562627 learned_addr learned my addr 172.21.15.123:0/1551562627 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2555671700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f25500cddb0 0x7f255014d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2555e72700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2550070ea0 0x7f25500c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2556673700 1 -- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f25500cddb0 msgr2=0x7f255014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2556673700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f25500cddb0 0x7f255014d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2556673700 1 -- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2550070ea0 msgr2=0x7f25500c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2556673700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2550070ea0 0x7f25500c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2556673700 1 -- 172.21.15.123:0/1551562627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400094b0 con 0x7f2550160640 2023-07-21T19:08:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f2556673700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 0x7f25500c7b40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2548014040 tx=0x7f2548004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548012430 con 0x7f2550160640 2023-07-21T19:08:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548020070 con 0x7f2550160640 2023-07-21T19:08:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480098f0 con 0x7f2550160640 2023-07-21T19:08:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2548009a70 con 0x7f2550160640 2023-07-21T19:08:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25500c6450 con 0x7f2550160640 2023-07-21T19:08:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.072+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255004dcb0 con 0x7f2550160640 2023-07-21T19:08:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.076+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2548004040 con 0x7f2550160640 2023-07-21T19:08:11.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.076+0000 7f25467fc700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25340662f0 0x7f25340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.076+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2548022070 con 0x7f2550160640 2023-07-21T19:08:11.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.076+0000 7f2555e72700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25340662f0 0x7f25340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.080+0000 7f2555e72700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25340662f0 0x7f25340687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f254c007fd0 tx=0x7f254c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.084+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2548056750 con 0x7f2550160640 2023-07-21T19:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.256+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2550163a40 con 0x7f2550160640 2023-07-21T19:08:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.256+0000 7f25467fc700 1 -- 172.21.15.123:0/1551562627 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f25480562e0 con 0x7f2550160640 2023-07-21T19:08:11.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:11.272 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25340662f0 msgr2=0x7f25340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25340662f0 0x7f25340687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f254c007fd0 tx=0x7f254c007de0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 msgr2=0x7f25500c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 0x7f25500c7b40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2548014040 tx=0x7f2548004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 shutdown_connections 2023-07-21T19:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25340662f0 0x7f25340687a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2550160640 0x7f25500c7b40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f25500cddb0 0x7f255014d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 --2- 172.21.15.123:0/1551562627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2550070ea0 0x7f25500c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 >> 172.21.15.123:0/1551562627 conn(0x7f25500cad30 msgr2=0x7f25500b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 shutdown_connections 2023-07-21T19:08:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.260+0000 7f25580d6700 1 -- 172.21.15.123:0/1551562627 wait complete. 2023-07-21T19:08:11.297 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-21T19:08:11.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:11.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 Processor -- start 2023-07-21T19:08:11.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 -- start start 2023-07-21T19:08:11.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f77900ceff0 0x7f77900afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77900af0a0 con 0x7f779015bff0 2023-07-21T19:08:11.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900cf470 con 0x7f77900ceff0 2023-07-21T19:08:11.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f7794b7a700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900cf720 con 0x7f77900cd240 2023-07-21T19:08:11.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.464+0000 7f778f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f779015bff0 0x7f77900ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38068/0 (socket says 172.21.15.123:38068) 2023-07-21T19:08:11.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778f7fe700 1 -- 172.21.15.123:0/3085490981 learned_addr learned my addr 172.21.15.123:0/3085490981 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:11.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778effd700 1 --2- 172.21.15.123:0/3085490981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778ffff700 1 --2- 172.21.15.123:0/3085490981 >> v2:172.21.15.145:3300/0 conn(0x7f77900ceff0 0x7f77900afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778effd700 1 -- 172.21.15.123:0/3085490981 >> v2:172.21.15.145:3300/0 conn(0x7f77900ceff0 msgr2=0x7f77900afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778effd700 1 --2- 172.21.15.123:0/3085490981 >> v2:172.21.15.145:3300/0 conn(0x7f77900ceff0 0x7f77900afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778effd700 1 -- 172.21.15.123:0/3085490981 >> v1:172.21.15.123:6789/0 conn(0x7f779015bff0 legacy=0x7f77900ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778effd700 1 -- 172.21.15.123:0/3085490981 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900af2f0 con 0x7f77900cd240 2023-07-21T19:08:11.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778e7fc700 1 -- 172.21.15.123:0/3085490981 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878029161 0 0) 0x7f77900af0a0 con 0x7f779015bff0 2023-07-21T19:08:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778effd700 1 --2- 172.21.15.123:0/3085490981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900ceab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7784009850 tx=0x7f7784009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42acb716279e7959 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778e7fc700 1 -- 172.21.15.123:0/3085490981 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784011830 con 0x7f77900cd240 2023-07-21T19:08:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778e7fc700 1 -- 172.21.15.123:0/3085490981 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784011990 con 0x7f77900cd240 2023-07-21T19:08:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f778e7fc700 1 -- 172.21.15.123:0/3085490981 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784011d40 con 0x7f77900cd240 2023-07-21T19:08:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 -- 172.21.15.123:0/3085490981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 msgr2=0x7f77900ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 --2- 172.21.15.123:0/3085490981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900ceab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7784009850 tx=0x7f7784009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:11.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 -- 172.21.15.123:0/3085490981 shutdown_connections 2023-07-21T19:08:11.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 --2- 172.21.15.123:0/3085490981 >> v2:172.21.15.145:3300/0 conn(0x7f77900ceff0 0x7f77900afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 --2- 172.21.15.123:0/3085490981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900ceab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 -- 172.21.15.123:0/3085490981 >> 172.21.15.123:0/3085490981 conn(0x7f7790060c40 msgr2=0x7f779009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 -- 172.21.15.123:0/3085490981 shutdown_connections 2023-07-21T19:08:11.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.468+0000 7f7794b7a700 1 -- 172.21.15.123:0/3085490981 wait complete. 2023-07-21T19:08:11.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 Processor -- start 2023-07-21T19:08:11.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 -- start start 2023-07-21T19:08:11.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77900ceff0 0x7f77901f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 0x7f77901ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77901f68c0 con 0x7f779015bff0 2023-07-21T19:08:11.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900cb130 con 0x7f77900ceff0 2023-07-21T19:08:11.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f7794b7a700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900cb410 con 0x7f77900cd240 2023-07-21T19:08:11.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f778ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 0x7f77901ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f778ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 0x7f77901ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58874/0 (socket says 172.21.15.123:58874) 2023-07-21T19:08:11.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f778ffff700 1 -- 172.21.15.123:0/1205937011 learned_addr learned my addr 172.21.15.123:0/1205937011 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f778effd700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77900ceff0 0x7f77901f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.472+0000 7f778f7fe700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f778ffff700 1 -- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 msgr2=0x7f77900cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f778ffff700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f778ffff700 1 -- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77900ceff0 msgr2=0x7f77901f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f778ffff700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77900ceff0 0x7f77901f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f778ffff700 1 -- 172.21.15.123:0/1205937011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840094b0 con 0x7f779015bff0 2023-07-21T19:08:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f778ffff700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 0x7f77901ef490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f778800efc0 tx=0x7f778800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800cad0 con 0x7f779015bff0 2023-07-21T19:08:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800f040 con 0x7f779015bff0 2023-07-21T19:08:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77900cb6f0 con 0x7f779015bff0 2023-07-21T19:08:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800ce70 con 0x7f779015bff0 2023-07-21T19:08:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77900cbcb0 con 0x7f779015bff0 2023-07-21T19:08:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.476+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77900cbed0 con 0x7f779015bff0 2023-07-21T19:08:11.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.480+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7788014480 con 0x7f779015bff0 2023-07-21T19:08:11.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.480+0000 7f7777fff700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f777c0662f0 0x7f777c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.480+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7788084720 con 0x7f779015bff0 2023-07-21T19:08:11.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.480+0000 7f778f7fe700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f777c0662f0 0x7f777c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.480+0000 7f778f7fe700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f777c0662f0 0x7f777c0687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7780000f60 tx=0x7f7780007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.484+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7788051950 con 0x7f779015bff0 2023-07-21T19:08:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.656+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f779004e500 con 0x7f779015bff0 2023-07-21T19:08:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7777fff700 1 -- 172.21.15.123:0/1205937011 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f7788054f70 con 0x7f779015bff0 2023-07-21T19:08:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:11.672 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f777c0662f0 msgr2=0x7f777c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f777c0662f0 0x7f777c0687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7780000f60 tx=0x7f7780007e90 comp rx=0 tx=0).stop 2023-07-21T19:08:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 msgr2=0x7f77901ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 0x7f77901ef490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f778800efc0 tx=0x7f778800c0c0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 shutdown_connections 2023-07-21T19:08:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f777c0662f0 0x7f777c0687a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77900ceff0 0x7f77901f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f779015bff0 0x7f77901ef490 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 --2- 172.21.15.123:0/1205937011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77900cd240 0x7f77900cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 >> 172.21.15.123:0/1205937011 conn(0x7f7790060c40 msgr2=0x7f77900d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 shutdown_connections 2023-07-21T19:08:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.660+0000 7f7794b7a700 1 -- 172.21.15.123:0/1205937011 wait complete. 2023-07-21T19:08:11.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-21T19:08:11.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-21T19:08:11.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-21T19:08:11.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-21T19:08:11.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-21T19:08:11.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-21T19:08:11.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-21T19:08:11.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-21T19:08:11.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.916+0000 7fa58f5c6700 1 Processor -- start 2023-07-21T19:08:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.916+0000 7fa58f5c6700 1 -- start start 2023-07-21T19:08:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58f5c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa58815ce50 0x7fa5880cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58f5c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5880ce620 0x7fa58815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58f5c6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880cb960 con 0x7fa5880acb10 2023-07-21T19:08:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58f5c6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880cdc00 con 0x7fa5880ce620 2023-07-21T19:08:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58f5c6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880caba0 con 0x7fa58815ce50 2023-07-21T19:08:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5880ce620 0x7fa58815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5880ce620 0x7fa58815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58888/0 (socket says 172.21.15.123:58888) 2023-07-21T19:08:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 -- 172.21.15.123:0/981030693 learned_addr learned my addr 172.21.15.123:0/981030693 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58d362700 1 --2- 172.21.15.123:0/981030693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa58815ce50 0x7fa5880cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 -- 172.21.15.123:0/981030693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa58815ce50 msgr2=0x7fa5880cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 --2- 172.21.15.123:0/981030693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa58815ce50 0x7fa5880cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 -- 172.21.15.123:0/981030693 >> v1:172.21.15.123:6789/0 conn(0x7fa5880acb10 legacy=0x7fa5880cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 -- 172.21.15.123:0/981030693 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880cae80 con 0x7fa5880ce620 2023-07-21T19:08:11.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.920+0000 7fa58db63700 1 --2- 172.21.15.123:0/981030693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa58815f790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e50 tx=0x7fa58000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a19ca841e44494 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa57ffff700 1 -- 172.21.15.123:0/981030693 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000e070 con 0x7fa5880ce620 2023-07-21T19:08:11.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa57ffff700 1 -- 172.21.15.123:0/981030693 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000b910 con 0x7fa5880ce620 2023-07-21T19:08:11.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 -- 172.21.15.123:0/981030693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 msgr2=0x7fa58815f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 --2- 172.21.15.123:0/981030693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa58815f790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e50 tx=0x7fa58000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:11.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7f2f91400700 1 Processor -- start 2023-07-21T19:08:11.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 -- 172.21.15.123:0/981030693 shutdown_connections 2023-07-21T19:08:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 --2- 172.21.15.123:0/981030693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa58815f790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 --2- 172.21.15.123:0/981030693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa58815ce50 0x7fa5880cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 -- 172.21.15.123:0/981030693 >> 172.21.15.123:0/981030693 conn(0x7fa588060320 msgr2=0x7fa5880606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7f2f91400700 1 -- start start 2023-07-21T19:08:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 -- 172.21.15.123:0/981030693 shutdown_connections 2023-07-21T19:08:11.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7fa58f5c6700 1 -- 172.21.15.123:0/981030693 wait complete. 2023-07-21T19:08:11.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7f39ed13e700 1 Processor -- start 2023-07-21T19:08:11.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.924+0000 7f39ed13e700 1 -- start start 2023-07-21T19:08:11.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f91400700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f8c0cd460 0x7f2f8c1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f91400700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0cdff0 0x7f2f8c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f91400700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0ce990 con 0x7f2f8c0c9d10 2023-07-21T19:08:11.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f91400700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c071730 con 0x7f2f8c0cd460 2023-07-21T19:08:11.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f91400700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0cd9f0 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39ed13e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 0x7f39e80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39ed13e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f39e80ce450 0x7f39e815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39ed13e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80cb960 con 0x7f39e815ce50 2023-07-21T19:08:11.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39ed13e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e80cda00 con 0x7f39e80ce450 2023-07-21T19:08:11.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39ed13e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80cdc00 con 0x7f39e80acb10 2023-07-21T19:08:11.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f8c0cd460 0x7f2f8c1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f8c0cd460 0x7f2f8c1603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58902/0 (socket says 172.21.15.123:58902) 2023-07-21T19:08:11.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 -- 172.21.15.123:0/3107329424 learned_addr learned my addr 172.21.15.123:0/3107329424 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8affd700 1 --1- 172.21.15.123:0/3107329424 >> v1:172.21.15.145:6789/0 conn(0x7f2f8c0c9d10 0x7f2f8c071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:46996/0 (socket says 172.21.15.123:46996) 2023-07-21T19:08:11.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7fa58f5c6700 1 Processor -- start 2023-07-21T19:08:11.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e6d9d700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f39e815ce50 0x7f39e80cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:47008/0 (socket says 172.21.15.123:47008) 2023-07-21T19:08:11.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e6d9d700 1 -- 172.21.15.123:0/3361051243 learned_addr learned my addr 172.21.15.123:0/3361051243 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:11.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7fa58f5c6700 1 -- start start 2023-07-21T19:08:11.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e759e700 1 --2- 172.21.15.123:0/3361051243 >> v2:172.21.15.145:3300/0 conn(0x7f39e80ce450 0x7f39e815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 -- 172.21.15.123:0/3107329424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0cdff0 msgr2=0x7f2f8c0ce450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T19:08:11.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 --2- 172.21.15.123:0/3107329424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0cdff0 0x7f2f8c0ce450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 -- 172.21.15.123:0/3107329424 >> v1:172.21.15.145:6789/0 conn(0x7f2f8c0c9d10 legacy=0x7f2f8c071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 -- 172.21.15.123:0/3107329424 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0cdcd0 con 0x7f2f8c0cd460 2023-07-21T19:08:11.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f8a7fc700 1 --2- 172.21.15.123:0/3107329424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 0x7f2f8c1603c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009e50 tx=0x7f2f8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b81d6edc4bbde0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462413617 0 0) 0x7f39e80cb960 con 0x7f39e815ce50 2023-07-21T19:08:11.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d00035d0 con 0x7f39e815ce50 2023-07-21T19:08:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e659c700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 0x7f39e80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f89ffb700 1 -- 172.21.15.123:0/3107329424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400e070 con 0x7f2f8c0cd460 2023-07-21T19:08:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f89ffb700 1 -- 172.21.15.123:0/3107329424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84003a40 con 0x7f2f8c0cd460 2023-07-21T19:08:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f2f89ffb700 1 -- 172.21.15.123:0/3107329424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003df0 con 0x7f2f8c0cd460 2023-07-21T19:08:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2078176469 0 0) 0x7f39d00035d0 con 0x7f39e815ce50 2023-07-21T19:08:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 msgr2=0x7f39e80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 0x7f39e80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7fa58f5c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa5880acb10 0x7fa5881f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7fa58f5c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa5880abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58f5c6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa58815ce50 0x7fa588201790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58d362700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa5880acb10 0x7fa5881f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58d362700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa5880acb10 0x7fa5881f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46928/0 (socket says 172.21.15.123:46928) 2023-07-21T19:08:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 -- 172.21.15.123:0/3107329424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 msgr2=0x7f2f8c1603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 --2- 172.21.15.123:0/3107329424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 0x7f2f8c1603c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009e50 tx=0x7f2f8400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58d362700 1 -- 172.21.15.123:0/2768121931 learned_addr learned my addr 172.21.15.123:0/2768121931 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 >> v2:172.21.15.145:3300/0 conn(0x7f39e80ce450 msgr2=0x7f39e815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 --2- 172.21.15.123:0/3361051243 >> v2:172.21.15.145:3300/0 conn(0x7f39e80ce450 0x7f39e815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80ce870 con 0x7f39e815ce50 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f39e00019f0 con 0x7f39e815ce50 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 >> v1:172.21.15.145:6789/0 conn(0x7f39e815ce50 legacy=0x7f39e80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 0x7f39d0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39d0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39d0004db0 0x7f39d0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80cda00 con 0x7f39d0004db0 2023-07-21T19:08:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80cdc00 con 0x7f39d0003fa0 2023-07-21T19:08:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d000bbc0 con 0x7f39e80acb10 2023-07-21T19:08:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.928+0000 7f39e759e700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39d0004db0 0x7f39d0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39d0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e6d9d700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 0x7f39d0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58db63700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa58815ce50 0x7fa588201790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa5880abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 -- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 msgr2=0x7f39d0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e80acb10 0x7f39d0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 -- 172.21.15.123:0/3361051243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39d0004db0 msgr2=0x7f39d0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39d0004db0 0x7f39d0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 -- 172.21.15.123:0/3361051243 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00035d0 con 0x7f39d0003fa0 2023-07-21T19:08:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5881f50a0 con 0x7fa5880ce620 2023-07-21T19:08:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588152cf0 con 0x7fa58815ce50 2023-07-21T19:08:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa588152fd0 con 0x7fa5880acb10 2023-07-21T19:08:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 -- 172.21.15.123:0/3107329424 shutdown_connections 2023-07-21T19:08:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 --2- 172.21.15.123:0/3107329424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0cdff0 0x7f2f8c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 --2- 172.21.15.123:0/3107329424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 0x7f2f8c1603c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 -- 172.21.15.123:0/3107329424 >> 172.21.15.123:0/3107329424 conn(0x7f2f8c060320 msgr2=0x7f2f8c0606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e659c700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39d0004870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009880 tx=0x7f39d00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc996a82a5dcf394 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00c070 con 0x7f39d0003fa0 2023-07-21T19:08:11.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 -- 172.21.15.123:0/3107329424 shutdown_connections 2023-07-21T19:08:11.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f2f91400700 1 -- 172.21.15.123:0/3107329424 wait complete. 2023-07-21T19:08:11.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 -- 172.21.15.123:0/2768121931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa5880acb10 msgr2=0x7fa5881f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa5880acb10 0x7fa5881f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 -- 172.21.15.123:0/2768121931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa58815ce50 msgr2=0x7fa588201790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa58815ce50 0x7fa588201790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009b30 con 0x7fa5880ce620 2023-07-21T19:08:11.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc013610 con 0x7f39d0003fa0 2023-07-21T19:08:11.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e5d9b700 1 -- 172.21.15.123:0/3361051243 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0139c0 con 0x7f39d0003fa0 2023-07-21T19:08:11.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58cb61700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa5880abc10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa57800c410 tx=0x7fa578001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39ed13e700 1 -- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 msgr2=0x7f39d0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39ed13e700 1 --2- 172.21.15.123:0/3361051243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39d0004870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009880 tx=0x7f39d00058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39e759e700 1 -- 172.21.15.123:0/3361051243 reap_dead start 2023-07-21T19:08:11.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39ed13e700 1 -- 172.21.15.123:0/3361051243 shutdown_connections 2023-07-21T19:08:11.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39ed13e700 1 -- 172.21.15.123:0/3361051243 >> 172.21.15.123:0/3361051243 conn(0x7f39e8060320 msgr2=0x7f39e80606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780052d0 con 0x7fa5880ce620 2023-07-21T19:08:11.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578005430 con 0x7fa5880ce620 2023-07-21T19:08:11.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780055a0 con 0x7fa5880ce620 2023-07-21T19:08:11.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5881532b0 con 0x7fa5880ce620 2023-07-21T19:08:11.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f2f91400700 1 Processor -- start 2023-07-21T19:08:11.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f2f91400700 1 -- start start 2023-07-21T19:08:11.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 Processor -- start 2023-07-21T19:08:11.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 -- start start 2023-07-21T19:08:11.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6dc0b38b0 0x7fa6dc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0ccb10 0x7fa6dc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0b3e20 con 0x7fa6dc15f670 2023-07-21T19:08:11.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0d0b20 con 0x7fa6dc0b38b0 2023-07-21T19:08:11.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6e0f7c700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0d0560 con 0x7fa6dc0ccb10 2023-07-21T19:08:11.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39ed13e700 1 -- 172.21.15.123:0/3361051243 shutdown_connections 2023-07-21T19:08:11.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f39ed13e700 1 -- 172.21.15.123:0/3361051243 wait complete. 2023-07-21T19:08:11.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 Processor -- start 2023-07-21T19:08:11.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 -- start start 2023-07-21T19:08:11.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f048341d700 1 Processor -- start 2023-07-21T19:08:11.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.932+0000 7f048341d700 1 -- start start 2023-07-21T19:08:11.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f048341d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0474036d40 0x7f04740f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f048341d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0474053cb0 con 0x7f04740e6d20 2023-07-21T19:08:11.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f048341d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047404f910 con 0x7f0474051170 2023-07-21T19:08:11.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f048341d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0474048570 con 0x7f0474036d40 2023-07-21T19:08:11.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5780038e0 con 0x7fa5880ce620 2023-07-21T19:08:11.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f04811b9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f04740e6d20 0x7f047404f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38088/0 (socket says 172.21.15.123:38088) 2023-07-21T19:08:11.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f04819ba700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0474036d40 0x7f04740f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f04811b9700 1 -- 172.21.15.123:0/3500198918 learned_addr learned my addr 172.21.15.123:0/3500198918 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:11.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6db7fe700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fa6dc15f670 0x7fa6dc0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:47028/0 (socket says 172.21.15.123:47028) 2023-07-21T19:08:11.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f203406bc60 0x7f20340aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 0x7f20340cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2034168de0 con 0x7f20340cbc30 2023-07-21T19:08:11.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20340b0920 con 0x7f203406bc60 2023-07-21T19:08:11.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f203359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20340ca9c0 con 0x7f20340b0480 2023-07-21T19:08:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6dbfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0ccb10 0x7fa6dc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6dbfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0ccb10 0x7fa6dc0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44192/0 (socket says 172.21.15.123:44192) 2023-07-21T19:08:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fa6dbfff700 1 -- 172.21.15.123:0/3315349112 learned_addr learned my addr 172.21.15.123:0/3315349112 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f39ed13e700 1 Processor -- start 2023-07-21T19:08:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f2f91400700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0c9d10 0x7f2f8c1f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7fbb445e6700 1 Processor -- start 2023-07-21T19:08:11.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f39ed13e700 1 -- start start 2023-07-21T19:08:11.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f0473fff700 1 -- 172.21.15.123:0/3500198918 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729674921 0 0) 0x7f0474053cb0 con 0x7f04740e6d20 2023-07-21T19:08:11.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f0473fff700 1 -- 172.21.15.123:0/3500198918 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04680035d0 con 0x7f04740e6d20 2023-07-21T19:08:11.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f04819ba700 1 -- 172.21.15.123:0/3500198918 >> v1:172.21.15.145:6789/0 conn(0x7f0474051170 legacy=0x7f0474036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f04819ba700 1 -- 172.21.15.123:0/3500198918 >> v1:172.21.15.123:6789/0 conn(0x7f04740e6d20 legacy=0x7f047404f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.936+0000 7f04819ba700 1 -- 172.21.15.123:0/3500198918 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0474033940 con 0x7f0474036d40 2023-07-21T19:08:11.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6dbfff700 1 -- 172.21.15.123:0/3315349112 >> v2:172.21.15.123:3300/0 conn(0x7fa6dc0b38b0 msgr2=0x7fa6dc0b2530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T19:08:11.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f203259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f20340cbc30 0x7f20340713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38096/0 (socket says 172.21.15.123:38096) 2023-07-21T19:08:11.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6da7fc700 1 -- 172.21.15.123:0/3315349112 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426884967 0 0) 0x7fa6dc0b3e20 con 0x7fa6dc15f670 2023-07-21T19:08:11.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f91400700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 0x7f2f8c0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fbb445e6700 1 -- start start 2023-07-21T19:08:11.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f91400700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f8c0cdff0 0x7f2f8c0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f04819ba700 1 --2- 172.21.15.123:0/3500198918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f04740f1760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f047c02c910 tx=0x7f047c073c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e60bc86a8969d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa57dffb700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa56c066340 0x7fa56c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58815d220 con 0x7fa5880ce620 2023-07-21T19:08:11.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f91400700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0c8070 con 0x7f2f8c0cd460 2023-07-21T19:08:11.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f91400700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c1f9390 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f91400700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0c7d90 con 0x7f2f8c0c9d10 2023-07-21T19:08:11.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f8c0cdff0 0x7f2f8c0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f8c0cdff0 0x7f2f8c0c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44194/0 (socket says 172.21.15.123:44194) 2023-07-21T19:08:11.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 -- 172.21.15.123:0/688936486 learned_addr learned my addr 172.21.15.123:0/688936486 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 0x7f2f8c0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8affd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0c9d10 0x7f2f8c1f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 -- 172.21.15.123:0/688936486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0c9d10 msgr2=0x7f2f8c1f9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f8c0c9d10 0x7f2f8c1f9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 -- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 msgr2=0x7f2f8c0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f8c0cd460 0x7f2f8c0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 -- 172.21.15.123:0/688936486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009b30 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6daffd700 1 --2- 172.21.15.123:0/3315349112 >> v2:172.21.15.123:3300/0 conn(0x7fa6dc0b38b0 0x7fa6dc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6dbfff700 1 --2- 172.21.15.123:0/3315349112 >> v2:172.21.15.123:3300/0 conn(0x7fa6dc0b38b0 0x7fa6dc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6dbfff700 1 -- 172.21.15.123:0/3315349112 >> v1:172.21.15.145:6789/0 conn(0x7fa6dc15f670 legacy=0x7fa6dc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6dbfff700 1 -- 172.21.15.123:0/3315349112 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0d0840 con 0x7fa6dc0ccb10 2023-07-21T19:08:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6daffd700 1 --2- 172.21.15.123:0/3315349112 >> v2:172.21.15.123:3300/0 conn(0x7fa6dc0b38b0 0x7fa6dc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6dbfff700 1 --2- 172.21.15.123:0/3315349112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc0ccb10 0x7fa6dc0ccf10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc08cc70 tx=0x7fa6cc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f38681543b8e5e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6da7fc700 1 -- 172.21.15.123:0/3315349112 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00b8a0 con 0x7fa6dc0ccb10 2023-07-21T19:08:11.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6da7fc700 1 -- 172.21.15.123:0/3315349112 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00ba00 con 0x7fa6dc0ccb10 2023-07-21T19:08:11.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6da7fc700 1 -- 172.21.15.123:0/3315349112 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00bd70 con 0x7fa6dc0ccb10 2023-07-21T19:08:11.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39ed13e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39e81fed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39ed13e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e80c2090 0x7f39e80c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39ed13e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e81fe1b0 0x7f39e80c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f0473fff700 1 -- 172.21.15.123:0/3500198918 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c06fae0 con 0x7f0474036d40 2023-07-21T19:08:11.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f0473fff700 1 -- 172.21.15.123:0/3500198918 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c06fc40 con 0x7f0474036d40 2023-07-21T19:08:11.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f0473fff700 1 -- 172.21.15.123:0/3500198918 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c066830 con 0x7f0474036d40 2023-07-21T19:08:11.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f048341d700 1 -- 172.21.15.123:0/3500198918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 msgr2=0x7f04740f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f048341d700 1 --2- 172.21.15.123:0/3500198918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f04740f1760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f047c02c910 tx=0x7f047c073c10 comp rx=0 tx=0).stop 2023-07-21T19:08:11.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39ed13e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e82024c0 con 0x7f39e80c2090 2023-07-21T19:08:11.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2031d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f203406bc60 0x7f20340aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 0x7f20340cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 0x7f20340cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46934/0 (socket says 172.21.15.123:46934) 2023-07-21T19:08:11.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 -- 172.21.15.123:0/2045459403 learned_addr learned my addr 172.21.15.123:0/2045459403 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 -- 172.21.15.123:0/2045459403 >> v2:172.21.15.123:3300/0 conn(0x7f203406bc60 msgr2=0x7f20340aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 --2- 172.21.15.123:0/2045459403 >> v2:172.21.15.123:3300/0 conn(0x7f203406bc60 0x7f20340aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 -- 172.21.15.123:0/2045459403 >> v1:172.21.15.123:6789/0 conn(0x7f20340cbc30 legacy=0x7f20340713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 -- 172.21.15.123:0/2045459403 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340cc0c0 con 0x7f20340b0480 2023-07-21T19:08:11.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fbb445e6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34036e80 0x7fbb3403a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fbb445e6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb34052280 0x7fbb3403a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39e6d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39e81fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39ed13e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e82018b0 con 0x7f39d0003fa0 2023-07-21T19:08:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39ed13e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8201b90 con 0x7f39e81fe1b0 2023-07-21T19:08:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39e759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e81fe1b0 0x7f39e80c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fbb445e6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb340060c0 con 0x7fbb34054800 2023-07-21T19:08:11.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fbb445e6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb340070b0 con 0x7fbb34052280 2023-07-21T19:08:11.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fbb445e6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3403ab80 con 0x7fbb34036e80 2023-07-21T19:08:11.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3315349112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc0ccb10 msgr2=0x7fa6dc0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 --2- 172.21.15.123:0/3315349112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc0ccb10 0x7fa6dc0ccf10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc08cc70 tx=0x7fa6cc009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa58d362700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa56c066340 0x7fa56c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa578057dd0 con 0x7fa5880ce620 2023-07-21T19:08:11.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2f8b7fe700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f8c0cdff0 0x7f2f8c0c7320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000b4a0 tx=0x7f2f8000b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f048341d700 1 -- 172.21.15.123:0/3500198918 shutdown_connections 2023-07-21T19:08:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f048341d700 1 --2- 172.21.15.123:0/3500198918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f04740f1760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f048341d700 1 -- 172.21.15.123:0/3500198918 >> 172.21.15.123:0/3500198918 conn(0x7f0474051630 msgr2=0x7f0474051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f2032d9d700 1 --2- 172.21.15.123:0/2045459403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 0x7f20340cd3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2028009910 tx=0x7f2028009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10dd3e8f16f79549 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3315349112 shutdown_connections 2023-07-21T19:08:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 --2- 172.21.15.123:0/3315349112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc0ccb10 0x7fa6dc0ccf10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 --2- 172.21.15.123:0/3315349112 >> v2:172.21.15.123:3300/0 conn(0x7fa6dc0b38b0 0x7fa6dc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3315349112 >> 172.21.15.123:0/3315349112 conn(0x7fa6dc060c40 msgr2=0x7fa6dc09b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39e759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e81fe1b0 0x7f39e80c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46950/0 (socket says 172.21.15.123:46950) 2023-07-21T19:08:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39e759e700 1 -- 172.21.15.123:0/2344611184 learned_addr learned my addr 172.21.15.123:0/2344611184 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39e659c700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e80c2090 0x7f39e80c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa58f5c6700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] conn(0x7fa588152780 0x7fa588070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5880cb160 con 0x7fa588152780 2023-07-21T19:08:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3315349112 shutdown_connections 2023-07-21T19:08:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011830 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800119b0 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011d60 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f2f91400700 1 -- 172.21.15.123:0/688936486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c1f9630 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3315349112 wait complete. 2023-07-21T19:08:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f39e6d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39e81fed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44206/0 (socket says 172.21.15.123:44206) 2023-07-21T19:08:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39e759e700 1 -- 172.21.15.123:0/2344611184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 msgr2=0x7f39e81fed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39e759e700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39d0003fa0 0x7f39e81fed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39e759e700 1 -- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e80c2090 msgr2=0x7f39e80c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39e759e700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e80c2090 0x7f39e80c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39e759e700 1 -- 172.21.15.123:0/2344611184 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8201e70 con 0x7f39e81fe1b0 2023-07-21T19:08:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203159a700 1 -- 172.21.15.123:0/2045459403 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028011830 con 0x7f20340b0480 2023-07-21T19:08:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203159a700 1 -- 172.21.15.123:0/2045459403 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028011990 con 0x7f20340b0480 2023-07-21T19:08:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203159a700 1 -- 172.21.15.123:0/2045459403 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028011d20 con 0x7f20340b0480 2023-07-21T19:08:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb42382700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbb34054800 0x7fbb34036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38108/0 (socket says 172.21.15.123:38108) 2023-07-21T19:08:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb42382700 1 -- 172.21.15.123:0/3268546433 learned_addr learned my addr 172.21.15.123:0/3268546433 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41b81700 1 --2- 172.21.15.123:0/3268546433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34036e80 0x7fbb3403a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.940+0000 7f048341d700 1 -- 172.21.15.123:0/3500198918 shutdown_connections 2023-07-21T19:08:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f048341d700 1 -- 172.21.15.123:0/3500198918 wait complete. 2023-07-21T19:08:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41380700 1 -- 172.21.15.123:0/3268546433 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766493146 0 0) 0x7fbb340060c0 con 0x7fbb34054800 2023-07-21T19:08:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41380700 1 -- 172.21.15.123:0/3268546433 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb280035d0 con 0x7fbb34054800 2023-07-21T19:08:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 -- 172.21.15.123:0/2045459403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 msgr2=0x7f20340cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 --2- 172.21.15.123:0/2045459403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 0x7f20340cd3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2028009910 tx=0x7f2028009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f2f91400700 1 -- 172.21.15.123:0/688936486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0c5df0 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f2f91400700 1 -- 172.21.15.123:0/688936486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f8c15fbc0 con 0x7f2f8c0cdff0 2023-07-21T19:08:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39e759e700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e81fe1b0 0x7f39e80c2eb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39e80cbb80 tx=0x7f39d8011b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41b81700 1 -- 172.21.15.123:0/3268546433 >> v2:172.21.15.123:3300/0 conn(0x7fbb34052280 msgr2=0x7fbb3403a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41b81700 1 --2- 172.21.15.123:0/3268546433 >> v2:172.21.15.123:3300/0 conn(0x7fbb34052280 0x7fbb3403a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41b81700 1 -- 172.21.15.123:0/3268546433 >> v1:172.21.15.123:6789/0 conn(0x7fbb34054800 legacy=0x7fbb34036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41b81700 1 -- 172.21.15.123:0/3268546433 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb340ded00 con 0x7fbb34036e80 2023-07-21T19:08:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 -- 172.21.15.123:0/2045459403 shutdown_connections 2023-07-21T19:08:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 --2- 172.21.15.123:0/2045459403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20340b0480 0x7f20340cd3c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 --2- 172.21.15.123:0/2045459403 >> v2:172.21.15.123:3300/0 conn(0x7f203406bc60 0x7f20340aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 -- 172.21.15.123:0/2045459403 >> 172.21.15.123:0/2045459403 conn(0x7f2034060320 msgr2=0x7f20340606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fa58db63700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] conn(0x7fa588152780 0x7fa588070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fa58d362700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa56c066340 0x7fa56c0687f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa584009b90 tx=0x7fa584009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fa6e0f7c700 1 Processor -- start 2023-07-21T19:08:11.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fa58db63700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] conn(0x7fa588152780 0x7fa588070750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 -- 172.21.15.123:0/2045459403 shutdown_connections 2023-07-21T19:08:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004240 con 0x7f39e81fe1b0 2023-07-21T19:08:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d80043a0 con 0x7f39e81fe1b0 2023-07-21T19:08:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003900 con 0x7f39e81fe1b0 2023-07-21T19:08:11.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f048341d700 1 Processor -- start 2023-07-21T19:08:11.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f048341d700 1 -- start start 2023-07-21T19:08:11.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e8202150 con 0x7f39e81fe1b0 2023-07-21T19:08:11.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e80b2f00 con 0x7f39e81fe1b0 2023-07-21T19:08:11.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fa6e0f7c700 1 -- start start 2023-07-21T19:08:11.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7f203359e700 1 -- 172.21.15.123:0/2045459403 wait complete. 2023-07-21T19:08:11.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 Processor -- start 2023-07-21T19:08:11.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 -- start start 2023-07-21T19:08:11.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbb41b81700 1 --2- 172.21.15.123:0/3268546433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34036e80 0x7fbb3403a100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009850 tx=0x7fbb2c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d7e40a8a1b0ba8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:11.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf301605d0 0x7fbf300c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf30164a10 0x7fbf301612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300ca400 con 0x7fbf301617e0 2023-07-21T19:08:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf300ca6e0 con 0x7fbf301605d0 2023-07-21T19:08:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.944+0000 7fbf374dd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300ca9c0 con 0x7fbf30164a10 2023-07-21T19:08:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f048341d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f047404afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf34a78700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf30164a10 0x7fbf301612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35279700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf301605d0 0x7fbf300c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35a7a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbf301617e0 0x7fbf30069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38116/0 (socket says 172.21.15.123:38116) 2023-07-21T19:08:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35a7a700 1 -- 172.21.15.123:0/1833287673 learned_addr learned my addr 172.21.15.123:0/1833287673 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6e0f7c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc0b38b0 0x7fa6dc0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6e0f7c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0ccb10 0x7fa6dc1f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6e0f7c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc15f670 0x7fa6dc0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6e0f7c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc09ffc0 con 0x7fa6dc0b38b0 2023-07-21T19:08:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6e0f7c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0b5da0 con 0x7fa6dc15f670 2023-07-21T19:08:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6e0f7c700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc1f55f0 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39c8000fc0 con 0x7f39e81fe1b0 2023-07-21T19:08:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f048341d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0474051170 0x7f047417f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f047404afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f047404afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44212/0 (socket says 172.21.15.123:44212) 2023-07-21T19:08:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6dbfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc15f670 0x7fa6dc0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6daffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0ccb10 0x7fa6dc1f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbb41380700 1 -- 172.21.15.123:0/3268546433 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c011830 con 0x7fbb34036e80 2023-07-21T19:08:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbb41380700 1 -- 172.21.15.123:0/3268546433 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c011990 con 0x7fbb34036e80 2023-07-21T19:08:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbb41380700 1 -- 172.21.15.123:0/3268546433 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c011d40 con 0x7fbb34036e80 2023-07-21T19:08:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbb445e6700 1 -- 172.21.15.123:0/3268546433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34036e80 msgr2=0x7fbb3403a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbb445e6700 1 --2- 172.21.15.123:0/3268546433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34036e80 0x7fbb3403a100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009850 tx=0x7fbb2c009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35279700 1 -- 172.21.15.123:0/1833287673 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf30164a10 msgr2=0x7fbf301612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== osd.0 v2:172.21.15.123:6800/2879105086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa5800099b0 con 0x7fa588152780 2023-07-21T19:08:12.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f8001a400 con 0x7f2f8c0cdff0 2023-07-21T19:08:12.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f737fe700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f780663c0 0x7f2f78068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f800844e0 con 0x7f2f8c0cdff0 2023-07-21T19:08:12.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f737fe700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] conn(0x7f2f78070090 0x7f2f780724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 --> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f78072b90 con 0x7f2f78070090 2023-07-21T19:08:12.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f80084890 con 0x7f2f8c0cdff0 2023-07-21T19:08:12.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6dbfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc15f670 0x7fa6dc0b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44222/0 (socket says 172.21.15.123:44222) 2023-07-21T19:08:12.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6dbfff700 1 -- 172.21.15.123:0/3639901762 learned_addr learned my addr 172.21.15.123:0/3639901762 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f203359e700 1 Processor -- start 2023-07-21T19:08:12.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f203359e700 1 -- start start 2023-07-21T19:08:12.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f048341d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f04740e6d20 0x7f047417f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04809b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0474051170 0x7f047417f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f048341d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047404e5f0 con 0x7f0474051170 2023-07-21T19:08:12.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f048341d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047404b500 con 0x7f0474036d40 2023-07-21T19:08:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f048341d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04740e8250 con 0x7f04740e6d20 2023-07-21T19:08:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04809b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0474051170 0x7f047417f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58982/0 (socket says 172.21.15.123:58982) 2023-07-21T19:08:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04809b8700 1 -- 172.21.15.123:0/444817308 learned_addr learned my addr 172.21.15.123:0/444817308 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35279700 1 --2- 172.21.15.123:0/1833287673 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf30164a10 0x7fbf301612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35279700 1 -- 172.21.15.123:0/1833287673 >> v1:172.21.15.123:6789/0 conn(0x7fbf301617e0 legacy=0x7fbf30069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35279700 1 -- 172.21.15.123:0/1833287673 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30160d80 con 0x7fbf301605d0 2023-07-21T19:08:12.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04819ba700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f04740e6d20 0x7f047417f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39d8003a60 con 0x7f39e81fe1b0 2023-07-21T19:08:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f8a7fc700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] conn(0x7f2f78070090 0x7f2f780724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f2f8affd700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f780663c0 0x7f2f78068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc0b38b0 0x7fa6dc0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6daffd700 1 -- 172.21.15.123:0/3639901762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc15f670 msgr2=0x7fa6dc0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6daffd700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6dc15f670 0x7fa6dc0b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6daffd700 1 -- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc0b38b0 msgr2=0x7fa6dc0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6daffd700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc0b38b0 0x7fa6dc0cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fa6daffd700 1 -- 172.21.15.123:0/3639901762 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009570 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 -- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f04740e6d20 msgr2=0x7f047417f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f04740e6d20 0x7f047417f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 -- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0474051170 msgr2=0x7f047417f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0474051170 0x7f047417f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7f04811b9700 1 -- 172.21.15.123:0/444817308 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c073710 con 0x7f0474036d40 2023-07-21T19:08:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.948+0000 7fbf35279700 1 --2- 172.21.15.123:0/1833287673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf301605d0 0x7fbf300c8970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009850 tx=0x7fbf20009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbad785a04d436d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbb445e6700 1 -- 172.21.15.123:0/3268546433 shutdown_connections 2023-07-21T19:08:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbb445e6700 1 --2- 172.21.15.123:0/3268546433 >> v2:172.21.15.123:3300/0 conn(0x7fbb34052280 0x7fbb3403a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbb445e6700 1 --2- 172.21.15.123:0/3268546433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34036e80 0x7fbb3403a100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbb445e6700 1 -- 172.21.15.123:0/3268546433 >> 172.21.15.123:0/3268546433 conn(0x7fbb34051770 msgr2=0x7fbb34051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f203406bc60 0x7f2034088eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20340b0480 0x7f20340c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf27fff700 1 -- 172.21.15.123:0/1833287673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20011830 con 0x7fbf301605d0 2023-07-21T19:08:12.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fa6daffd700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0ccb10 0x7fa6dc1f50b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c7f0 tx=0x7fa6d000cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20340cbc30 0x7f20340c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbb445e6700 1 -- 172.21.15.123:0/3268546433 shutdown_connections 2023-07-21T19:08:12.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2f8a7fc700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] conn(0x7f2f78070090 0x7f2f780724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004220 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0004380 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00036c0 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39cf7fe700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39d4066340 0x7f39d40687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39d8084380 con 0x7f39e81fe1b0 2023-07-21T19:08:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340af790 con 0x7f20340cbc30 2023-07-21T19:08:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340893f0 con 0x7f20340b0480 2023-07-21T19:08:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203416ad50 con 0x7f203406bc60 2023-07-21T19:08:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f203406bc60 0x7f2034088eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2031d9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20340b0480 0x7f20340c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2031d9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20340b0480 0x7f20340c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44228/0 (socket says 172.21.15.123:44228) 2023-07-21T19:08:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2031d9b700 1 -- 172.21.15.123:0/1995048324 learned_addr learned my addr 172.21.15.123:0/1995048324 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f203406bc60 0x7f2034088eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47000/0 (socket says 172.21.15.123:47000) 2023-07-21T19:08:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2032d9d700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20340cbc30 0x7f20340c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f04811b9700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f047404afc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f047800c3e0 tx=0x7f047800c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39cf7fe700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] conn(0x7f39d4070010 0x7f39d4072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 --> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39d4072b10 con 0x7f39d4070010 2023-07-21T19:08:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39d8086960 con 0x7f39e81fe1b0 2023-07-21T19:08:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf27fff700 1 -- 172.21.15.123:0/1833287673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf20011990 con 0x7fbf301605d0 2023-07-21T19:08:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf27fff700 1 -- 172.21.15.123:0/1833287673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20011d40 con 0x7fbf301605d0 2023-07-21T19:08:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2f8affd700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f780663c0 0x7f2f78068870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0099a0 tx=0x7f2f7c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 -- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20340b0480 msgr2=0x7f20340c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20340b0480 0x7f20340c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 -- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20340cbc30 msgr2=0x7f20340c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20340cbc30 0x7f20340c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 -- 172.21.15.123:0/1995048324 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009570 con 0x7f203406bc60 2023-07-21T19:08:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2032d9d700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20340cbc30 0x7f20340c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39e6d9d700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39d4066340 0x7f39d40687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478004a90 con 0x7f0474036d40 2023-07-21T19:08:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478004bf0 con 0x7f0474036d40 2023-07-21T19:08:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780070d0 con 0x7f0474036d40 2023-07-21T19:08:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04740e7f70 con 0x7f0474036d40 2023-07-21T19:08:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 -- 172.21.15.123:0/1833287673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf301605d0 msgr2=0x7fbf300c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 --2- 172.21.15.123:0/1833287673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf301605d0 0x7fbf300c8970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009850 tx=0x7fbf20009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 -- 172.21.15.123:0/1833287673 shutdown_connections 2023-07-21T19:08:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== osd.1 v2:172.21.15.123:6808/2209387933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2f78072b90 con 0x7f2f78070090 2023-07-21T19:08:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 --2- 172.21.15.123:0/1833287673 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf30164a10 0x7fbf301612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 --2- 172.21.15.123:0/1833287673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf301605d0 0x7fbf300c8970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 -- 172.21.15.123:0/1833287673 >> 172.21.15.123:0/1833287673 conn(0x7fbf300cb9c0 msgr2=0x7fbf300ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203259c700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f203406bc60 0x7f2034088eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f202400c500 tx=0x7f202400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 -- 172.21.15.123:0/1833287673 shutdown_connections 2023-07-21T19:08:12.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047404e210 con 0x7f0474036d40 2023-07-21T19:08:12.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbf374dd700 1 -- 172.21.15.123:0/1833287673 wait complete. 2023-07-21T19:08:12.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc09fce0 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc0ca2b0 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39e659c700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] conn(0x7f39d4070010 0x7f39d4072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024005cd0 con 0x7f203406bc60 2023-07-21T19:08:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2024005e30 con 0x7f203406bc60 2023-07-21T19:08:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240072d0 con 0x7f203406bc60 2023-07-21T19:08:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203416b030 con 0x7f203406bc60 2023-07-21T19:08:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203416b5f0 con 0x7f203406bc60 2023-07-21T19:08:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39e6d9d700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39d4066340 0x7f39d40687f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39e0000f80 tx=0x7f39e00017b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7f39e659c700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] conn(0x7f39d4070010 0x7f39d4072440 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6dc0d3170 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.952+0000 7fbb445e6700 1 -- 172.21.15.123:0/3268546433 wait complete. 2023-07-21T19:08:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7fbf374dd700 1 Processor -- start 2023-07-21T19:08:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7fbb445e6700 1 Processor -- start 2023-07-21T19:08:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7fbf374dd700 1 -- start start 2023-07-21T19:08:12.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7fbb445e6700 1 -- start start 2023-07-21T19:08:12.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0478007230 con 0x7f0474036d40 2023-07-21T19:08:12.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7f0471ffb700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f04600663f0 0x7f04600688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0478083a30 con 0x7f0474036d40 2023-07-21T19:08:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb445e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb34036e80 0x7fbb340347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf301605d0 0x7fbf300b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb445e6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb34052280 0x7fbb340ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf301617e0 0x7fbf30163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb445e6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34054800 0x7fbb34048820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6d0003820 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6c3fff700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c80662f0 0x7fa6c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6d0084930 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6c3fff700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] conn(0x7fa6c806ffc0 0x7fa6c80723f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 --> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6c8072ac0 con 0x7fa6c806ffc0 2023-07-21T19:08:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6d0084ce0 con 0x7fa6dc0ccb10 2023-07-21T19:08:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.956+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== osd.3 v2:172.21.15.123:6824/3573584440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f39d4072b10 con 0x7f39d4070010 2023-07-21T19:08:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20340cc680 con 0x7f203406bc60 2023-07-21T19:08:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2024007430 con 0x7f203406bc60 2023-07-21T19:08:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb445e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3404b720 con 0x7fbb34036e80 2023-07-21T19:08:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb445e6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340d6df0 con 0x7fbb34052280 2023-07-21T19:08:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb445e6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340d7970 con 0x7fbb34054800 2023-07-21T19:08:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb34036e80 0x7fbb340347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb34036e80 0x7fbb340347c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59030/0 (socket says 172.21.15.123:59030) 2023-07-21T19:08:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 -- 172.21.15.123:0/702558583 learned_addr learned my addr 172.21.15.123:0/702558583 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42b83700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34054800 0x7fbb34048820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb41b81700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb34052280 0x7fbb340ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f04809b8700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f04600663f0 0x7f04600688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f048341d700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] conn(0x7f04740e7b00 0x7f04740070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 --> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0474033c20 con 0x7f04740e7b00 2023-07-21T19:08:12.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f04809b8700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f04600663f0 0x7f04600688a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0474033820 tx=0x7f046c007f70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f04819ba700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] conn(0x7f04740e7b00 0x7f04740070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf30164a10 0x7fbf3014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf301617e0 0x7fbf30163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf301617e0 0x7fbf30163010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44236/0 (socket says 172.21.15.123:44236) 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 -- 172.21.15.123:0/2742969048 learned_addr learned my addr 172.21.15.123:0/2742969048 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf35279700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf301605d0 0x7fbf300b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf35a7a700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf30164a10 0x7fbf3014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3014e300 con 0x7fbf30164a10 2023-07-21T19:08:12.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300b3980 con 0x7fbf301617e0 2023-07-21T19:08:12.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300b3c60 con 0x7fbf301605d0 2023-07-21T19:08:12.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 -- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34054800 msgr2=0x7fbb34048820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34054800 0x7fbb34048820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 -- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb34052280 msgr2=0x7fbb340ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb34052280 0x7fbb340ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 -- 172.21.15.123:0/702558583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0094b0 con 0x7fbb34036e80 2023-07-21T19:08:12.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 -- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf301605d0 msgr2=0x7fbf300b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf301605d0 0x7fbf300b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 -- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf30164a10 msgr2=0x7fbf3014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf30164a10 0x7fbf3014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf200094b0 con 0x7fbf301617e0 2023-07-21T19:08:12.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42b83700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb34054800 0x7fbb34048820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7f04819ba700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] conn(0x7f04740e7b00 0x7f04740070c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf34a78700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf301617e0 0x7fbf30163010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00e840 tx=0x7fbf2c00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6dbfff700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] conn(0x7fa6c806ffc0 0x7fa6c80723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c80662f0 0x7fa6c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fa6dbfff700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] conn(0x7fa6c806ffc0 0x7fa6c80723f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c80662f0 0x7fa6c80687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40012e0 tx=0x7fa6d40018c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbb42382700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb34036e80 0x7fbb340347c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c500 tx=0x7fbb3800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38005d90 con 0x7fbb34036e80 2023-07-21T19:08:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbb445e6700 1 -- 172.21.15.123:0/702558583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb340d7040 con 0x7fbb34036e80 2023-07-21T19:08:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbb445e6700 1 -- 172.21.15.123:0/702558583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb340d7600 con 0x7fbb34036e80 2023-07-21T19:08:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380070d0 con 0x7fbb34036e80 2023-07-21T19:08:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38007480 con 0x7fbb34036e80 2023-07-21T19:08:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbb445e6700 1 -- 172.21.15.123:0/702558583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb24000fc0 con 0x7fbb34036e80 2023-07-21T19:08:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== osd.6 v2:172.21.15.145:6800/2645113531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f047c04e220 con 0x7f04740e7b00 2023-07-21T19:08:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c013680 con 0x7fbf301617e0 2023-07-21T19:08:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.960+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf300b3f40 con 0x7fbf301617e0 2023-07-21T19:08:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0137e0 con 0x7fbf301617e0 2023-07-21T19:08:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c013b50 con 0x7fbf301617e0 2023-07-21T19:08:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== osd.2 v2:172.21.15.123:6816/2633526095 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa6c8072ac0 con 0x7fa6c806ffc0 2023-07-21T19:08:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2022ffd700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f20140663c0 0x7f2014068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2024083310 con 0x7f203406bc60 2023-07-21T19:08:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2022ffd700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] conn(0x7f2014070090 0x7f20140724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 --> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2014072b90 con 0x7f2014070090 2023-07-21T19:08:12.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2024085870 con 0x7f203406bc60 2023-07-21T19:08:12.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2032d9d700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] conn(0x7f2014070090 0x7f20140724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.964+0000 7f2031d9b700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f20140663c0 0x7f2014068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7f2032d9d700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] conn(0x7f2014070090 0x7f20140724c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7f2031d9b700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f20140663c0 0x7f2014068870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f202c00b630 tx=0x7f202c018040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb380075e0 con 0x7fbb34036e80 2023-07-21T19:08:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf2c013cb0 con 0x7fbf301617e0 2023-07-21T19:08:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf30163550 con 0x7fbf301617e0 2023-07-21T19:08:12.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb32ffd700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbb200662f0 0x7fbb200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb38083c20 con 0x7fbb34036e80 2023-07-21T19:08:12.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb32ffd700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] conn(0x7fbb2006ff40 0x7fbb20072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 --> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb20072a40 con 0x7fbb2006ff40 2023-07-21T19:08:12.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb38083f90 con 0x7fbb34036e80 2023-07-21T19:08:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbf25ffb700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbf14066340 0x7fbf140687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== osd.4 v2:172.21.15.145:6803/1441391469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2014072b90 con 0x7f2014070090 2023-07-21T19:08:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb41b81700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbb200662f0 0x7fbb200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf2c058440 con 0x7fbf301617e0 2023-07-21T19:08:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbf35279700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbf14066340 0x7fbf140687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.972+0000 7fbf35279700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbf14066340 0x7fbf140687f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf200090b0 tx=0x7fbf20008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.972+0000 7fbf374dd700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] conn(0x7fbf30164130 0x7fbf3014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.972+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf3004dcb0 con 0x7fbf30164130 2023-07-21T19:08:12.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.972+0000 7fbf35a7a700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] conn(0x7fbf30164130 0x7fbf3014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.968+0000 7fbb42b83700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] conn(0x7fbb2006ff40 0x7fbb20072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.972+0000 7fbb42b83700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] conn(0x7fbb2006ff40 0x7fbb20072370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.972+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== osd.5 v2:172.21.15.145:6805/4212871842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbb20072a40 con 0x7fbb2006ff40 2023-07-21T19:08:12.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.976+0000 7fbb41b81700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbb200662f0 0x7fbb200687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb34037270 tx=0x7fbb2c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.976+0000 7fbf35a7a700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] conn(0x7fbf30164130 0x7fbf3014ecd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.976+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== osd.7 v2:172.21.15.145:6824/2662407435 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbf3004dcb0 con 0x7fbf30164130 2023-07-21T19:08:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.980+0000 7fa58f5c6700 1 -- 172.21.15.123:0/2768121931 --> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa58815c1a0 con 0x7fa588152780 2023-07-21T19:08:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.980+0000 7fa57dffb700 1 -- 172.21.15.123:0/2768121931 <== osd.0 v2:172.21.15.123:6800/2879105086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa58001c410 con 0x7fa588152780 2023-07-21T19:08:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.980+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] conn(0x7fa588152780 msgr2=0x7fa588070750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.980+0000 7fa56b7fe700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6800/2879105086,v1:172.21.15.123:6801/2879105086] conn(0x7fa588152780 0x7fa588070750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.980+0000 7f2f91400700 1 -- 172.21.15.123:0/688936486 --> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f8c15f8e0 con 0x7f2f78070090 2023-07-21T19:08:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa56c066340 msgr2=0x7fa56c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7f2f737fe700 1 -- 172.21.15.123:0/688936486 <== osd.1 v2:172.21.15.123:6808/2209387933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f840092e0 con 0x7f2f78070090 2023-07-21T19:08:12.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa56c066340 0x7fa56c0687f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa584009b90 tx=0x7fa584009240 comp rx=0 tx=0).stop 2023-07-21T19:08:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 msgr2=0x7fa5880abc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 --2- 172.21.15.123:0/2768121931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880ce620 0x7fa5880abc10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa57800c410 tx=0x7fa578001e70 comp rx=0 tx=0).stop 2023-07-21T19:08:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa58db63700 1 -- 172.21.15.123:0/2768121931 reap_dead start 2023-07-21T19:08:12.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 shutdown_connections 2023-07-21T19:08:12.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 >> 172.21.15.123:0/2768121931 conn(0x7fa588060320 msgr2=0x7fa5880ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.063 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 --> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39c8002d60 con 0x7f39d4070010 2023-07-21T19:08:12.063 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] conn(0x7f2f78070090 msgr2=0x7f2f780724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 shutdown_connections 2023-07-21T19:08:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7fa56b7fe700 1 -- 172.21.15.123:0/2768121931 wait complete. 2023-07-21T19:08:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7f39cf7fe700 1 -- 172.21.15.123:0/2344611184 <== osd.3 v2:172.21.15.123:6824/3573584440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f39c8002d60 con 0x7f39d4070010 2023-07-21T19:08:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.984+0000 7f2f717fa700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6808/2209387933,v1:172.21.15.123:6809/2209387933] conn(0x7f2f78070090 0x7f2f780724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f780663c0 msgr2=0x7f2f78068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] conn(0x7f39d4070010 msgr2=0x7f39d4072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6824/3573584440,v1:172.21.15.123:6825/3573584440] conn(0x7f39d4070010 0x7f39d4072440 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f780663c0 0x7f2f78068870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0099a0 tx=0x7f2f7c0090e0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f8c0cdff0 msgr2=0x7f2f8c0c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39d4066340 msgr2=0x7f39d40687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39d4066340 0x7f39d40687f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39e0000f80 tx=0x7f39e00017b0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 --2- 172.21.15.123:0/688936486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f8c0cdff0 0x7f2f8c0c7320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000b4a0 tx=0x7f2f8000b7b0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e81fe1b0 msgr2=0x7f39e80c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 --2- 172.21.15.123:0/2344611184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39e81fe1b0 0x7f39e80c2eb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39e80cbb80 tx=0x7f39d8011b80 comp rx=0 tx=0).stop 2023-07-21T19:08:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f8b7fe700 1 -- 172.21.15.123:0/688936486 reap_dead start 2023-07-21T19:08:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39e759e700 1 -- 172.21.15.123:0/2344611184 reap_dead start 2023-07-21T19:08:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 shutdown_connections 2023-07-21T19:08:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 >> 172.21.15.123:0/2344611184 conn(0x7f39e8060320 msgr2=0x7f39e815b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 --> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04740341e0 con 0x7f04740e7b00 2023-07-21T19:08:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 shutdown_connections 2023-07-21T19:08:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 shutdown_connections 2023-07-21T19:08:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 >> 172.21.15.123:0/688936486 conn(0x7f2f8c060320 msgr2=0x7f2f8c0ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f39ed13e700 1 -- 172.21.15.123:0/2344611184 wait complete. 2023-07-21T19:08:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 shutdown_connections 2023-07-21T19:08:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f0471ffb700 1 -- 172.21.15.123:0/444817308 <== osd.6 v2:172.21.15.145:6800/2645113531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f047c06fdb0 con 0x7f04740e7b00 2023-07-21T19:08:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f2f717fa700 1 -- 172.21.15.123:0/688936486 wait complete. 2023-07-21T19:08:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] conn(0x7f04740e7b00 msgr2=0x7f04740070c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.988+0000 7f048341d700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:6800/2645113531,v1:172.21.15.145:6801/2645113531] conn(0x7f04740e7b00 0x7f04740070c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 --> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20340cc3a0 con 0x7f2014070090 2023-07-21T19:08:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f04600663f0 msgr2=0x7f04600688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f04600663f0 0x7f04600688a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0474033820 tx=0x7f046c007f70 comp rx=0 tx=0).stop 2023-07-21T19:08:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 msgr2=0x7f047404afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 --2- 172.21.15.123:0/444817308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0474036d40 0x7f047404afc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f047800c3e0 tx=0x7f047800c6f0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 --> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6dc0d2c50 con 0x7fa6c806ffc0 2023-07-21T19:08:12.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f04819ba700 1 -- 172.21.15.123:0/444817308 reap_dead start 2023-07-21T19:08:12.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 shutdown_connections 2023-07-21T19:08:12.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 >> 172.21.15.123:0/444817308 conn(0x7f0474051630 msgr2=0x7f0474036430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 shutdown_connections 2023-07-21T19:08:12.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f048341d700 1 -- 172.21.15.123:0/444817308 wait complete. 2023-07-21T19:08:12.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7fa6c3fff700 1 -- 172.21.15.123:0/3639901762 <== osd.2 v2:172.21.15.123:6816/2633526095 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6cc021040 con 0x7fa6c806ffc0 2023-07-21T19:08:12.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7f2022ffd700 1 -- 172.21.15.123:0/1995048324 <== osd.4 v2:172.21.15.145:6803/1441391469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2028000c30 con 0x7f2014070090 2023-07-21T19:08:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] conn(0x7fa6c806ffc0 msgr2=0x7fa6c80723f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:11.996+0000 7fa6e0f7c700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6816/2633526095,v1:172.21.15.123:6817/2633526095] conn(0x7fa6c806ffc0 0x7fa6c80723f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c80662f0 msgr2=0x7fa6c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7fa6e0f7c700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c80662f0 0x7fa6c80687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40012e0 tx=0x7fa6d40018c0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0ccb10 msgr2=0x7fa6dc1f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7fa6e0f7c700 1 --2- 172.21.15.123:0/3639901762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0ccb10 0x7fa6dc1f50b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c7f0 tx=0x7fa6d000cb00 comp rx=0 tx=0).stop 2023-07-21T19:08:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7fa6dbfff700 1 -- 172.21.15.123:0/3639901762 reap_dead start 2023-07-21T19:08:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] conn(0x7f2014070090 msgr2=0x7f20140724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:6803/1441391469,v1:172.21.15.145:6806/1441391469] conn(0x7f2014070090 0x7f20140724c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f20140663c0 msgr2=0x7f2014068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f20140663c0 0x7f2014068870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f202c00b630 tx=0x7f202c018040 comp rx=0 tx=0).stop 2023-07-21T19:08:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f203406bc60 msgr2=0x7f2034088eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 --2- 172.21.15.123:0/1995048324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f203406bc60 0x7f2034088eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f202400c500 tx=0x7f202400c810 comp rx=0 tx=0).stop 2023-07-21T19:08:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f2032d9d700 1 -- 172.21.15.123:0/1995048324 reap_dead start 2023-07-21T19:08:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 shutdown_connections 2023-07-21T19:08:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 >> 172.21.15.123:0/1995048324 conn(0x7f2034060320 msgr2=0x7f20340adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 shutdown_connections 2023-07-21T19:08:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.000+0000 7f203359e700 1 -- 172.21.15.123:0/1995048324 wait complete. 2023-07-21T19:08:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 shutdown_connections 2023-07-21T19:08:12.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 >> 172.21.15.123:0/3639901762 conn(0x7fa6dc060c40 msgr2=0x7fa6dc0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 shutdown_connections 2023-07-21T19:08:12.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fa6e0f7c700 1 -- 172.21.15.123:0/3639901762 wait complete. 2023-07-21T19:08:12.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb445e6700 1 -- 172.21.15.123:0/702558583 --> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb24002d90 con 0x7fbb2006ff40 2023-07-21T19:08:12.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 --> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf3006df70 con 0x7fbf30164130 2023-07-21T19:08:12.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf25ffb700 1 -- 172.21.15.123:0/2742969048 <== osd.7 v2:172.21.15.145:6824/2662407435 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf3006df70 con 0x7fbf30164130 2023-07-21T19:08:12.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb32ffd700 1 -- 172.21.15.123:0/702558583 <== osd.5 v2:172.21.15.145:6805/4212871842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb24002d90 con 0x7fbb2006ff40 2023-07-21T19:08:12.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] conn(0x7fbf30164130 msgr2=0x7fbf3014ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:6824/2662407435,v1:172.21.15.145:6825/2662407435] conn(0x7fbf30164130 0x7fbf3014ecd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] conn(0x7fbb2006ff40 msgr2=0x7fbb20072370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb30ff9700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.145:6805/4212871842,v1:172.21.15.145:6808/4212871842] conn(0x7fbb2006ff40 0x7fbb20072370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbb200662f0 msgr2=0x7fbb200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb30ff9700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbb200662f0 0x7fbb200687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb34037270 tx=0x7fbb2c008030 comp rx=0 tx=0).stop 2023-07-21T19:08:12.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbf14066340 msgr2=0x7fbf140687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbf14066340 0x7fbf140687f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf200090b0 tx=0x7fbf20008030 comp rx=0 tx=0).stop 2023-07-21T19:08:12.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb34036e80 msgr2=0x7fbb340347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb30ff9700 1 --2- 172.21.15.123:0/702558583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb34036e80 0x7fbb340347c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c500 tx=0x7fbb3800c810 comp rx=0 tx=0).stop 2023-07-21T19:08:12.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbb42b83700 1 -- 172.21.15.123:0/702558583 reap_dead start 2023-07-21T19:08:12.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf301617e0 msgr2=0x7fbf30163010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 --2- 172.21.15.123:0/2742969048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf301617e0 0x7fbf30163010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00e840 tx=0x7fbf2c00eb50 comp rx=0 tx=0).stop 2023-07-21T19:08:12.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf35a7a700 1 -- 172.21.15.123:0/2742969048 reap_dead start 2023-07-21T19:08:12.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 shutdown_connections 2023-07-21T19:08:12.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.004+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 >> 172.21.15.123:0/2742969048 conn(0x7fbf300cb9c0 msgr2=0x7fbf30162390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.008+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 shutdown_connections 2023-07-21T19:08:12.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.008+0000 7fbf374dd700 1 -- 172.21.15.123:0/2742969048 wait complete. 2023-07-21T19:08:12.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.008+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 shutdown_connections 2023-07-21T19:08:12.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.008+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 >> 172.21.15.123:0/702558583 conn(0x7fbb34051770 msgr2=0x7fbb340e16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.008+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 shutdown_connections 2023-07-21T19:08:12.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.012+0000 7fbb30ff9700 1 -- 172.21.15.123:0/702558583 wait complete. 2023-07-21T19:08:12.097 INFO:teuthology.orchestra.run.smithi123.stdout:55834574859 2023-07-21T19:08:12.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T19:08:12.099 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:12.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T19:08:12.100 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:12.100 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T19:08:12.101 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:12.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T19:08:12.102 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:12.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T19:08:12.103 INFO:teuthology.orchestra.run.smithi123.stdout:55834574859 2023-07-21T19:08:12.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T19:08:12.104 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:12.105 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T19:08:12.105 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:12.106 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T19:08:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a89ed700 1 Processor -- start 2023-07-21T19:08:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 Processor -- start 2023-07-21T19:08:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a89ed700 1 -- start start 2023-07-21T19:08:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a89ed700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a415ce50 0x7fa8a40cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a89ed700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa8a40acb10 0x7fa8a40cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a89ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa8a40ce450 0x7fa8a40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 -- start start 2023-07-21T19:08:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 0x7f1ac406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ac40cb180 0x7f1ac40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40ca8a0 con 0x7f1ac406dc50 2023-07-21T19:08:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac40cbcd0 con 0x7f1ac40cb180 2023-07-21T19:08:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7f1acb34d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40cbf70 con 0x7f1ac415ffa0 2023-07-21T19:08:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a2d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa8a40ce450 0x7fa8a40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a2d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa8a40ce450 0x7fa8a40ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59034/0 (socket says 172.21.15.123:59034) 2023-07-21T19:08:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a2d9d700 1 -- 172.21.15.123:0/1963218228 learned_addr learned my addr 172.21.15.123:0/1963218228 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a1d9b700 1 --2- 172.21.15.123:0/1963218228 >> v2:172.21.15.145:3300/0 conn(0x7fa8a40acb10 0x7fa8a40cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac90e9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 0x7f1ac406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac98ea700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ac40cb180 0x7f1ac40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac90e9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 0x7f1ac406d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47012/0 (socket says 172.21.15.123:47012) 2023-07-21T19:08:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac90e9700 1 -- 172.21.15.123:0/4254473975 learned_addr learned my addr 172.21.15.123:0/4254473975 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.356+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40cb960 con 0x7fa8a40ce450 2023-07-21T19:08:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40cdc00 con 0x7fa8a40acb10 2023-07-21T19:08:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40ce870 con 0x7fa8a415ce50 2023-07-21T19:08:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac98ea700 1 -- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 msgr2=0x7f1ac406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac98ea700 1 --2- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 0x7f1ac406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac98ea700 1 -- 172.21.15.123:0/4254473975 >> v1:172.21.15.145:6789/0 conn(0x7f1ac406dc50 legacy=0x7f1ac40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac98ea700 1 -- 172.21.15.123:0/4254473975 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40cc250 con 0x7f1ac40cb180 2023-07-21T19:08:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac90e9700 1 --2- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 0x7f1ac406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a2d9d700 1 -- 172.21.15.123:0/1963218228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a415ce50 msgr2=0x7fa8a40cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a2d9d700 1 --2- 172.21.15.123:0/1963218228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a415ce50 0x7fa8a40cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a2d9d700 1 -- 172.21.15.123:0/1963218228 >> v2:172.21.15.145:3300/0 conn(0x7fa8a40acb10 msgr2=0x7fa8a40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a2d9d700 1 --2- 172.21.15.123:0/1963218228 >> v2:172.21.15.145:3300/0 conn(0x7fa8a40acb10 0x7fa8a40cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a2d9d700 1 -- 172.21.15.123:0/1963218228 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40caba0 con 0x7fa8a40ce450 2023-07-21T19:08:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1ac98ea700 1 --2- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 0x7f1ac40ce340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009d90 tx=0x7f1abc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae9f5ee407a2da37 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1abbfff700 1 -- 172.21.15.123:0/4254473975 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00e070 con 0x7f1ac40cb180 2023-07-21T19:08:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a2d9d700 1 --2- 172.21.15.123:0/1963218228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40ce450 0x7fa8a40ab8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40b0cb0 tx=0x7fa894009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922b897d07f3169c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1abbfff700 1 -- 172.21.15.123:0/4254473975 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00bb20 con 0x7f1ac40cb180 2023-07-21T19:08:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a159a700 1 -- 172.21.15.123:0/1963218228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011830 con 0x7fa8a40ce450 2023-07-21T19:08:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a159a700 1 -- 172.21.15.123:0/1963218228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894011990 con 0x7fa8a40ce450 2023-07-21T19:08:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a159a700 1 -- 172.21.15.123:0/1963218228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011d20 con 0x7fa8a40ce450 2023-07-21T19:08:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1acb34d700 1 -- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 msgr2=0x7f1ac40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1acb34d700 1 --2- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 0x7f1ac40ce340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009d90 tx=0x7f1abc00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40ce450 msgr2=0x7fa8a40ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/1963218228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40ce450 0x7fa8a40ab8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40b0cb0 tx=0x7fa894009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1acb34d700 1 -- 172.21.15.123:0/4254473975 shutdown_connections 2023-07-21T19:08:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1acb34d700 1 --2- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 0x7f1ac40ce340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.360+0000 7f1acb34d700 1 --2- 172.21.15.123:0/4254473975 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac415ffa0 0x7f1ac406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f1acb34d700 1 -- 172.21.15.123:0/4254473975 >> 172.21.15.123:0/4254473975 conn(0x7f1ac406e960 msgr2=0x7f1ac406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f1acb34d700 1 -- 172.21.15.123:0/4254473975 shutdown_connections 2023-07-21T19:08:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f1acb34d700 1 -- 172.21.15.123:0/4254473975 wait complete. 2023-07-21T19:08:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 shutdown_connections 2023-07-21T19:08:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/1963218228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40ce450 0x7fa8a40ab8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/1963218228 >> v2:172.21.15.145:3300/0 conn(0x7fa8a40acb10 0x7fa8a40cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/1963218228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a415ce50 0x7fa8a40cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 >> 172.21.15.123:0/1963218228 conn(0x7fa8a4060320 msgr2=0x7fa8a40606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe3301700 1 Processor -- start 2023-07-21T19:08:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 shutdown_connections 2023-07-21T19:08:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 -- 172.21.15.123:0/1963218228 wait complete. 2023-07-21T19:08:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f1acb34d700 1 Processor -- start 2023-07-21T19:08:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe3301700 1 -- start start 2023-07-21T19:08:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe3301700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7fd4054800 0x7f7fd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe3301700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40060c0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe3301700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ded00 con 0x7f7fd403a810 2023-07-21T19:08:12.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe3301700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40070b0 con 0x7f7fd4054800 2023-07-21T19:08:12.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 Processor -- start 2023-07-21T19:08:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7fa8a89ed700 1 -- start start 2023-07-21T19:08:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe089c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7fd4036cb0 0x7f7fd403a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38120/0 (socket says 172.21.15.123:38120) 2023-07-21T19:08:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f7fe089c700 1 -- 172.21.15.123:0/1709748626 learned_addr learned my addr 172.21.15.123:0/1709748626 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.364+0000 7f1acb34d700 1 -- start start 2023-07-21T19:08:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe109d700 1 --2- 172.21.15.123:0/1709748626 >> v2:172.21.15.145:3300/0 conn(0x7f7fd4054800 0x7f7fd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 0x7f1ac414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 0x7f1ac414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac415ffa0 0x7f1ac40c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40c51c0 con 0x7f1ac415ffa0 2023-07-21T19:08:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac415ce50 con 0x7f1ac40cb180 2023-07-21T19:08:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac414cd30 con 0x7f1ac406dc50 2023-07-21T19:08:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe109d700 1 -- 172.21.15.123:0/1709748626 >> v1:172.21.15.145:6789/0 conn(0x7f7fd403a810 legacy=0x7f7fd40528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe109d700 1 -- 172.21.15.123:0/1709748626 >> v1:172.21.15.123:6789/0 conn(0x7f7fd4036cb0 legacy=0x7f7fd403a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 Processor -- start 2023-07-21T19:08:12.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fd3fff700 1 -- 172.21.15.123:0/1709748626 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942091510 0 0) 0x7f7fd40060c0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe109d700 1 -- 172.21.15.123:0/1709748626 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40062f0 con 0x7f7fd4054800 2023-07-21T19:08:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a89ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 0x7fa8a4158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a89ed700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a40ce450 0x7fa8a4158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe109d700 1 --2- 172.21.15.123:0/1709748626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4054800 0x7f7fd4036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8007040 tx=0x7f7fd8007350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa66b945d2a809a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 0x7fa8a4158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 0x7fa8a4158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59054/0 (socket says 172.21.15.123:59054) 2023-07-21T19:08:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 0x7f1ac414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 0x7f1ac414dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47026/0 (socket says 172.21.15.123:47026) 2023-07-21T19:08:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 -- 172.21.15.123:0/678989046 learned_addr learned my addr 172.21.15.123:0/678989046 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 -- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 msgr2=0x7f1ac414d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 0x7f1ac414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 -- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac415ffa0 msgr2=0x7f1ac40c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac415ffa0 0x7f1ac40c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 -- 172.21.15.123:0/678989046 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4009570 con 0x7f1ac406dc50 2023-07-21T19:08:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a259c700 1 -- 172.21.15.123:0/2471858865 learned_addr learned my addr 172.21.15.123:0/2471858865 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a415ce50 0x7fa8a4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4156f00 con 0x7fa8a40acb10 2023-07-21T19:08:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415f350 con 0x7fa8a415ce50 2023-07-21T19:08:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fd3fff700 1 -- 172.21.15.123:0/1709748626 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007a90 con 0x7f7fd4054800 2023-07-21T19:08:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fd3fff700 1 -- 172.21.15.123:0/1709748626 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8007bf0 con 0x7f7fd4054800 2023-07-21T19:08:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fd3fff700 1 -- 172.21.15.123:0/1709748626 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80090d0 con 0x7f7fd4054800 2023-07-21T19:08:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a1d9b700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a40ce450 0x7fa8a4158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4157150 con 0x7fa8a40ce450 2023-07-21T19:08:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fd2d9a5a700 1 Processor -- start 2023-07-21T19:08:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ac90e9700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 0x7f1ac414dc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400ebe0 tx=0x7f1ab4009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400c910 con 0x7f1ac406dc50 2023-07-21T19:08:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fa8a2d9d700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a415ce50 0x7fa8a4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe3301700 1 -- 172.21.15.123:0/1709748626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4054800 msgr2=0x7f7fd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe3301700 1 --2- 172.21.15.123:0/1709748626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4054800 0x7f7fd4036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8007040 tx=0x7f7fd8007350 comp rx=0 tx=0).stop 2023-07-21T19:08:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab400ca70 con 0x7f1ac406dc50 2023-07-21T19:08:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400ce00 con 0x7f1ac406dc50 2023-07-21T19:08:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe3301700 1 -- 172.21.15.123:0/1709748626 shutdown_connections 2023-07-21T19:08:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe3301700 1 --2- 172.21.15.123:0/1709748626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4054800 0x7f7fd4036770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f7fe3301700 1 -- 172.21.15.123:0/1709748626 >> 172.21.15.123:0/1709748626 conn(0x7f7fd4051770 msgr2=0x7f7fd4051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 -- start start 2023-07-21T19:08:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbddc15b620 0x7fbddc15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbddc06f1e0 0x7fbddc0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc157ee0 con 0x7fbddc0ccf60 2023-07-21T19:08:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbddc15c590 con 0x7fbddc06f1e0 2023-07-21T19:08:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde34cd700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbddc15c2f0 con 0x7fbddc15b620 2023-07-21T19:08:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fd2d9a5a700 1 -- start start 2023-07-21T19:08:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc009a70 con 0x7f1ac406dc50 2023-07-21T19:08:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde0a68700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbddc06f1e0 0x7fbddc0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.368+0000 7fbde1269700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbddc15b620 0x7fbddc15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde1269700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbddc15b620 0x7fbddc15b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44296/0 (socket says 172.21.15.123:44296) 2023-07-21T19:08:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde1269700 1 -- 172.21.15.123:0/2688070063 learned_addr learned my addr 172.21.15.123:0/2688070063 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7f7fe3301700 1 -- 172.21.15.123:0/1709748626 shutdown_connections 2023-07-21T19:08:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a1d9b700 1 -- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a415ce50 msgr2=0x7fa8a4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a1d9b700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a415ce50 0x7fa8a4154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a1d9b700 1 -- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 msgr2=0x7fa8a4158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a1d9b700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 0x7fa8a4158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a1d9b700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009570 con 0x7fa8a40ce450 2023-07-21T19:08:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7f7fe3301700 1 -- 172.21.15.123:0/1709748626 wait complete. 2023-07-21T19:08:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac414c9c0 con 0x7f1ac406dc50 2023-07-21T19:08:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a259c700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 0x7fa8a4158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde0a68700 1 -- 172.21.15.123:0/2688070063 >> v2:172.21.15.145:3300/0 conn(0x7fbddc15b620 msgr2=0x7fbddc15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde0a68700 1 --2- 172.21.15.123:0/2688070063 >> v2:172.21.15.145:3300/0 conn(0x7fbddc15b620 0x7fbddc15b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde0a68700 1 -- 172.21.15.123:0/2688070063 >> v1:172.21.15.123:6789/0 conn(0x7fbddc0ccf60 legacy=0x7fbddc0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde0a68700 1 -- 172.21.15.123:0/2688070063 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc0c8970 con 0x7fbddc06f1e0 2023-07-21T19:08:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9a5a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d40afbf0 0x7fd2d40c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde0a68700 1 --2- 172.21.15.123:0/2688070063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc06f1e0 0x7fbddc0cd760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbddc06fe50 tx=0x7fbdd400d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc22140dd244b1a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9a5a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2d40ce1e0 0x7fd2d40caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9a5a700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d40cdd50 con 0x7fd2d4157cb0 2023-07-21T19:08:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9a5a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d41580e0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9a5a700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40ca440 con 0x7fd2d40afbf0 2023-07-21T19:08:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbdd3fff700 1 -- 172.21.15.123:0/2688070063 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd400dd20 con 0x7fbddc06f1e0 2023-07-21T19:08:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbdd3fff700 1 -- 172.21.15.123:0/2688070063 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd400de80 con 0x7fbddc06f1e0 2023-07-21T19:08:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbdd3fff700 1 -- 172.21.15.123:0/2688070063 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4010640 con 0x7fbddc06f1e0 2023-07-21T19:08:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a1d9b700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a40ce450 0x7fa8a4158840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ebc0 tx=0x7fa89c00eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9259700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2d40ce1e0 0x7fd2d40caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbbeedbf700 1 Processor -- start 2023-07-21T19:08:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d3fff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fd2d4157cb0 0x7fd2d4158c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:47054/0 (socket says 172.21.15.123:47054) 2023-07-21T19:08:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d3fff700 1 -- 172.21.15.123:0/2544552379 learned_addr learned my addr 172.21.15.123:0/2544552379 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d8a58700 1 --2- 172.21.15.123:0/2544552379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d40afbf0 0x7fd2d40c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbbeedbf700 1 -- start start 2023-07-21T19:08:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac4071620 con 0x7f1ac406dc50 2023-07-21T19:08:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00ca80 con 0x7fa8a40ce450 2023-07-21T19:08:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00f040 con 0x7fa8a40ce450 2023-07-21T19:08:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00ce20 con 0x7fa8a40ce450 2023-07-21T19:08:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4157430 con 0x7fa8a40ce450 2023-07-21T19:08:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a4157c30 con 0x7fa8a40ce450 2023-07-21T19:08:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 -- 172.21.15.123:0/2688070063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc06f1e0 msgr2=0x7fbddc0cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 --2- 172.21.15.123:0/2688070063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc06f1e0 0x7fbddc0cd760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbddc06fe50 tx=0x7fbdd400d2a0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d8a58700 1 -- 172.21.15.123:0/2544552379 >> v2:172.21.15.123:3300/0 conn(0x7fd2d40ce1e0 msgr2=0x7fd2d40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d8a58700 1 --2- 172.21.15.123:0/2544552379 >> v2:172.21.15.123:3300/0 conn(0x7fd2d40ce1e0 0x7fd2d40caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d8a58700 1 -- 172.21.15.123:0/2544552379 >> v1:172.21.15.145:6789/0 conn(0x7fd2d4157cb0 legacy=0x7fd2d4158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d8a58700 1 -- 172.21.15.123:0/2544552379 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40ca720 con 0x7fd2d40afbf0 2023-07-21T19:08:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d37fe700 1 -- 172.21.15.123:0/2544552379 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356973832 0 0) 0x7fd2d40cdd50 con 0x7fd2d4157cb0 2023-07-21T19:08:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7f7fe3301700 1 Processor -- start 2023-07-21T19:08:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d9259700 1 --2- 172.21.15.123:0/2544552379 >> v2:172.21.15.123:3300/0 conn(0x7fd2d40ce1e0 0x7fd2d40caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 -- 172.21.15.123:0/2688070063 shutdown_connections 2023-07-21T19:08:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 --2- 172.21.15.123:0/2688070063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc06f1e0 0x7fbddc0cd760 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 --2- 172.21.15.123:0/2688070063 >> v2:172.21.15.145:3300/0 conn(0x7fbddc15b620 0x7fbddc15b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 -- 172.21.15.123:0/2688070063 >> 172.21.15.123:0/2688070063 conn(0x7fbddc060320 msgr2=0x7fbddc0606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fd2d8a58700 1 --2- 172.21.15.123:0/2544552379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d40afbf0 0x7fd2d40c86b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009d90 tx=0x7fd2cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5697923997a5108a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 -- 172.21.15.123:0/2688070063 shutdown_connections 2023-07-21T19:08:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.372+0000 7fbde34cd700 1 -- 172.21.15.123:0/2688070063 wait complete. 2023-07-21T19:08:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d37fe700 1 -- 172.21.15.123:0/2544552379 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00e070 con 0x7fd2d40afbf0 2023-07-21T19:08:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d37fe700 1 -- 172.21.15.123:0/2544552379 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc00bb20 con 0x7fd2d40afbf0 2023-07-21T19:08:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d37fe700 1 -- 172.21.15.123:0/2544552379 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc012430 con 0x7fd2d40afbf0 2023-07-21T19:08:12.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888005310 con 0x7fa8a40ce450 2023-07-21T19:08:12.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa89c014480 con 0x7fa8a40ce450 2023-07-21T19:08:12.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbde34cd700 1 Processor -- start 2023-07-21T19:08:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 -- start start 2023-07-21T19:08:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbeedbf700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbbe81599d0 0x7fbbe8071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbeedbf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbe815ccf0 0x7fbbe80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbeedbf700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80cde10 con 0x7fbbe80caa20 2023-07-21T19:08:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbeedbf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80c8bf0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbeedbf700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80cd520 con 0x7fbbe81599d0 2023-07-21T19:08:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbecb5b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbbe81599d0 0x7fbbe8071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbe815ccf0 0x7fbbe80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbecb5b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbbe81599d0 0x7fbbe8071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44302/0 (socket says 172.21.15.123:44302) 2023-07-21T19:08:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbecb5b700 1 -- 172.21.15.123:0/1225487938 learned_addr learned my addr 172.21.15.123:0/1225487938 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe7fff700 1 -- 172.21.15.123:0/1225487938 >> v2:172.21.15.145:3300/0 conn(0x7fbbe81599d0 msgr2=0x7fbbe8071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe7fff700 1 --2- 172.21.15.123:0/1225487938 >> v2:172.21.15.145:3300/0 conn(0x7fbbe81599d0 0x7fbbe8071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe7fff700 1 -- 172.21.15.123:0/1225487938 >> v1:172.21.15.145:6789/0 conn(0x7fbbe80caa20 legacy=0x7fbbe80ce2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T19:08:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe7fff700 1 -- 172.21.15.123:0/1225487938 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80715e0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/2544552379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d40afbf0 msgr2=0x7fd2d40c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/2544552379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d40afbf0 0x7fd2d40c86b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009d90 tx=0x7fd2cc00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/2544552379 shutdown_connections 2023-07-21T19:08:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/2544552379 >> v2:172.21.15.123:3300/0 conn(0x7fd2d40ce1e0 0x7fd2d40caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/2544552379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d40afbf0 0x7fd2d40c86b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/2544552379 >> 172.21.15.123:0/2544552379 conn(0x7fd2d4060320 msgr2=0x7fd2d40606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/2544552379 shutdown_connections 2023-07-21T19:08:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f6fac2c6700 1 Processor -- start 2023-07-21T19:08:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f6fac2c6700 1 -- start start 2023-07-21T19:08:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe7fff700 1 --2- 172.21.15.123:0/1225487938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80c86b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80cbbc0 tx=0x7fbbdc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a8a2eb04201f6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fa892ffd700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840663f0 0x7fa8840688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa89c084890 con 0x7fa8a40ce450 2023-07-21T19:08:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbbe77fe700 1 -- 172.21.15.123:0/1225487938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc004230 con 0x7fbbe815ccf0 2023-07-21T19:08:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbe77fe700 1 -- 172.21.15.123:0/1225487938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc004390 con 0x7fbbe815ccf0 2023-07-21T19:08:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbe77fe700 1 -- 172.21.15.123:0/1225487938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0036c0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ab4013470 con 0x7f1ac406dc50 2023-07-21T19:08:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f1ab9ffb700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1aa8066320 0x7f1aa80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ab4084120 con 0x7f1ac406dc50 2023-07-21T19:08:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fa8a259c700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840663f0 0x7fa8840688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4036cb0 0x7f7fd404e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fd403a810 0x7f7fd40dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4054800 0x7f7fd4047400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd404c3f0 con 0x7f7fd4054800 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd417c140 con 0x7f7fd4036cb0 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe3301700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd404bdc0 con 0x7f7fd403a810 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe089c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fd403a810 0x7f7fd40dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe089c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fd403a810 0x7f7fd40dd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47062/0 (socket says 172.21.15.123:47062) 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe089c700 1 -- 172.21.15.123:0/325909775 learned_addr learned my addr 172.21.15.123:0/325909775 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7fe109d700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4036cb0 0x7f7fd404e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe109d700 1 -- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fd403a810 msgr2=0x7f7fd40dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe109d700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fd403a810 0x7f7fd40dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe109d700 1 -- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4054800 msgr2=0x7f7fd4047400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe109d700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4054800 0x7f7fd4047400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe109d700 1 -- 172.21.15.123:0/325909775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd8009dd0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/2544552379 wait complete. 2023-07-21T19:08:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fd2d9a5a700 1 Processor -- start 2023-07-21T19:08:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe109d700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4036cb0 0x7f7fd404e0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8016000 tx=0x7f7fd8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 -- 172.21.15.123:0/1225487938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe815ccf0 msgr2=0x7fbbe80c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/1225487938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80c86b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80cbbc0 tx=0x7fbbdc009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7e99377700 1 Processor -- start 2023-07-21T19:08:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f1ac88e8700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1aa8066320 0x7f1aa80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fa8a259c700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840663f0 0x7fa8840688a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41f8dd0 tx=0x7fa898009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7fbde34cd700 1 -- start start 2023-07-21T19:08:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80097d0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd80036c0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8003a50 con 0x7f7fd4036cb0 2023-07-21T19:08:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd404e8e0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 -- 172.21.15.123:0/1225487938 shutdown_connections 2023-07-21T19:08:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/1225487938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80c86b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/1225487938 >> v2:172.21.15.145:3300/0 conn(0x7fbbe81599d0 0x7fbbe8071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 -- 172.21.15.123:0/1225487938 >> 172.21.15.123:0/1225487938 conn(0x7fbbe806e960 msgr2=0x7fbbe806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fd2d9a5a700 1 -- start start 2023-07-21T19:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7e99377700 1 -- start start 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7e99377700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e940ca2f0 0x7f7e940c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7e99377700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940caa70 con 0x7f7e94071210 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7e99377700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940ca790 con 0x7f7e94069800 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.376+0000 7f7e99377700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e941583d0 con 0x7f7e940ca2f0 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e940ca2f0 0x7f7e940c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e940ca2f0 0x7f7e940c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59092/0 (socket says 172.21.15.123:59092) 2023-07-21T19:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 -- 172.21.15.123:0/1127055696 learned_addr learned my addr 172.21.15.123:0/1127055696 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6fac2c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6fac2c6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa415a5d0 con 0x7f6fa4159f80 2023-07-21T19:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6fa9861700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6fa4159f80 0x7f6fa40cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38142/0 (socket says 172.21.15.123:38142) 2023-07-21T19:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6fa9861700 1 -- 172.21.15.123:0/1470452780 learned_addr learned my addr 172.21.15.123:0/1470452780 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa415a8b0 con 0x7f6fa4157720 2023-07-21T19:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40ca550 con 0x7f6fa40ce700 2023-07-21T19:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6faa863700 1 --2- 172.21.15.123:0/1470452780 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6faa863700 1 -- 172.21.15.123:0/1470452780 >> v1:172.21.15.145:6789/0 conn(0x7f6fa4157720 legacy=0x7f6fa40c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6faa863700 1 -- 172.21.15.123:0/1470452780 >> v1:172.21.15.123:6789/0 conn(0x7f6fa4159f80 legacy=0x7f6fa40cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6faa863700 1 -- 172.21.15.123:0/1470452780 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa415ab90 con 0x7f6fa40ce700 2023-07-21T19:08:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f1ac88e8700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1aa8066320 0x7f1aa80687d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40c4fc0 tx=0x7f1ac0007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 -- 172.21.15.123:0/1127055696 >> v1:172.21.15.145:6789/0 conn(0x7f7e94069800 legacy=0x7f7e94069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 -- 172.21.15.123:0/1127055696 >> v1:172.21.15.123:6789/0 conn(0x7f7e94071210 legacy=0x7f7e9406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 -- 172.21.15.123:0/1127055696 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94070730 con 0x7f7e940ca2f0 2023-07-21T19:08:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e927fc700 1 --2- 172.21.15.123:0/1127055696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940ca2f0 0x7f7e940c8800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e94066ce0 tx=0x7f7e88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e316689f1c075608 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e91ffb700 1 -- 172.21.15.123:0/1127055696 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88004230 con 0x7f7e940ca2f0 2023-07-21T19:08:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e91ffb700 1 -- 172.21.15.123:0/1127055696 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e88004390 con 0x7f7e940ca2f0 2023-07-21T19:08:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e91ffb700 1 -- 172.21.15.123:0/1127055696 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880036c0 con 0x7f7e940ca2f0 2023-07-21T19:08:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde34cd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbddc06f1e0 0x7fbddc1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde34cd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbddc0ccf60 0x7fbddc1f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde34cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 0x7fbddc1f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde34cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc158d20 con 0x7fbddc15b620 2023-07-21T19:08:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde34cd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc1f6a20 con 0x7fbddc0ccf60 2023-07-21T19:08:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde34cd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc158110 con 0x7fbddc06f1e0 2023-07-21T19:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f6faa863700 1 --2- 172.21.15.123:0/1470452780 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa406d040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009dc0 tx=0x7f6fa000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9fed70bebb8bd91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd404c010 con 0x7f7fd4036cb0 2023-07-21T19:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 -- 172.21.15.123:0/1225487938 shutdown_connections 2023-07-21T19:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde1a6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 0x7fbddc1f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde1269700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbddc06f1e0 0x7fbddc1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde1a6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 0x7fbddc1f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59106/0 (socket says 172.21.15.123:59106) 2023-07-21T19:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde1a6a700 1 -- 172.21.15.123:0/3178028938 learned_addr learned my addr 172.21.15.123:0/3178028938 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbde0a68700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbddc0ccf60 0x7fbddc1f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7fbbeedbf700 1 -- 172.21.15.123:0/1225487938 wait complete. 2023-07-21T19:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2d40afbf0 0x7fd2d41f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e99377700 1 -- 172.21.15.123:0/1127055696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940ca2f0 msgr2=0x7f7e940c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.380+0000 7f7e99377700 1 --2- 172.21.15.123:0/1127055696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940ca2f0 0x7f7e940c8800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e94066ce0 tx=0x7f7e88009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 0x7fd2d41ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde1a6a700 1 -- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbddc06f1e0 msgr2=0x7fbddc1f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde1a6a700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbddc06f1e0 0x7fbddc1f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde1a6a700 1 -- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbddc0ccf60 msgr2=0x7fbddc1f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde1a6a700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbddc0ccf60 0x7fbddc1f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde1a6a700 1 -- 172.21.15.123:0/3178028938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4007920 con 0x7fbddc15b620 2023-07-21T19:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde1a6a700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 0x7fbddc1f6c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c3c0 tx=0x7fbdcc00c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 -- 172.21.15.123:0/1127055696 shutdown_connections 2023-07-21T19:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 --2- 172.21.15.123:0/1127055696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940ca2f0 0x7f7e940c8800 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 -- 172.21.15.123:0/1127055696 >> 172.21.15.123:0/1127055696 conn(0x7f7e940cb8c0 msgr2=0x7f7e940ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d4157cb0 0x7fd2d40b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd4005530 con 0x7f7fd4036cb0 2023-07-21T19:08:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 -- 172.21.15.123:0/1127055696 shutdown_connections 2023-07-21T19:08:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 0x7fd2d41ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 0x7fd2d41ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59120/0 (socket says 172.21.15.123:59120) 2023-07-21T19:08:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d8a58700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2d40afbf0 0x7fd2d41f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d8a58700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2d40afbf0 0x7fd2d41f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44336/0 (socket says 172.21.15.123:44336) 2023-07-21T19:08:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc016070 con 0x7fbddc15b620 2023-07-21T19:08:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 -- 172.21.15.123:0/3479739726 learned_addr learned my addr 172.21.15.123:0/3479739726 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc1583f0 con 0x7fbddc15b620 2023-07-21T19:08:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc006880 con 0x7fbddc15b620 2023-07-21T19:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc006bf0 con 0x7fbddc15b620 2023-07-21T19:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40b3ee0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d41597a0 con 0x7fd2d40afbf0 2023-07-21T19:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc1589b0 con 0x7fbddc15b620 2023-07-21T19:08:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9259700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d4157cb0 0x7fd2d40b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d41f4c90 con 0x7fd2d4157cb0 2023-07-21T19:08:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 -- 172.21.15.123:0/1127055696 wait complete. 2023-07-21T19:08:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbbeedbf700 1 Processor -- start 2023-07-21T19:08:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 -- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d4157cb0 msgr2=0x7fd2d40b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d4157cb0 0x7fd2d40b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 -- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2d40afbf0 msgr2=0x7fd2d41f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2d40afbf0 0x7fd2d41f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40094b0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc04e500 con 0x7fbddc15b620 2023-07-21T19:08:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fd8003bb0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d3fff700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 0x7fd2d41ff9e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c4e0 tx=0x7fd2c800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 Processor -- start 2023-07-21T19:08:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fbbeedbf700 1 -- start start 2023-07-21T19:08:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8004ca0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8004e20 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8007310 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc009a70 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d4159fe0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1ab40512a0 con 0x7f1ac406dc50 2023-07-21T19:08:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7fd1ffb700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7fc0066370 0x7f7fc0068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fd8085480 con 0x7f7fd4036cb0 2023-07-21T19:08:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.384+0000 7f7e99377700 1 -- start start 2023-07-21T19:08:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e99377700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e94069800 0x7f7e940c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e99377700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e94071210 0x7f7e94156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e99377700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940ca2f0 0x7f7e940ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e99377700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940c6050 con 0x7f7e94069800 2023-07-21T19:08:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e99377700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940c6330 con 0x7f7e940ca2f0 2023-07-21T19:08:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e99377700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940c6610 con 0x7f7e94071210 2023-07-21T19:08:12.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7fe089c700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7fc0066370 0x7f7fc0068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbeedbf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbe80caa20 0x7fbbe80c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbeedbf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe81599d0 0x7fbbe80b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbeedbf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4005310 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbeedbf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80c5630 con 0x7fbbe81599d0 2023-07-21T19:08:12.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbeedbf700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80c5910 con 0x7fbbe815ccf0 2023-07-21T19:08:12.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbeedbf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80c5bf0 con 0x7fbbe80caa20 2023-07-21T19:08:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbdcc006d50 con 0x7fbddc15b620 2023-07-21T19:08:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44352/0 (socket says 172.21.15.123:44352) 2023-07-21T19:08:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 -- 172.21.15.123:0/3362644507 learned_addr learned my addr 172.21.15.123:0/3362644507 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e92ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e94069800 0x7f7e940c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e927fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e94071210 0x7f7e94156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e927fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e94071210 0x7f7e94156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47106/0 (socket says 172.21.15.123:47106) 2023-07-21T19:08:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e927fc700 1 -- 172.21.15.123:0/515175413 learned_addr learned my addr 172.21.15.123:0/515175413 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940ca2f0 0x7f7e940ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbdd1ffb700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdc00662f0 0x7fbdc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbe7fff700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe81599d0 0x7fbbe80b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbde1269700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdc00662f0 0x7fbdc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbecb5b700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbe80caa20 0x7fbbe80c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7fe089c700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7fc0066370 0x7f7fc0068820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001360 tx=0x7f7fcc0012f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 -- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbe80caa20 msgr2=0x7fbbe80c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbe80caa20 0x7fbbe80c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 -- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe81599d0 msgr2=0x7fbbe80b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe81599d0 0x7fbbe80b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbed35c700 1 -- 172.21.15.123:0/3362644507 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0094b0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbbecb5b700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbe80caa20 0x7fbbe80c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:12.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 -- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e94071210 msgr2=0x7f7e94156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e94071210 0x7f7e94156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 -- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e94069800 msgr2=0x7f7e940c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e94069800 0x7f7e940c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 -- 172.21.15.123:0/515175413 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88009570 con 0x7f7e940ca2f0 2023-07-21T19:08:12.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fbde1269700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdc00662f0 0x7fbdc00687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8006e80 tx=0x7fbdd800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7f7e93fff700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940ca2f0 0x7f7e940ce1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c8f0 tx=0x7f7e8c00cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.388+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2c8007470 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fbbed35c700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80b32c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b990 tx=0x7fbbe000bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbdcc057a40 con 0x7fbddc15b620 2023-07-21T19:08:12.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fd2d17fa700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2c00663c0 0x7fd2c0068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd2c8083ba0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fa9060700 1 -- 172.21.15.123:0/1470452780 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000e070 con 0x7f6fa40ce700 2023-07-21T19:08:12.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fa9060700 1 -- 172.21.15.123:0/1470452780 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000bad0 con 0x7f6fa40ce700 2023-07-21T19:08:12.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fa9060700 1 -- 172.21.15.123:0/1470452780 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000be60 con 0x7f6fa40ce700 2023-07-21T19:08:12.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fd2d8a58700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2c00663c0 0x7fd2c0068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa89c051a90 con 0x7fa8a40ce450 2023-07-21T19:08:12.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 msgr2=0x7f6fa406d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/1470452780 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa406d040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009dc0 tx=0x7f6fa000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:12.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7fd2d8a58700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2c00663c0 0x7fd2c0068870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc014040 tx=0x7fd2cc011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 shutdown_connections 2023-07-21T19:08:12.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/1470452780 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa406d040 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 >> 172.21.15.123:0/1470452780 conn(0x7f6fa4060320 msgr2=0x7f6fa40606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 shutdown_connections 2023-07-21T19:08:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.392+0000 7f6fac2c6700 1 -- 172.21.15.123:0/1470452780 wait complete. 2023-07-21T19:08:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 Processor -- start 2023-07-21T19:08:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbdcc04fdc0 con 0x7fbddc15b620 2023-07-21T19:08:12.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 -- start start 2023-07-21T19:08:12.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000c930 con 0x7fbbe815ccf0 2023-07-21T19:08:12.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe000ca90 con 0x7fbbe815ccf0 2023-07-21T19:08:12.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000ce40 con 0x7fbbe815ccf0 2023-07-21T19:08:12.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7fd8052680 con 0x7f7fd4036cb0 2023-07-21T19:08:12.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fa4157720 0x7f6fa415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa4159f80 0x7f6fa41f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa414cbb0 con 0x7f6fa4159f80 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6faa062700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fa9861700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fa4157720 0x7f6fa415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6faa062700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa414c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47120/0 (socket says 172.21.15.123:47120) 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40cdc40 con 0x7f6fa4157720 2023-07-21T19:08:12.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fa9861700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fa4157720 0x7f6fa415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44366/0 (socket says 172.21.15.123:44366) 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41efb10 con 0x7f6fa40ce700 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6faa062700 1 -- 172.21.15.123:0/2299633681 learned_addr learned my addr 172.21.15.123:0/2299633681 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.396+0000 7f6faa863700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa4159f80 0x7f6fa41f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f6faa863700 1 -- 172.21.15.123:0/2299633681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 msgr2=0x7f6fa414c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f6faa863700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa414c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f6faa863700 1 -- 172.21.15.123:0/2299633681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fa4157720 msgr2=0x7f6fa415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f6faa863700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fa4157720 0x7f6fa415c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f6faa863700 1 -- 172.21.15.123:0/2299633681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009a70 con 0x7f6fa4159f80 2023-07-21T19:08:12.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f6faa863700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa4159f80 0x7f6fa41f0710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0014000 tx=0x7f6fa0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c011840 con 0x7f7e940ca2f0 2023-07-21T19:08:12.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0119c0 con 0x7f7e940ca2f0 2023-07-21T19:08:12.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c011d70 con 0x7f7e940ca2f0 2023-07-21T19:08:12.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940c68f0 con 0x7f7e940ca2f0 2023-07-21T19:08:12.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e941571d0 con 0x7f7e940ca2f0 2023-07-21T19:08:12.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e74005310 con 0x7f7e940ca2f0 2023-07-21T19:08:12.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd2c8050da0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe80c5ed0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe80b2590 con 0x7fbbe815ccf0 2023-07-21T19:08:12.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.400+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80c63f0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0012650 con 0x7f6fa4159f80 2023-07-21T19:08:12.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e8c00a410 con 0x7f7e940ca2f0 2023-07-21T19:08:12.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa41efdf0 con 0x7f6fa4159f80 2023-07-21T19:08:12.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa41f03b0 con 0x7f6fa4159f80 2023-07-21T19:08:12.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f7e7b7fe700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800663c0 0x7f7e80068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00127d0 con 0x7f6fa4159f80 2023-07-21T19:08:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbe001d3b0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7e8c00d040 con 0x7f7e940ca2f0 2023-07-21T19:08:12.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f7e92ffd700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800663c0 0x7f7e80068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.404+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0012b80 con 0x7f6fa4159f80 2023-07-21T19:08:12.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7f7e92ffd700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800663c0 0x7f7e80068870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e9415c990 tx=0x7f7e84007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fa0012d20 con 0x7f6fa4159f80 2023-07-21T19:08:12.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7fbbe57fa700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbbcc0662f0 0x7fbbcc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbbe0084180 con 0x7fbbe815ccf0 2023-07-21T19:08:12.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7fbbecb5b700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbbcc0662f0 0x7fbbcc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbbe00511f0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7fbbecb5b700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbbcc0662f0 0x7fbbcc0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009ba0 tx=0x7fbbd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c005310 con 0x7f6fa4159f80 2023-07-21T19:08:12.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7f6f96ffd700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6f88066370 0x7f6f88068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:12.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6fa0085ed0 con 0x7f6fa4159f80 2023-07-21T19:08:12.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.408+0000 7f6faa062700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6f88066370 0x7f6f88068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:12.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.412+0000 7f6faa062700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6f88066370 0x7f6f88068820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005180 tx=0x7f6f9c003910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:12.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.412+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7e8c051330 con 0x7f7e940ca2f0 2023-07-21T19:08:12.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.412+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6fa00531d0 con 0x7f6fa4159f80 2023-07-21T19:08:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.712+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ac404e500 con 0x7f1ac406dc50 2023-07-21T19:08:12.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.712+0000 7f1ab9ffb700 1 -- 172.21.15.123:0/678989046 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ab40548c0 con 0x7f1ac406dc50 2023-07-21T19:08:12.727 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8880055c0 con 0x7fa8a40ce450 2023-07-21T19:08:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1aa8066320 msgr2=0x7f1aa80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7fa892ffd700 1 -- 172.21.15.123:0/2471858865 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa89c0550b0 con 0x7fa8a40ce450 2023-07-21T19:08:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1aa8066320 0x7f1aa80687d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40c4fc0 tx=0x7f1ac0007a00 comp rx=0 tx=0).stop 2023-07-21T19:08:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 msgr2=0x7f1ac414dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 0x7f1ac414dc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400ebe0 tx=0x7f1ab4009e90 comp rx=0 tx=0).stop 2023-07-21T19:08:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 shutdown_connections 2023-07-21T19:08:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1aa8066320 0x7f1aa80687d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac40cb180 0x7f1ac414d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac415ffa0 0x7f1ac40c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 --2- 172.21.15.123:0/678989046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac406dc50 0x7f1ac414dc90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 >> 172.21.15.123:0/678989046 conn(0x7f1ac406e960 msgr2=0x7f1ac40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 shutdown_connections 2023-07-21T19:08:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f1acb34d700 1 -- 172.21.15.123:0/678989046 wait complete. 2023-07-21T19:08:12.732 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.716+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7fd40de470 con 0x7f7fd4036cb0 2023-07-21T19:08:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840663f0 msgr2=0x7fa8840688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840663f0 0x7fa8840688a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41f8dd0 tx=0x7fa898009210 comp rx=0 tx=0).stop 2023-07-21T19:08:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a40ce450 msgr2=0x7fa8a4158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7f7fd1ffb700 1 -- 172.21.15.123:0/325909775 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fd8055ca0 con 0x7f7fd4036cb0 2023-07-21T19:08:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a40ce450 0x7fa8a4158840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ebc0 tx=0x7fa89c00eed0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.735 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 shutdown_connections 2023-07-21T19:08:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa8840663f0 0x7fa8840688a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a415ce50 0x7fa8a4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a40ce450 0x7fa8a4158840 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 --2- 172.21.15.123:0/2471858865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a40acb10 0x7fa8a4158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 >> 172.21.15.123:0/2471858865 conn(0x7fa8a4060320 msgr2=0x7fa8a40ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 shutdown_connections 2023-07-21T19:08:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.720+0000 7fa8a89ed700 1 -- 172.21.15.123:0/2471858865 wait complete. 2023-07-21T19:08:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7fc0066370 msgr2=0x7f7fc0068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7fc0066370 0x7f7fc0068820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001360 tx=0x7f7fcc0012f0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4036cb0 msgr2=0x7f7fd404e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4036cb0 0x7f7fd404e0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8016000 tx=0x7f7fd8004770 comp rx=0 tx=0).stop 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 shutdown_connections 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7fc0066370 0x7f7fc0068820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4054800 0x7f7fd4047400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7fd403a810 0x7f7fd40dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 --2- 172.21.15.123:0/325909775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7fd4036cb0 0x7f7fd404e0b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 >> 172.21.15.123:0/325909775 conn(0x7f7fd4051770 msgr2=0x7f7fd4051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 shutdown_connections 2023-07-21T19:08:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7f7fe3301700 1 -- 172.21.15.123:0/325909775 wait complete. 2023-07-21T19:08:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.724+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd2b40055c0 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.728+0000 7fd2d17fa700 1 -- 172.21.15.123:0/3479739726 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2c8007720 con 0x7fd2d40ce1e0 2023-07-21T19:08:12.740 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2c00663c0 msgr2=0x7fd2c0068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2c00663c0 0x7fd2c0068870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc014040 tx=0x7fd2cc011000 comp rx=0 tx=0).stop 2023-07-21T19:08:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 msgr2=0x7fd2d41ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 0x7fd2d41ff9e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c4e0 tx=0x7fd2c800c7f0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 shutdown_connections 2023-07-21T19:08:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2c00663c0 0x7fd2c0068870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2d4157cb0 0x7fd2d40b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d40ce1e0 0x7fd2d41ff9e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 --2- 172.21.15.123:0/3479739726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2d40afbf0 0x7fd2d41f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 >> 172.21.15.123:0/3479739726 conn(0x7fd2d4060320 msgr2=0x7fd2d40c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 shutdown_connections 2023-07-21T19:08:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7fd2d9a5a700 1 -- 172.21.15.123:0/3479739726 wait complete. 2023-07-21T19:08:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.732+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6f8c005890 con 0x7f6fa4159f80 2023-07-21T19:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.736+0000 7f6f96ffd700 1 -- 172.21.15.123:0/2299633681 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6fa0017090 con 0x7f6fa4159f80 2023-07-21T19:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.736+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbddc06a400 con 0x7fbddc15b620 2023-07-21T19:08:12.748 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.736+0000 7fbdd1ffb700 1 -- 172.21.15.123:0/3178028938 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdcc0533e0 con 0x7fbddc15b620 2023-07-21T19:08:12.749 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.736+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbbe80c63f0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.736+0000 7fbbe57fa700 1 -- 172.21.15.123:0/3362644507 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbe80c63f0 con 0x7fbbe815ccf0 2023-07-21T19:08:12.750 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6f88066370 msgr2=0x7f6f88068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6f88066370 0x7f6f88068820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005180 tx=0x7f6f9c003910 comp rx=0 tx=0).stop 2023-07-21T19:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa4159f80 msgr2=0x7f6fa41f0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa4159f80 0x7f6fa41f0710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0014000 tx=0x7f6fa0004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdc00662f0 msgr2=0x7fbdc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdc00662f0 0x7fbdc00687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8006e80 tx=0x7fbdd800c040 comp rx=0 tx=0).stop 2023-07-21T19:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 shutdown_connections 2023-07-21T19:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6f88066370 0x7f6f88068820 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fa4157720 0x7f6fa415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa4159f80 0x7f6fa41f0710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 --2- 172.21.15.123:0/2299633681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fa40ce700 0x7f6fa414c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 >> 172.21.15.123:0/2299633681 conn(0x7f6fa4060320 msgr2=0x7f6fa40c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 shutdown_connections 2023-07-21T19:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7f6fac2c6700 1 -- 172.21.15.123:0/2299633681 wait complete. 2023-07-21T19:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 msgr2=0x7fbddc1f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 0x7fbddc1f6c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c3c0 tx=0x7fbdcc00c6d0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 shutdown_connections 2023-07-21T19:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbdc00662f0 0x7fbdc00687a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbddc0ccf60 0x7fbddc1f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbddc15b620 0x7fbddc1f6c70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 --2- 172.21.15.123:0/3178028938 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbddc06f1e0 0x7fbddc1f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 >> 172.21.15.123:0/3178028938 conn(0x7fbddc060320 msgr2=0x7fbddc0724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.740+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 shutdown_connections 2023-07-21T19:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbde34cd700 1 -- 172.21.15.123:0/3178028938 wait complete. 2023-07-21T19:08:12.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-07-21T19:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbbcc0662f0 msgr2=0x7fbbcc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbbcc0662f0 0x7fbbcc0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009ba0 tx=0x7fbbd4008040 comp rx=0 tx=0).stop 2023-07-21T19:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 msgr2=0x7fbbe80b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80b32c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b990 tx=0x7fbbe000bca0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e740055c0 con 0x7f7e940ca2f0 2023-07-21T19:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 shutdown_connections 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fbbcc0662f0 0x7fbbcc0687a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbe815ccf0 0x7fbbe80b32c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe81599d0 0x7fbbe80b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 --2- 172.21.15.123:0/3362644507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbe80caa20 0x7fbbe80c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 >> 172.21.15.123:0/3362644507 conn(0x7fbbe806e960 msgr2=0x7fbbe80c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 shutdown_connections 2023-07-21T19:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7fbbeedbf700 1 -- 172.21.15.123:0/3362644507 wait complete. 2023-07-21T19:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.744+0000 7f7e7b7fe700 1 -- 172.21.15.123:0/515175413 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e8c01f090 con 0x7f7e940ca2f0 2023-07-21T19:08:12.761 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:12.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-07-21T19:08:12.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-07-21T19:08:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800663c0 msgr2=0x7f7e80068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800663c0 0x7f7e80068870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e9415c990 tx=0x7f7e84007ee0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940ca2f0 msgr2=0x7f7e940ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940ca2f0 0x7f7e940ce1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c8f0 tx=0x7f7e8c00cc00 comp rx=0 tx=0).stop 2023-07-21T19:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 shutdown_connections 2023-07-21T19:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800663c0 0x7f7e80068870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940ca2f0 0x7f7e940ce1d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e94071210 0x7f7e94156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 --2- 172.21.15.123:0/515175413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e94069800 0x7f7e940c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.748+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 >> 172.21.15.123:0/515175413 conn(0x7f7e940cb8c0 msgr2=0x7f7e940af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.752+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 shutdown_connections 2023-07-21T19:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:12.752+0000 7f7e99377700 1 -- 172.21.15.123:0/515175413 wait complete. 2023-07-21T19:08:12.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-07-21T19:08:12.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-07-21T19:08:12.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-07-21T19:08:12.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-07-21T19:08:12.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-07-21T19:08:13.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T19:08:13.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T19:08:13.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T19:08:13.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T19:08:13.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T19:08:13.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T19:08:13.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T19:08:13.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T19:08:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 Processor -- start 2023-07-21T19:08:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 -- start start 2023-07-21T19:08:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79040caa70 0x7f79040c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7904158c70 0x7f79040cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79040cdd50 con 0x7f79040ce1e0 2023-07-21T19:08:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040cda20 con 0x7f79040caa70 2023-07-21T19:08:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.951+0000 7f790af01700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040cb380 con 0x7f7904158c70 2023-07-21T19:08:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79040caa70 0x7f79040c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79040caa70 0x7f79040c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51292/0 (socket says 172.21.15.123:51292) 2023-07-21T19:08:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7903fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7904158c70 0x7f79040cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 -- 172.21.15.123:0/3533454517 learned_addr learned my addr 172.21.15.123:0/3533454517 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 -- 172.21.15.123:0/3533454517 >> v2:172.21.15.145:3300/0 conn(0x7f7904158c70 msgr2=0x7f79040cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 --2- 172.21.15.123:0/3533454517 >> v2:172.21.15.145:3300/0 conn(0x7f7904158c70 0x7f79040cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 -- 172.21.15.123:0/3533454517 >> v1:172.21.15.145:6789/0 conn(0x7f79040ce1e0 legacy=0x7f790406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 -- 172.21.15.123:0/3533454517 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040ca440 con 0x7f79040caa70 2023-07-21T19:08:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f7908c9d700 1 --2- 172.21.15.123:0/3533454517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79040c86b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79040c9e60 tx=0x7f78f4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29782293f66c689e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f79037fe700 1 -- 172.21.15.123:0/3533454517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4004230 con 0x7f79040caa70 2023-07-21T19:08:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f79037fe700 1 -- 172.21.15.123:0/3533454517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4004390 con 0x7f79040caa70 2023-07-21T19:08:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f790af01700 1 -- 172.21.15.123:0/3533454517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 msgr2=0x7f79040c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.955+0000 7f790af01700 1 --2- 172.21.15.123:0/3533454517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79040c86b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79040c9e60 tx=0x7f78f4009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 -- 172.21.15.123:0/3533454517 shutdown_connections 2023-07-21T19:08:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 --2- 172.21.15.123:0/3533454517 >> v2:172.21.15.145:3300/0 conn(0x7f7904158c70 0x7f79040cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 --2- 172.21.15.123:0/3533454517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79040c86b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 -- 172.21.15.123:0/3533454517 >> 172.21.15.123:0/3533454517 conn(0x7f7904060320 msgr2=0x7f79040606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 -- 172.21.15.123:0/3533454517 shutdown_connections 2023-07-21T19:08:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 -- 172.21.15.123:0/3533454517 wait complete. 2023-07-21T19:08:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 Processor -- start 2023-07-21T19:08:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.959+0000 7f790af01700 1 -- start start 2023-07-21T19:08:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790af01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79041fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790af01700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79040ce1e0 0x7f79040c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790af01700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7904158c70 0x7f790415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79041fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79041fe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51306/0 (socket says 172.21.15.123:51306) 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 -- 172.21.15.123:0/1052359890 learned_addr learned my addr 172.21.15.123:0/1052359890 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041fec80 con 0x7f79040caa70 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041ff020 con 0x7f79040ce1e0 2023-07-21T19:08:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79041ff300 con 0x7f7904158c70 2023-07-21T19:08:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7903fff700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79040ce1e0 0x7f79040c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f790949e700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7904158c70 0x7f790415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 -- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7904158c70 msgr2=0x7f790415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7904158c70 0x7f790415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 -- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79040ce1e0 msgr2=0x7f79040c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79040ce1e0 0x7f79040c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.963+0000 7f7908c9d700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009570 con 0x7f79040caa70 2023-07-21T19:08:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.967+0000 7f7903fff700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79040ce1e0 0x7f79040c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.967+0000 7f7908c9d700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79041fe740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79040ceeb0 tx=0x7f78f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:13.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.967+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4011a40 con 0x7f79040caa70 2023-07-21T19:08:13.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.967+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79041ff5e0 con 0x7f79040caa70 2023-07-21T19:08:13.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.967+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79041ffba0 con 0x7f79040caa70 2023-07-21T19:08:13.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.971+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4011bc0 con 0x7f79040caa70 2023-07-21T19:08:13.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.971+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4003e30 con 0x7f79040caa70 2023-07-21T19:08:13.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.971+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78f4022070 con 0x7f79040caa70 2023-07-21T19:08:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.971+0000 7f79017fa700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78f0066440 0x7f78f00688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.971+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f78f4085d10 con 0x7f79040caa70 2023-07-21T19:08:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.971+0000 7f7903fff700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78f0066440 0x7f78f00688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:13.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.975+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e4005310 con 0x7f79040caa70 2023-07-21T19:08:13.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.975+0000 7f7903fff700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78f0066440 0x7f78f00688f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7904162630 tx=0x7f78fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:13.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:13.983+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f78f4052f10 con 0x7f79040caa70 2023-07-21T19:08:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.003+0000 7f87ba74a700 1 Processor -- start 2023-07-21T19:08:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.003+0000 7f87ba74a700 1 -- start start 2023-07-21T19:08:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b9748700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f87b40ca510 0x7f87b40713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43444/0 (socket says 172.21.15.123:43444) 2023-07-21T19:08:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b9748700 1 -- 172.21.15.123:0/904424664 learned_addr learned my addr 172.21.15.123:0/904424664 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87ba74a700 1 --2- 172.21.15.123:0/904424664 >> v2:172.21.15.123:3300/0 conn(0x7f87b40cbc30 0x7f87b40aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b8f47700 1 --2- 172.21.15.123:0/904424664 >> v2:172.21.15.123:3300/0 conn(0x7f87b40cbc30 0x7f87b40aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b4089de0 con 0x7f87b40ca510 2023-07-21T19:08:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b40b0870 con 0x7f87b40b0450 2023-07-21T19:08:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b40cc0c0 con 0x7f87b40cbc30 2023-07-21T19:08:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342610287 0 0) 0x7f87b4089de0 con 0x7f87b40ca510 2023-07-21T19:08:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a40035b0 con 0x7f87b40ca510 2023-07-21T19:08:14.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 772976764 0 0) 0x7f87a40035b0 con 0x7f87b40ca510 2023-07-21T19:08:14.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 >> v2:172.21.15.123:3300/0 conn(0x7f87b40cbc30 msgr2=0x7f87b40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 --2- 172.21.15.123:0/904424664 >> v2:172.21.15.123:3300/0 conn(0x7f87b40cbc30 0x7f87b40aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 >> v1:172.21.15.145:6789/0 conn(0x7f87b40b0450 legacy=0x7f87b40cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40cc3a0 con 0x7f87b40ca510 2023-07-21T19:08:14.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f87ac001670 con 0x7f87b40ca510 2023-07-21T19:08:14.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 >> v1:172.21.15.123:6789/0 conn(0x7f87b40ca510 legacy=0x7f87b40713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87a4003d80 0x7f87a4004190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a40046d0 0x7f87a40116c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87a4004e90 0x7f87a4007340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40cc0c0 con 0x7f87a4004e90 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4007b80 con 0x7f87a40046d0 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4007d40 con 0x7f87a4003d80 2023-07-21T19:08:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b9f49700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87a4004e90 0x7f87a4007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.007+0000 7f87b8f47700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a40046d0 0x7f87a40116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9748700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87a4003d80 0x7f87a4004190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 -- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87a4003d80 msgr2=0x7f87a4004190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87a4003d80 0x7f87a4004190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 -- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a40046d0 msgr2=0x7f87a40116c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a40046d0 0x7f87a40116c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 -- 172.21.15.123:0/904424664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a40035b0 con 0x7f87a4004e90 2023-07-21T19:08:14.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b8f47700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a40046d0 0x7f87a40116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:14.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 -- 172.21.15.123:0/904424664 reap_dead start 2023-07-21T19:08:14.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f53883cd700 1 Processor -- start 2023-07-21T19:08:14.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b9f49700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87a4004e90 0x7f87a4007340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87a800c190 tx=0x7f87a4004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e993ca8626a75f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8001db0 con 0x7f87a4004e90 2023-07-21T19:08:14.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800ccf0 con 0x7f87a4004e90 2023-07-21T19:08:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87b3fff700 1 -- 172.21.15.123:0/904424664 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8003c60 con 0x7f87a4004e90 2023-07-21T19:08:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87a4004e90 msgr2=0x7f87a4007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87a4004e90 0x7f87a4007340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87a800c190 tx=0x7f87a4004e00 comp rx=0 tx=0).stop 2023-07-21T19:08:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f53883cd700 1 -- start start 2023-07-21T19:08:14.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f53883cd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5380157da0 0x7f538015b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f53883cd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f53800c8b10 0x7f538015be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f53883cd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800ca830 con 0x7f53800cd570 2023-07-21T19:08:14.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f53883cd700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800ca590 con 0x7f53800c8b10 2023-07-21T19:08:14.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f53883cd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800cacc0 con 0x7f5380157da0 2023-07-21T19:08:14.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f538696a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53800cd570 0x7f53800caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43452/0 (socket says 172.21.15.123:43452) 2023-07-21T19:08:14.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f538696a700 1 -- 172.21.15.123:0/2805199918 learned_addr learned my addr 172.21.15.123:0/2805199918 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:14.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f5386169700 1 --2- 172.21.15.123:0/2805199918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5380157da0 0x7f538015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 shutdown_connections 2023-07-21T19:08:14.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 --2- 172.21.15.123:0/904424664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87a4004e90 0x7f87a4007340 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 >> 172.21.15.123:0/904424664 conn(0x7f87b4060320 msgr2=0x7f87b40606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 shutdown_connections 2023-07-21T19:08:14.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.011+0000 7f87ba74a700 1 -- 172.21.15.123:0/904424664 wait complete. 2023-07-21T19:08:14.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f5386169700 1 -- 172.21.15.123:0/2805199918 >> v2:172.21.15.145:3300/0 conn(0x7f53800c8b10 msgr2=0x7f538015be50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T19:08:14.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f87ba74a700 1 Processor -- start 2023-07-21T19:08:14.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f5386169700 1 --2- 172.21.15.123:0/2805199918 >> v2:172.21.15.145:3300/0 conn(0x7f53800c8b10 0x7f538015be50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f5386169700 1 -- 172.21.15.123:0/2805199918 >> v1:172.21.15.123:6789/0 conn(0x7f53800cd570 legacy=0x7f53800caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f5386169700 1 -- 172.21.15.123:0/2805199918 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800ccb40 con 0x7f5380157da0 2023-07-21T19:08:14.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f5386169700 1 --2- 172.21.15.123:0/2805199918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5380157da0 0x7f538015b910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5370009850 tx=0x7f5370009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f9f825ac3ff8f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f87ba74a700 1 -- start start 2023-07-21T19:08:14.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f5385167700 1 -- 172.21.15.123:0/2805199918 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370004230 con 0x7f5380157da0 2023-07-21T19:08:14.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.015+0000 7f87ba74a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a4004e90 0x7f87b41fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 0x7f87b416b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b9748700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a4004e90 0x7f87b41fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b9748700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a4004e90 0x7f87b41fd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45814/0 (socket says 172.21.15.123:45814) 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 0x7f87b416b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 0x7f87b416b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51338/0 (socket says 172.21.15.123:51338) 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b9748700 1 -- 172.21.15.123:0/186404693 learned_addr learned my addr 172.21.15.123:0/186404693 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87b4201560 0x7f87b42019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40c6df0 con 0x7f87b416b400 2023-07-21T19:08:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b416bdb0 con 0x7f87a4004e90 2023-07-21T19:08:14.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b42024c0 con 0x7f87b4201560 2023-07-21T19:08:14.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b9f49700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87b4201560 0x7f87b42019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 -- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87b4201560 msgr2=0x7f87b42019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87b4201560 0x7f87b42019d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 -- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a4004e90 msgr2=0x7f87b41fd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a4004e90 0x7f87b41fd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f5385167700 1 -- 172.21.15.123:0/2805199918 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370004390 con 0x7f5380157da0 2023-07-21T19:08:14.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b4201f10 con 0x7f87b416b400 2023-07-21T19:08:14.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b8f47700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 0x7f87b416b870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009200 tx=0x7f87a00098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f53883cd700 1 -- 172.21.15.123:0/2805199918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5380157da0 msgr2=0x7f538015b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f53883cd700 1 --2- 172.21.15.123:0/2805199918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5380157da0 0x7f538015b910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5370009850 tx=0x7f5370009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0014070 con 0x7f87b416b400 2023-07-21T19:08:14.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a000f050 con 0x7f87b416b400 2023-07-21T19:08:14.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a00078c0 con 0x7f87b416b400 2023-07-21T19:08:14.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b42021e0 con 0x7f87b416b400 2023-07-21T19:08:14.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.019+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b4169390 con 0x7f87b416b400 2023-07-21T19:08:14.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 -- 172.21.15.123:0/2805199918 shutdown_connections 2023-07-21T19:08:14.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 --2- 172.21.15.123:0/2805199918 >> v2:172.21.15.145:3300/0 conn(0x7f53800c8b10 0x7f538015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 --2- 172.21.15.123:0/2805199918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5380157da0 0x7f538015b910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 -- 172.21.15.123:0/2805199918 >> 172.21.15.123:0/2805199918 conn(0x7f538006e960 msgr2=0x7f538006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 -- 172.21.15.123:0/2805199918 shutdown_connections 2023-07-21T19:08:14.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 -- 172.21.15.123:0/2805199918 wait complete. 2023-07-21T19:08:14.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8794005310 con 0x7f87b416b400 2023-07-21T19:08:14.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 Processor -- start 2023-07-21T19:08:14.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f53883cd700 1 -- start start 2023-07-21T19:08:14.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.023+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87a0007a20 con 0x7f87b416b400 2023-07-21T19:08:14.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53800c8b10 0x7f53801e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 0x7f5380152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5380157da0 0x7f53801e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53801e0dc0 con 0x7f5380157da0 2023-07-21T19:08:14.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c7040 con 0x7f53800c8b10 2023-07-21T19:08:14.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53801e0af0 con 0x7f53800cd570 2023-07-21T19:08:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f87b1ffb700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87a4078f60 0x7f87a407b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87a0083310 con 0x7f87b416b400 2023-07-21T19:08:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 0x7f5380152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 0x7f5380152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33796/0 (socket says 172.21.15.123:33796) 2023-07-21T19:08:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 -- 172.21.15.123:0/1229721154 learned_addr learned my addr 172.21.15.123:0/1229721154 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5386169700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53800c8b10 0x7f53801e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 -- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53800c8b10 msgr2=0x7f53801e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53800c8b10 0x7f53801e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 -- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5380157da0 msgr2=0x7f53801e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5380157da0 0x7f53801e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 -- 172.21.15.123:0/1229721154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700094b0 con 0x7f53800cd570 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5386169700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53800c8b10 0x7f53801e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5385968700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 0x7f5380152770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b520 tx=0x7f537c00b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c011830 con 0x7f53800cd570 2023-07-21T19:08:14.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.027+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53801e10f0 con 0x7f53800cd570 2023-07-21T19:08:14.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.031+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53801e16b0 con 0x7f53800cd570 2023-07-21T19:08:14.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.031+0000 7f87b9748700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87a4078f60 0x7f87a407b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.031+0000 7f87b9748700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87a4078f60 0x7f87a407b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f87ac001bc0 tx=0x7f87ac001b30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.031+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c011990 con 0x7f53800cd570 2023-07-21T19:08:14.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.031+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c011d40 con 0x7f53800cd570 2023-07-21T19:08:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.031+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f537c01a400 con 0x7f53800cd570 2023-07-21T19:08:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.035+0000 7f5376ffd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53640662f0 0x7f53640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.035+0000 7f5386169700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53640662f0 0x7f53640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.035+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f537c084000 con 0x7f53800cd570 2023-07-21T19:08:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.035+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5368005310 con 0x7f53800cd570 2023-07-21T19:08:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.035+0000 7f5386169700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53640662f0 0x7f53640687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5370009850 tx=0x7f5370010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.035+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f87a00505c0 con 0x7f87b416b400 2023-07-21T19:08:14.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.043+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f537c015020 con 0x7f53800cd570 2023-07-21T19:08:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.071+0000 7f87f11f7700 1 Processor -- start 2023-07-21T19:08:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.071+0000 7f87f11f7700 1 -- start start 2023-07-21T19:08:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87f11f7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87ec0c86b0 0x7f87ec0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87f11f7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87f11f7700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0cdd50 con 0x7f87ec0caa70 2023-07-21T19:08:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87f11f7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0cda20 con 0x7f87ec0c86b0 2023-07-21T19:08:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87f11f7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0cb380 con 0x7f87ec0ce1e0 2023-07-21T19:08:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87ec0c86b0 0x7f87ec0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87ec0c86b0 0x7f87ec0cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51354/0 (socket says 172.21.15.123:51354) 2023-07-21T19:08:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 -- 172.21.15.123:0/3254128816 learned_addr learned my addr 172.21.15.123:0/3254128816 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87eb59e700 1 --2- 172.21.15.123:0/3254128816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 -- 172.21.15.123:0/3254128816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 msgr2=0x7f87ec06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 --2- 172.21.15.123:0/3254128816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 -- 172.21.15.123:0/3254128816 >> v1:172.21.15.145:6789/0 conn(0x7f87ec0caa70 legacy=0x7f87ec158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.075+0000 7f87ea59c700 1 -- 172.21.15.123:0/3254128816 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0ca440 con 0x7f87ec0c86b0 2023-07-21T19:08:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87ea59c700 1 --2- 172.21.15.123:0/3254128816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec0cae40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d150 tx=0x7f87e400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4323dcc4c2848a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7fac73834700 1 Processor -- start 2023-07-21T19:08:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87e9d9b700 1 -- 172.21.15.123:0/3254128816 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4010070 con 0x7f87ec0c86b0 2023-07-21T19:08:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87e9d9b700 1 -- 172.21.15.123:0/3254128816 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400dd80 con 0x7f87ec0c86b0 2023-07-21T19:08:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87e9d9b700 1 -- 172.21.15.123:0/3254128816 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400b310 con 0x7f87ec0c86b0 2023-07-21T19:08:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 Processor -- start 2023-07-21T19:08:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7fac73834700 1 -- start start 2023-07-21T19:08:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 -- start start 2023-07-21T19:08:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 -- 172.21.15.123:0/3254128816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 msgr2=0x7f87ec0cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3254128816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec0cae40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d150 tx=0x7f87e400d460 comp rx=0 tx=0).stop 2023-07-21T19:08:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 -- 172.21.15.123:0/3254128816 shutdown_connections 2023-07-21T19:08:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3254128816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3254128816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec0cae40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 -- 172.21.15.123:0/3254128816 >> 172.21.15.123:0/3254128816 conn(0x7f87ec060320 msgr2=0x7f87ec0606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 -- 172.21.15.123:0/3254128816 shutdown_connections 2023-07-21T19:08:14.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7fac73834700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac6c160370 0x7fac6c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f59500c86b0 0x7f5950157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7fac73834700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c0ca8a0 con 0x7fac6c15ffa0 2023-07-21T19:08:14.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7fac73834700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c0cb3b0 con 0x7fac6c0cafb0 2023-07-21T19:08:14.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7fac73834700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c0cbcd0 con 0x7fac6c160370 2023-07-21T19:08:14.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59500ce1e0 0x7f59500caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59500cdd50 con 0x7f59500afbf0 2023-07-21T19:08:14.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500ca440 con 0x7f59500ce1e0 2023-07-21T19:08:14.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f5956e4a700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500ca720 con 0x7f59500c86b0 2023-07-21T19:08:14.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac715d0700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fac6c15ffa0 0x7fac6c06d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43454/0 (socket says 172.21.15.123:43454) 2023-07-21T19:08:14.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac715d0700 1 -- 172.21.15.123:0/1637865674 learned_addr learned my addr 172.21.15.123:0/1637865674 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:14.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac70dcf700 1 --2- 172.21.15.123:0/1637865674 >> v2:172.21.15.123:3300/0 conn(0x7fac6c160370 0x7fac6c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac6bfff700 1 -- 172.21.15.123:0/1637865674 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795219520 0 0) 0x7fac6c0cb3b0 con 0x7fac6c0cafb0 2023-07-21T19:08:14.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac6bfff700 1 -- 172.21.15.123:0/1637865674 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac540035d0 con 0x7fac6c0cafb0 2023-07-21T19:08:14.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f5954be6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f59500afbf0 0x7f5950158c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43464/0 (socket says 172.21.15.123:43464) 2023-07-21T19:08:14.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f5954be6700 1 -- 172.21.15.123:0/516999909 learned_addr learned my addr 172.21.15.123:0/516999909 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:14.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f59553e7700 1 --2- 172.21.15.123:0/516999909 >> v2:172.21.15.123:3300/0 conn(0x7f59500ce1e0 0x7f59500caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac70dcf700 1 -- 172.21.15.123:0/1637865674 >> v1:172.21.15.145:6789/0 conn(0x7fac6c0cafb0 legacy=0x7fac6c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac70dcf700 1 -- 172.21.15.123:0/1637865674 >> v1:172.21.15.123:6789/0 conn(0x7fac6c15ffa0 legacy=0x7fac6c06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac70dcf700 1 -- 172.21.15.123:0/1637865674 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0cbf70 con 0x7fac6c160370 2023-07-21T19:08:14.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f59553e7700 1 -- 172.21.15.123:0/516999909 >> v2:172.21.15.145:3300/0 conn(0x7f59500c86b0 msgr2=0x7f5950157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f59553e7700 1 --2- 172.21.15.123:0/516999909 >> v2:172.21.15.145:3300/0 conn(0x7f59500c86b0 0x7f5950157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f59553e7700 1 -- 172.21.15.123:0/516999909 >> v1:172.21.15.123:6789/0 conn(0x7f59500afbf0 legacy=0x7f5950158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f59553e7700 1 -- 172.21.15.123:0/516999909 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500ca0f0 con 0x7f59500ce1e0 2023-07-21T19:08:14.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.079+0000 7f87f11f7700 1 -- 172.21.15.123:0/3254128816 wait complete. 2023-07-21T19:08:14.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f87f11f7700 1 Processor -- start 2023-07-21T19:08:14.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac70dcf700 1 --2- 172.21.15.123:0/1637865674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c0caa70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009d90 tx=0x7fac5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d182620dc7e0e971 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f59553e7700 1 --2- 172.21.15.123:0/516999909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500ce1e0 0x7f59500caa70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59500ced10 tx=0x7f594800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8a7dfffc85e1c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac6bfff700 1 -- 172.21.15.123:0/1637865674 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c00e070 con 0x7fac6c160370 2023-07-21T19:08:14.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac6bfff700 1 -- 172.21.15.123:0/1637865674 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c00bb20 con 0x7fac6c160370 2023-07-21T19:08:14.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac6bfff700 1 -- 172.21.15.123:0/1637865674 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c012430 con 0x7fac6c160370 2023-07-21T19:08:14.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f594f7fe700 1 -- 172.21.15.123:0/516999909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594800e070 con 0x7f59500ce1e0 2023-07-21T19:08:14.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f594f7fe700 1 -- 172.21.15.123:0/516999909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800bbd0 con 0x7f59500ce1e0 2023-07-21T19:08:14.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f594f7fe700 1 -- 172.21.15.123:0/516999909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948012430 con 0x7f59500ce1e0 2023-07-21T19:08:14.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f87f11f7700 1 -- start start 2023-07-21T19:08:14.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac73834700 1 -- 172.21.15.123:0/1637865674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 msgr2=0x7fac6c0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac73834700 1 --2- 172.21.15.123:0/1637865674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c0caa70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009d90 tx=0x7fac5c00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:14.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f9d5d0c6700 1 Processor -- start 2023-07-21T19:08:14.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac73834700 1 -- 172.21.15.123:0/1637865674 shutdown_connections 2023-07-21T19:08:14.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac73834700 1 --2- 172.21.15.123:0/1637865674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c0caa70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7fac73834700 1 -- 172.21.15.123:0/1637865674 >> 172.21.15.123:0/1637865674 conn(0x7fac6c06e960 msgr2=0x7fac6c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 -- 172.21.15.123:0/1637865674 shutdown_connections 2023-07-21T19:08:14.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f5956e4a700 1 -- 172.21.15.123:0/516999909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500ce1e0 msgr2=0x7f59500caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f5956e4a700 1 --2- 172.21.15.123:0/516999909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500ce1e0 0x7f59500caa70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59500ced10 tx=0x7f594800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:14.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87f11f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 -- 172.21.15.123:0/1637865674 wait complete. 2023-07-21T19:08:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.083+0000 7f9d5d0c6700 1 -- start start 2023-07-21T19:08:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f5956e4a700 1 -- 172.21.15.123:0/516999909 shutdown_connections 2023-07-21T19:08:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f5956e4a700 1 --2- 172.21.15.123:0/516999909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500ce1e0 0x7f59500caa70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f5956e4a700 1 --2- 172.21.15.123:0/516999909 >> v2:172.21.15.145:3300/0 conn(0x7f59500c86b0 0x7f5950157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f5956e4a700 1 -- 172.21.15.123:0/516999909 >> 172.21.15.123:0/516999909 conn(0x7f5950060320 msgr2=0x7f59500606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ead9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ead9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec15a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51392/0 (socket says 172.21.15.123:51392) 2023-07-21T19:08:14.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ead9d700 1 -- 172.21.15.123:0/3077299871 learned_addr learned my addr 172.21.15.123:0/3077299871 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87ec0caa70 0x7f87ec1f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1f7660 con 0x7f87ec0c86b0 2023-07-21T19:08:14.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1f67b0 con 0x7f87ec0caa70 2023-07-21T19:08:14.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1f6a50 con 0x7f87ec0ce1e0 2023-07-21T19:08:14.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6e18df700 1 Processor -- start 2023-07-21T19:08:14.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87ec0caa70 0x7f87ec1f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6e18df700 1 -- start start 2023-07-21T19:08:14.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5d0c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d5815bff0 0x7f9d580ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5d0c6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9d580cd070 0x7f9d580ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5d0c6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580cd4c0 con 0x7f9d580ceff0 2023-07-21T19:08:14.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5d0c6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d580af0a0 con 0x7f9d580cd070 2023-07-21T19:08:14.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5d0c6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580cf470 con 0x7f9d5815bff0 2023-07-21T19:08:14.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87eb59e700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 -- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 msgr2=0x7f87ec154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 -- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 msgr2=0x7f87ec15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 Processor -- start 2023-07-21T19:08:14.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e400bd40 con 0x7f87ec0caa70 2023-07-21T19:08:14.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 -- start start 2023-07-21T19:08:14.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9d580cd070 0x7f9d580ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9d580cd070 0x7f9d580ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45858/0 (socket says 172.21.15.123:45858) 2023-07-21T19:08:14.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 -- 172.21.15.123:0/1362987684 learned_addr learned my addr 172.21.15.123:0/1362987684 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ead9d700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:14.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d56d9d700 1 --2- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d5815bff0 0x7f9d580ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f5956e4a700 1 -- 172.21.15.123:0/516999909 shutdown_connections 2023-07-21T19:08:14.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f5956e4a700 1 -- 172.21.15.123:0/516999909 wait complete. 2023-07-21T19:08:14.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f87ea59c700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87ec0caa70 0x7f87ec1f6270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87e4016000 tx=0x7f87e4004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 -- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d5815bff0 msgr2=0x7f9d580ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 --2- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d5815bff0 0x7f9d580ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 -- 172.21.15.123:0/1362987684 >> v1:172.21.15.145:6789/0 conn(0x7f9d580ceff0 legacy=0x7f9d580d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7f9d5659c700 1 -- 172.21.15.123:0/1362987684 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580cf720 con 0x7f9d580cd070 2023-07-21T19:08:14.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac6c0cafb0 0x7fac6c162730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac6c15ffa0 0x7fac6c162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c1631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1614b0 con 0x7fac6c160370 2023-07-21T19:08:14.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1622a0 con 0x7fac6c0cafb0 2023-07-21T19:08:14.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fac73834700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c161690 con 0x7fac6c15ffa0 2023-07-21T19:08:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6e18df700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0caa70 0x7fa6dc0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6e18df700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0cdd50 con 0x7fa6dc158c70 2023-07-21T19:08:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6e18df700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0cda20 con 0x7fa6dc0ce1e0 2023-07-21T19:08:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6e18df700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0ca440 con 0x7fa6dc0caa70 2023-07-21T19:08:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4009800 con 0x7f87ec0caa70 2023-07-21T19:08:14.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec1f6d30 con 0x7f87ec0caa70 2023-07-21T19:08:14.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec1f72f0 con 0x7f87ec0caa70 2023-07-21T19:08:14.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac715d0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac6c0cafb0 0x7fac6c162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.087+0000 7fa6da7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa6dc158c70 0x7fa6dc0cae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43466/0 (socket says 172.21.15.123:43466) 2023-07-21T19:08:14.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6da7fc700 1 -- 172.21.15.123:0/341514679 learned_addr learned my addr 172.21.15.123:0/341514679 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:14.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5659c700 1 --2- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d580cd070 0x7f9d580ceab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009910 tx=0x7f9d48009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0e7f626562a8ab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac715d0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac6c0cafb0 0x7fac6c162730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45868/0 (socket says 172.21.15.123:45868) 2023-07-21T19:08:14.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac715d0700 1 -- 172.21.15.123:0/2154563288 learned_addr learned my addr 172.21.15.123:0/2154563288 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e4009980 con 0x7f87ec0caa70 2023-07-21T19:08:14.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4009d30 con 0x7f87ec0caa70 2023-07-21T19:08:14.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c1631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac70dcf700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac6c15ffa0 0x7fac6c162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012976158 0 0) 0x7fa6dc0cdd50 con 0x7fa6dc158c70 2023-07-21T19:08:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c40035d0 con 0x7fa6dc158c70 2023-07-21T19:08:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6daffd700 1 --2- 172.21.15.123:0/341514679 >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0caa70 0x7fa6dc0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110598880 0 0) 0x7fa6c40035d0 con 0x7fa6dc158c70 2023-07-21T19:08:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0caa70 msgr2=0x7fa6dc0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 --2- 172.21.15.123:0/341514679 >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0caa70 0x7fa6dc0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 >> v1:172.21.15.145:6789/0 conn(0x7fa6dc0ce1e0 legacy=0x7fa6dc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0ca720 con 0x7fa6dc158c70 2023-07-21T19:08:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7fa6d40019f0 con 0x7fa6dc158c70 2023-07-21T19:08:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d55d9b700 1 -- 172.21.15.123:0/1362987684 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011830 con 0x7f9d580cd070 2023-07-21T19:08:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d55d9b700 1 -- 172.21.15.123:0/1362987684 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48011990 con 0x7f9d580cd070 2023-07-21T19:08:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d55d9b700 1 -- 172.21.15.123:0/1362987684 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011d40 con 0x7f9d580cd070 2023-07-21T19:08:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 >> v1:172.21.15.123:6789/0 conn(0x7fa6dc158c70 legacy=0x7fa6dc0cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6c4003a20 0x7fa6c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4004870 0x7fa6c4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6c4005370 0x7fa6c4005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0ca440 con 0x7fa6c4005370 2023-07-21T19:08:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c40062e0 con 0x7fa6c4004870 2023-07-21T19:08:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c40064a0 con 0x7fa6c4003a20 2023-07-21T19:08:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 -- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac6c15ffa0 msgr2=0x7fac6c162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac6c15ffa0 0x7fac6c162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 -- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac6c0cafb0 msgr2=0x7fac6c162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac6c0cafb0 0x7fac6c162730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 -- 172.21.15.123:0/2154563288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c009a70 con 0x7fac6c160370 2023-07-21T19:08:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f5956e4a700 1 Processor -- start 2023-07-21T19:08:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc005310 con 0x7f87ec0caa70 2023-07-21T19:08:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87e401b040 con 0x7f87ec0caa70 2023-07-21T19:08:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac71dd1700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c1631b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c310 tx=0x7fac6000c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600052d0 con 0x7fac6c160370 2023-07-21T19:08:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac73834700 1 -- 172.21.15.123:0/2154563288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c161970 con 0x7fac6c160370 2023-07-21T19:08:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac73834700 1 -- 172.21.15.123:0/2154563288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c161f30 con 0x7fac6c160370 2023-07-21T19:08:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac60005430 con 0x7fac6c160370 2023-07-21T19:08:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600055a0 con 0x7fac6c160370 2023-07-21T19:08:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6c4005370 0x7fa6c4005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6daffd700 1 --2- 172.21.15.123:0/341514679 >> v2:172.21.15.145:3300/0 conn(0x7fa6dc0caa70 0x7fa6dc0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 -- 172.21.15.123:0/341514679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6c4003a20 msgr2=0x7fa6c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6c4003a20 0x7fa6c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 -- 172.21.15.123:0/341514679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4004870 msgr2=0x7fa6c4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4004870 0x7fa6c4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 -- 172.21.15.123:0/341514679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0ca720 con 0x7fa6c4005370 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 -- 172.21.15.123:0/341514679 reap_dead start 2023-07-21T19:08:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6c4005370 0x7fa6c4005a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc003f10 tx=0x7fa6c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2196cffde4d43d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0039b0 con 0x7fa6c4005370 2023-07-21T19:08:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc005240 con 0x7fa6c4005370 2023-07-21T19:08:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6d9ffb700 1 -- 172.21.15.123:0/341514679 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc006880 con 0x7fa6c4005370 2023-07-21T19:08:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f5956e4a700 1 -- start start 2023-07-21T19:08:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f5956e4a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 0x7f59500cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5956e4a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 0x7f59501f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5956e4a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500cc4e0 0x7f59501f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 0x7f59500cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 0x7f59500cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33852/0 (socket says 172.21.15.123:33852) 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f594ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 0x7f59501f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f594ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 0x7f59501f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45898/0 (socket says 172.21.15.123:45898) 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 -- 172.21.15.123:0/2703026164 learned_addr learned my addr 172.21.15.123:0/2703026164 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c2c90 con 0x7f59500cc4e0 2023-07-21T19:08:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c2a40 con 0x7f59500ce1e0 2023-07-21T19:08:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c2110 con 0x7f59500afbf0 2023-07-21T19:08:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d580cd070 msgr2=0x7f9d580ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d580cd070 0x7f9d580ceab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009910 tx=0x7f9d48009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/1362987684 shutdown_connections 2023-07-21T19:08:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d580cd070 0x7f9d580ceab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/1362987684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d5815bff0 0x7f9d580ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/1362987684 >> 172.21.15.123:0/1362987684 conn(0x7f9d58060c40 msgr2=0x7f9d5809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/1362987684 shutdown_connections 2023-07-21T19:08:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.091+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/1362987684 wait complete. 2023-07-21T19:08:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 -- 172.21.15.123:0/341514679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6c4005370 msgr2=0x7fa6c4005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6c4005370 0x7fa6c4005a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc003f10 tx=0x7fa6c40058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f87d37fe700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87d80662f0 0x7f87d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87e4084fe0 con 0x7f87ec0caa70 2023-07-21T19:08:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 -- 172.21.15.123:0/341514679 shutdown_connections 2023-07-21T19:08:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 --2- 172.21.15.123:0/341514679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6c4005370 0x7fa6c4005a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 -- 172.21.15.123:0/341514679 >> 172.21.15.123:0/341514679 conn(0x7fa6dc060320 msgr2=0x7fa6dc0606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 -- 172.21.15.123:0/341514679 shutdown_connections 2023-07-21T19:08:14.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f9d5d0c6700 1 Processor -- start 2023-07-21T19:08:14.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 -- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 msgr2=0x7f59501f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 0x7f59501f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 -- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500cc4e0 msgr2=0x7f59501f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500cc4e0 0x7f59501f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948009a70 con 0x7f59500afbf0 2023-07-21T19:08:14.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f594ffff700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 0x7f59501f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:14.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f9d5d0c6700 1 -- start start 2023-07-21T19:08:14.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fa6e18df700 1 -- 172.21.15.123:0/341514679 wait complete. 2023-07-21T19:08:14.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f87ead9d700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87d80662f0 0x7f87d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f5954be6700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 0x7f59500cacb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f594400c730 tx=0x7f594400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944005d90 con 0x7f59500afbf0 2023-07-21T19:08:14.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59440070d0 con 0x7f59500afbf0 2023-07-21T19:08:14.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944007440 con 0x7f59500afbf0 2023-07-21T19:08:14.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7f87ead9d700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87d80662f0 0x7f87d80687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0c14b0 tx=0x7f87e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5d0c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 0x7f9d580b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59500c23f0 con 0x7f59500afbf0 2023-07-21T19:08:14.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5950141080 con 0x7f59500afbf0 2023-07-21T19:08:14.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.095+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac600038a0 con 0x7fac6c160370 2023-07-21T19:08:14.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c0c12e0 con 0x7fac6c160370 2023-07-21T19:08:14.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5d0c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d580ceff0 0x7f9d58155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 0x7f9d580b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 0x7f9d580b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51430/0 (socket says 172.21.15.123:51430) 2023-07-21T19:08:14.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6e18df700 1 Processor -- start 2023-07-21T19:08:14.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5d0c6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d5815bff0 0x7f9d580b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fac69ffb700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fac580663c0 0x7fac58068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5659c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d580ceff0 0x7f9d58155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5659c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d580ceff0 0x7f9d58155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33854/0 (socket says 172.21.15.123:33854) 2023-07-21T19:08:14.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac60083200 con 0x7fac6c160370 2023-07-21T19:08:14.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 -- 172.21.15.123:0/3447723778 learned_addr learned my addr 172.21.15.123:0/3447723778 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6e18df700 1 -- start start 2023-07-21T19:08:14.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580b6c00 con 0x7f9d580cd070 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580cc520 con 0x7f9d5815bff0 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580b6e30 con 0x7f9d580ceff0 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d5759e700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d5815bff0 0x7f9d580b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 -- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d580ceff0 msgr2=0x7f9d58155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d580ceff0 0x7f9d58155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 -- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d5815bff0 msgr2=0x7f9d580b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d5815bff0 0x7f9d580b7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009570 con 0x7f9d580cd070 2023-07-21T19:08:14.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f9d56d9d700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 0x7f9d580b5310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000efc0 tx=0x7f9d5000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6e18df700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4005370 0x7fa6dc0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6e18df700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0c6fa0 0x7fa6dc146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6e18df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 0x7fa6dc1f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59440075a0 con 0x7f59500afbf0 2023-07-21T19:08:14.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595004e500 con 0x7f59500afbf0 2023-07-21T19:08:14.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fac715d0700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fac580663c0 0x7fac58068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6daffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4005370 0x7fa6dc0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.099+0000 7fa6daffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4005370 0x7fa6dc0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45920/0 (socket says 172.21.15.123:45920) 2023-07-21T19:08:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6da7fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0c6fa0 0x7fa6dc146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6da7fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0c6fa0 0x7fa6dc146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33868/0 (socket says 172.21.15.123:33868) 2023-07-21T19:08:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 0x7fa6dc1f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 0x7fa6dc1f0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51440/0 (socket says 172.21.15.123:51440) 2023-07-21T19:08:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6daffd700 1 -- 172.21.15.123:0/864786462 learned_addr learned my addr 172.21.15.123:0/864786462 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7f594d7fa700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5934066320 0x7f59340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c2bc0 con 0x7fa6dc146b70 2023-07-21T19:08:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc1470d0 con 0x7fa6c4005370 2023-07-21T19:08:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5944083380 con 0x7f59500afbf0 2023-07-21T19:08:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc1473b0 con 0x7fa6dc0c6fa0 2023-07-21T19:08:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fac715d0700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fac580663c0 0x7fac58068870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac64004ef0 tx=0x7fac64001080 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f87e4052160 con 0x7f87ec0caa70 2023-07-21T19:08:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7f594ffff700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5934066320 0x7f59340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 -- 172.21.15.123:0/864786462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0c6fa0 msgr2=0x7fa6dc146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0c6fa0 0x7fa6dc146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 -- 172.21.15.123:0/864786462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4005370 msgr2=0x7fa6dc0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4005370 0x7fa6dc0c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0c2dd0 con 0x7fa6dc146b70 2023-07-21T19:08:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7fa6db7fe700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 0x7fa6dc1f0a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc15b720 tx=0x7fa6cc0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.103+0000 7f594ffff700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5934066320 0x7f59340687d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f595006d030 tx=0x7f593c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000cb50 con 0x7f9d580cd070 2023-07-21T19:08:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fac60050420 con 0x7fac6c160370 2023-07-21T19:08:14.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d580b7110 con 0x7f9d580cd070 2023-07-21T19:08:14.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580b76d0 con 0x7f9d580cd070 2023-07-21T19:08:14.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc020070 con 0x7fa6dc146b70 2023-07-21T19:08:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5000f040 con 0x7f9d580cd070 2023-07-21T19:08:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50014480 con 0x7f9d580cd070 2023-07-21T19:08:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc007020 con 0x7fa6dc146b70 2023-07-21T19:08:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc0c30b0 con 0x7fa6dc146b70 2023-07-21T19:08:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.107+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d38005310 con 0x7f9d580cd070 2023-07-21T19:08:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc0c58e0 con 0x7fa6dc146b70 2023-07-21T19:08:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc0c5ad0 con 0x7fa6dc146b70 2023-07-21T19:08:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f59440505b0 con 0x7f59500afbf0 2023-07-21T19:08:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0073f0 con 0x7fa6dc146b70 2023-07-21T19:08:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6cc0075d0 con 0x7fa6dc146b70 2023-07-21T19:08:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d500145e0 con 0x7f9d580cd070 2023-07-21T19:08:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7f9d3f7fe700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9d440662f0 0x7f9d440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.111+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d50084860 con 0x7f9d580cd070 2023-07-21T19:08:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.115+0000 7fa6c3fff700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c8066370 0x7fa6c8068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.115+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6cc0881f0 con 0x7fa6dc146b70 2023-07-21T19:08:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.115+0000 7f9d5659c700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9d440662f0 0x7f9d440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.115+0000 7f9d5659c700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9d440662f0 0x7f9d440687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d48014040 tx=0x7f9d48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.119+0000 7fa6daffd700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c8066370 0x7fa6c8068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.119+0000 7fa6daffd700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c8066370 0x7fa6c8068820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a9c0 tx=0x7fa6d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.119+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9d50051860 con 0x7f9d580cd070 2023-07-21T19:08:14.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.131+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa6cc0553f0 con 0x7fa6dc146b70 2023-07-21T19:08:14.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.307+0000 7f790af01700 1 -- 172.21.15.123:0/1052359890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78e40055c0 con 0x7f79040caa70 2023-07-21T19:08:14.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.307+0000 7f79017fa700 1 -- 172.21.15.123:0/1052359890 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78f4056530 con 0x7f79040caa70 2023-07-21T19:08:14.325 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:14.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 -- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78f0066440 msgr2=0x7f78f00688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78f0066440 0x7f78f00688f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7904162630 tx=0x7f78fc009040 comp rx=0 tx=0).stop 2023-07-21T19:08:14.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 -- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 msgr2=0x7f79041fe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79041fe740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79040ceeb0 tx=0x7f78f4004770 comp rx=0 tx=0).stop 2023-07-21T19:08:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 -- 172.21.15.123:0/1052359890 shutdown_connections 2023-07-21T19:08:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78f0066440 0x7f78f00688f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79040ce1e0 0x7f79040c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7904158c70 0x7f790415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 --2- 172.21.15.123:0/1052359890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79040caa70 0x7f79041fe740 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.311+0000 7f78eaffd700 1 -- 172.21.15.123:0/1052359890 >> 172.21.15.123:0/1052359890 conn(0x7f7904060320 msgr2=0x7f790406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.315+0000 7f78eaffd700 1 -- 172.21.15.123:0/1052359890 shutdown_connections 2023-07-21T19:08:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.315+0000 7f78eaffd700 1 -- 172.21.15.123:0/1052359890 wait complete. 2023-07-21T19:08:14.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-07-21T19:08:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.347+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87940055c0 con 0x7f87b416b400 2023-07-21T19:08:14.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.347+0000 7f87b1ffb700 1 -- 172.21.15.123:0/186404693 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87a0053be0 con 0x7f87b416b400 2023-07-21T19:08:14.362 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87a4078f60 msgr2=0x7f87a407b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87a4078f60 0x7f87a407b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f87ac001bc0 tx=0x7f87ac001b30 comp rx=0 tx=0).stop 2023-07-21T19:08:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 msgr2=0x7f87b416b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 0x7f87b416b870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009200 tx=0x7f87a00098d0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 shutdown_connections 2023-07-21T19:08:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87a4078f60 0x7f87a407b410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87b4201560 0x7f87b42019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b416b400 0x7f87b416b870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 --2- 172.21.15.123:0/186404693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87a4004e90 0x7f87b41fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 >> 172.21.15.123:0/186404693 conn(0x7f87b4060320 msgr2=0x7f87b40c3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 shutdown_connections 2023-07-21T19:08:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.351+0000 7f87ba74a700 1 -- 172.21.15.123:0/186404693 wait complete. 2023-07-21T19:08:14.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-07-21T19:08:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.371+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53680055c0 con 0x7f53800cd570 2023-07-21T19:08:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f5376ffd700 1 -- 172.21.15.123:0/1229721154 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f537c051180 con 0x7f53800cd570 2023-07-21T19:08:14.387 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:14.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53640662f0 msgr2=0x7f53640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53640662f0 0x7f53640687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5370009850 tx=0x7f5370010000 comp rx=0 tx=0).stop 2023-07-21T19:08:14.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 msgr2=0x7f5380152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 0x7f5380152770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b520 tx=0x7f537c00b830 comp rx=0 tx=0).stop 2023-07-21T19:08:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 shutdown_connections 2023-07-21T19:08:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53640662f0 0x7f53640687a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5380157da0 0x7f53801e05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53800cd570 0x7f5380152770 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b520 tx=0x7f537c00b830 comp rx=0 tx=0).stop 2023-07-21T19:08:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 --2- 172.21.15.123:0/1229721154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53800c8b10 0x7f53801e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 >> 172.21.15.123:0/1229721154 conn(0x7f538006e960 msgr2=0x7f5380153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 shutdown_connections 2023-07-21T19:08:14.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.375+0000 7f53883cd700 1 -- 172.21.15.123:0/1229721154 wait complete. 2023-07-21T19:08:14.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-07-21T19:08:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.407+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f59500c6320 con 0x7f59500afbf0 2023-07-21T19:08:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.407+0000 7f594d7fa700 1 -- 172.21.15.123:0/2703026164 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5944017030 con 0x7f59500afbf0 2023-07-21T19:08:14.421 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5934066320 msgr2=0x7f59340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5934066320 0x7f59340687d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f595006d030 tx=0x7f593c0091c0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 msgr2=0x7f59500cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 0x7f59500cacb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f594400c730 tx=0x7f594400ca40 comp rx=0 tx=0).stop 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 shutdown_connections 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5934066320 0x7f59340687d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59500ce1e0 0x7f59501f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59500cc4e0 0x7f59501f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 --2- 172.21.15.123:0/2703026164 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f59500afbf0 0x7f59500cacb0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f594400c730 tx=0x7f594400ca40 comp rx=0 tx=0).stop 2023-07-21T19:08:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 >> 172.21.15.123:0/2703026164 conn(0x7f5950060320 msgr2=0x7f595006d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 shutdown_connections 2023-07-21T19:08:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.411+0000 7f5956e4a700 1 -- 172.21.15.123:0/2703026164 wait complete. 2023-07-21T19:08:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.415+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f87cc0055c0 con 0x7f87ec0caa70 2023-07-21T19:08:14.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.415+0000 7f87d37fe700 1 -- 172.21.15.123:0/3077299871 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87e4055780 con 0x7f87ec0caa70 2023-07-21T19:08:14.428 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.415+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa6dc04e500 con 0x7fa6dc146b70 2023-07-21T19:08:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.415+0000 7fa6c3fff700 1 -- 172.21.15.123:0/864786462 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6cc058a10 con 0x7fa6dc146b70 2023-07-21T19:08:14.430 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.415+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fac6c162410 con 0x7fac6c160370 2023-07-21T19:08:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fac69ffb700 1 -- 172.21.15.123:0/2154563288 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac60017030 con 0x7fac6c160370 2023-07-21T19:08:14.432 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87d80662f0 msgr2=0x7f87d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87d80662f0 0x7f87d80687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0c14b0 tx=0x7f87e0009040 comp rx=0 tx=0).stop 2023-07-21T19:08:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87ec0caa70 msgr2=0x7f87ec1f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87ec0caa70 0x7f87ec1f6270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87e4016000 tx=0x7f87e4004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 shutdown_connections 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f87d80662f0 0x7f87d80687a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87ec0caa70 0x7f87ec1f6270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87ec0ce1e0 0x7f87ec154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 --2- 172.21.15.123:0/3077299871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec0c86b0 0x7f87ec15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 >> 172.21.15.123:0/3077299871 conn(0x7f87ec060320 msgr2=0x7f87ec06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 shutdown_connections 2023-07-21T19:08:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7f87f11f7700 1 -- 172.21.15.123:0/3077299871 wait complete. 2023-07-21T19:08:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c8066370 msgr2=0x7fa6c8068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c8066370 0x7fa6c8068820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a9c0 tx=0x7fa6d0008040 comp rx=0 tx=0).stop 2023-07-21T19:08:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 msgr2=0x7fa6dc1f0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 0x7fa6dc1f0a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc15b720 tx=0x7fa6cc0037a0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 shutdown_connections 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6c8066370 0x7fa6c8068820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6dc146b70 0x7fa6dc1f0a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6dc0c6fa0 0x7fa6dc146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 --2- 172.21.15.123:0/864786462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6c4005370 0x7fa6dc0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.419+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 >> 172.21.15.123:0/864786462 conn(0x7fa6dc060320 msgr2=0x7fa6dc0cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 shutdown_connections 2023-07-21T19:08:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fa6e18df700 1 -- 172.21.15.123:0/864786462 wait complete. 2023-07-21T19:08:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fac580663c0 msgr2=0x7fac58068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fac580663c0 0x7fac58068870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac64004ef0 tx=0x7fac64001080 comp rx=0 tx=0).stop 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 msgr2=0x7fac6c1631b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c1631b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c310 tx=0x7fac6000c620 comp rx=0 tx=0).stop 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 shutdown_connections 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fac580663c0 0x7fac58068870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac6c160370 0x7fac6c1631b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac6c15ffa0 0x7fac6c162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 --2- 172.21.15.123:0/2154563288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac6c0cafb0 0x7fac6c162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 >> 172.21.15.123:0/2154563288 conn(0x7fac6c06e960 msgr2=0x7fac6c0ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 shutdown_connections 2023-07-21T19:08:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.423+0000 7fac537fe700 1 -- 172.21.15.123:0/2154563288 wait complete. 2023-07-21T19:08:14.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-07-21T19:08:14.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-07-21T19:08:14.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-07-21T19:08:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.443+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d380055c0 con 0x7f9d580cd070 2023-07-21T19:08:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.443+0000 7f9d3f7fe700 1 -- 172.21.15.123:0/3447723778 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d50054e80 con 0x7f9d580cd070 2023-07-21T19:08:14.458 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-07-21T19:08:14.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-07-21T19:08:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9d440662f0 msgr2=0x7f9d440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9d440662f0 0x7f9d440687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d48014040 tx=0x7f9d48008030 comp rx=0 tx=0).stop 2023-07-21T19:08:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 msgr2=0x7f9d580b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 0x7f9d580b5310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000efc0 tx=0x7f9d5000c0c0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 shutdown_connections 2023-07-21T19:08:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9d440662f0 0x7f9d440687a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d5815bff0 0x7f9d580b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d580ceff0 0x7f9d58155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 --2- 172.21.15.123:0/3447723778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d580cd070 0x7f9d580b5310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 >> 172.21.15.123:0/3447723778 conn(0x7f9d58060c40 msgr2=0x7f9d580d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 shutdown_connections 2023-07-21T19:08:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:14.447+0000 7f9d5d0c6700 1 -- 172.21.15.123:0/3447723778 wait complete. 2023-07-21T19:08:14.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-07-21T19:08:15.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T19:08:15.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T19:08:15.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T19:08:15.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T19:08:15.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T19:08:15.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T19:08:15.462 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T19:08:15.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T19:08:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.563+0000 7f9b50d95700 1 Processor -- start 2023-07-21T19:08:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.563+0000 7f9b50d95700 1 -- start start 2023-07-21T19:08:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b50d95700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b50d95700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b4c0ce1e0 0x7f9b4c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b50d95700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0cdd50 con 0x7f9b4c0caa70 2023-07-21T19:08:15.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b50d95700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c8b00 con 0x7f9b4c0ce1e0 2023-07-21T19:08:15.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b50d95700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0cda20 con 0x7f9b4c0c86b0 2023-07-21T19:08:15.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b4c0ce1e0 0x7f9b4c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b4c0ce1e0 0x7f9b4c06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51450/0 (socket says 172.21.15.123:51450) 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 -- 172.21.15.123:0/2645123813 learned_addr learned my addr 172.21.15.123:0/2645123813 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4affd700 1 --2- 172.21.15.123:0/2645123813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 -- 172.21.15.123:0/2645123813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 msgr2=0x7f9b4c0cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 --2- 172.21.15.123:0/2645123813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c0cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 -- 172.21.15.123:0/2645123813 >> v1:172.21.15.145:6789/0 conn(0x7f9b4c0caa70 legacy=0x7f9b4c158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 -- 172.21.15.123:0/2645123813 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0cb380 con 0x7f9b4c0ce1e0 2023-07-21T19:08:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4bfff700 1 --2- 172.21.15.123:0/2645123813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0ce1e0 0x7f9b4c06bc60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9b40008910 tx=0x7f9b4000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f9fe4b6767a0b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4a7fc700 1 -- 172.21.15.123:0/2645123813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40010070 con 0x7f9b4c0ce1e0 2023-07-21T19:08:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.567+0000 7f9b4a7fc700 1 -- 172.21.15.123:0/2645123813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4000d9d0 con 0x7f9b4c0ce1e0 2023-07-21T19:08:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 -- 172.21.15.123:0/2645123813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0ce1e0 msgr2=0x7f9b4c06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 --2- 172.21.15.123:0/2645123813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0ce1e0 0x7f9b4c06bc60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9b40008910 tx=0x7f9b4000d330 comp rx=0 tx=0).stop 2023-07-21T19:08:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 -- 172.21.15.123:0/2645123813 shutdown_connections 2023-07-21T19:08:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 --2- 172.21.15.123:0/2645123813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0ce1e0 0x7f9b4c06bc60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 --2- 172.21.15.123:0/2645123813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c0cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 -- 172.21.15.123:0/2645123813 >> 172.21.15.123:0/2645123813 conn(0x7f9b4c060320 msgr2=0x7f9b4c0606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 -- 172.21.15.123:0/2645123813 shutdown_connections 2023-07-21T19:08:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 -- 172.21.15.123:0/2645123813 wait complete. 2023-07-21T19:08:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.571+0000 7f9b50d95700 1 Processor -- start 2023-07-21T19:08:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 -- start start 2023-07-21T19:08:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c1f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 0x7f9b4c0c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b4c0c2a80 0x7f9b4c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b4affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 0x7f9b4c0c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c3550 con 0x7f9b4c0caa70 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b4b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c1f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b4b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c1f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33888/0 (socket says 172.21.15.123:33888) 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b4affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 0x7f9b4c0c2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51456/0 (socket says 172.21.15.123:51456) 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b4b7fe700 1 -- 172.21.15.123:0/931981902 learned_addr learned my addr 172.21.15.123:0/931981902 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c2f20 con 0x7f9b4c0c2a80 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b4bfff700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b4c0c2a80 0x7f9b4c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.575+0000 7f9b50d95700 1 -- 172.21.15.123:0/931981902 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c3810 con 0x7f9b4c0c86b0 2023-07-21T19:08:15.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b4affd700 1 -- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 msgr2=0x7f9b4c1f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b4affd700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c1f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b4affd700 1 -- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b4c0c2a80 msgr2=0x7f9b4c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b4affd700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b4c0c2a80 0x7f9b4c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b4affd700 1 -- 172.21.15.123:0/931981902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400085f0 con 0x7f9b4c0caa70 2023-07-21T19:08:15.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b4affd700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 0x7f9b4c0c2540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ebc0 tx=0x7f9b4400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400ca80 con 0x7f9b4c0caa70 2023-07-21T19:08:15.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b50d95700 1 -- 172.21.15.123:0/931981902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c0c3af0 con 0x7f9b4c0caa70 2023-07-21T19:08:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.579+0000 7f9b50d95700 1 -- 172.21.15.123:0/931981902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c1f9b00 con 0x7f9b4c0caa70 2023-07-21T19:08:15.596 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.583+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400f040 con 0x7f9b4c0caa70 2023-07-21T19:08:15.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.583+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400ce20 con 0x7f9b4c0caa70 2023-07-21T19:08:15.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.583+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b44014480 con 0x7f9b4c0caa70 2023-07-21T19:08:15.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.587+0000 7f9b33fff700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b38066440 0x7f9b380688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.587+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b44084a40 con 0x7f9b4c0caa70 2023-07-21T19:08:15.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.587+0000 7f9b4b7fe700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b38066440 0x7f9b380688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.587+0000 7f9b50d95700 1 -- 172.21.15.123:0/931981902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c005310 con 0x7f9b4c0caa70 2023-07-21T19:08:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.595+0000 7f9b4b7fe700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b38066440 0x7f9b380688f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c001940 tx=0x7f9b3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.595+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9b44051bb0 con 0x7f9b4c0caa70 2023-07-21T19:08:15.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.607+0000 7f751cc89700 1 Processor -- start 2023-07-21T19:08:15.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.607+0000 7f751cc89700 1 -- start start 2023-07-21T19:08:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751cc89700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75180afbf0 0x7f75180c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751cc89700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751cc89700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180cdd50 con 0x7f7518158c70 2023-07-21T19:08:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751cc89700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180cb430 con 0x7f75180afbf0 2023-07-21T19:08:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751cc89700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cda20 con 0x7f75180caa70 2023-07-21T19:08:15.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75180afbf0 0x7f75180c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f7515d9b700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f7518158c70 0x7f75180ce1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:36142/0 (socket says 172.21.15.123:36142) 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f7515d9b700 1 -- 172.21.15.123:0/1987407713 learned_addr learned my addr 172.21.15.123:0/1987407713 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751559a700 1 -- 172.21.15.123:0/1987407713 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529477268 0 0) 0x7f75180cdd50 con 0x7f7518158c70 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751559a700 1 -- 172.21.15.123:0/1987407713 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75000035d0 con 0x7f7518158c70 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751659c700 1 -- 172.21.15.123:0/1987407713 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 msgr2=0x7f75180caef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751659c700 1 --2- 172.21.15.123:0/1987407713 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180caef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751659c700 1 -- 172.21.15.123:0/1987407713 >> v1:172.21.15.145:6789/0 conn(0x7f7518158c70 legacy=0x7f75180ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751659c700 1 -- 172.21.15.123:0/1987407713 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180ce8f0 con 0x7f75180afbf0 2023-07-21T19:08:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751659c700 1 --2- 172.21.15.123:0/1987407713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180afbf0 0x7f75180c86b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7508009ab0 tx=0x7f7508009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d17b2c0e954cb0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751559a700 1 -- 172.21.15.123:0/1987407713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800b850 con 0x7f75180afbf0 2023-07-21T19:08:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751559a700 1 -- 172.21.15.123:0/1987407713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800b9b0 con 0x7f75180afbf0 2023-07-21T19:08:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.611+0000 7f751559a700 1 -- 172.21.15.123:0/1987407713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800bd40 con 0x7f75180afbf0 2023-07-21T19:08:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 -- 172.21.15.123:0/1987407713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180afbf0 msgr2=0x7f75180c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 --2- 172.21.15.123:0/1987407713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180afbf0 0x7f75180c86b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7508009ab0 tx=0x7f7508009dc0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 -- 172.21.15.123:0/1987407713 shutdown_connections 2023-07-21T19:08:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 --2- 172.21.15.123:0/1987407713 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 --2- 172.21.15.123:0/1987407713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180afbf0 0x7f75180c86b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 -- 172.21.15.123:0/1987407713 >> 172.21.15.123:0/1987407713 conn(0x7f7518060320 msgr2=0x7f75180606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 -- 172.21.15.123:0/1987407713 shutdown_connections 2023-07-21T19:08:15.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.615+0000 7f751cc89700 1 -- 172.21.15.123:0/1987407713 wait complete. 2023-07-21T19:08:15.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 Processor -- start 2023-07-21T19:08:15.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 -- start start 2023-07-21T19:08:15.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75180afbf0 0x7f75180c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7518158c70 0x7f75180adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180b1a30 con 0x7f7518158c70 2023-07-21T19:08:15.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180b1cd0 con 0x7f75180afbf0 2023-07-21T19:08:15.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751cc89700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180b1fb0 con 0x7f75180caa70 2023-07-21T19:08:15.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f7515d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f751659c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75180afbf0 0x7f75180c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f7515d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33896/0 (socket says 172.21.15.123:33896) 2023-07-21T19:08:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.619+0000 7f7515d9b700 1 -- 172.21.15.123:0/3727569088 learned_addr learned my addr 172.21.15.123:0/3727569088 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7516d9d700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7518158c70 0x7f75180adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7515d9b700 1 -- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75180afbf0 msgr2=0x7f75180c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7515d9b700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75180afbf0 0x7f75180c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7515d9b700 1 -- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7518158c70 msgr2=0x7f75180adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7515d9b700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7518158c70 0x7f75180adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7515d9b700 1 -- 172.21.15.123:0/3727569088 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080094b0 con 0x7f75180caa70 2023-07-21T19:08:15.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7516d9d700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7518158c70 0x7f75180adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:15.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7515d9b700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180cccd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f751000cbc0 tx=0x7f751000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000a820 con 0x7f75180caa70 2023-07-21T19:08:15.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75180b2290 con 0x7f75180caa70 2023-07-21T19:08:15.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75180cd210 con 0x7f75180caa70 2023-07-21T19:08:15.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.623+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000a980 con 0x7f75180caa70 2023-07-21T19:08:15.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.627+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000ad10 con 0x7f75180caa70 2023-07-21T19:08:15.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.627+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc005310 con 0x7f75180caa70 2023-07-21T19:08:15.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.627+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f751001b3b0 con 0x7f75180caa70 2023-07-21T19:08:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.631+0000 7f7506ffd700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74f80662f0 0x7f74f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.631+0000 7f751659c700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74f80662f0 0x7f74f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.631+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7510083af0 con 0x7f75180caa70 2023-07-21T19:08:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.631+0000 7f751659c700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74f80662f0 0x7f74f80687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75080090b0 tx=0x7f7508008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.635+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7510050c70 con 0x7f75180caa70 2023-07-21T19:08:15.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.655+0000 7f74980bc700 1 Processor -- start 2023-07-21T19:08:15.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.655+0000 7f74980bc700 1 -- start start 2023-07-21T19:08:15.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f74980bc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f74900c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f74980bc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7490157cb0 0x7f7490158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f74980bc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74900cdd50 con 0x7f74900ce1e0 2023-07-21T19:08:15.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f74980bc700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74901580e0 con 0x7f7490157cb0 2023-07-21T19:08:15.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f74980bc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74901591b0 con 0x7f74900afbf0 2023-07-21T19:08:15.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7490157cb0 0x7f7490158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7490157cb0 0x7f7490158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45946/0 (socket says 172.21.15.123:45946) 2023-07-21T19:08:15.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 -- 172.21.15.123:0/4019568832 learned_addr learned my addr 172.21.15.123:0/4019568832 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495e58700 1 --2- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f74900c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 -- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 msgr2=0x7f74900c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 --2- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f74900c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 -- 172.21.15.123:0/4019568832 >> v1:172.21.15.123:6789/0 conn(0x7f74900ce1e0 legacy=0x7f74900caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.659+0000 7f7495657700 1 -- 172.21.15.123:0/4019568832 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900ca440 con 0x7f7490157cb0 2023-07-21T19:08:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f7495657700 1 --2- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7490157cb0 0x7f7490158c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7488009e50 tx=0x7f748800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dfb893ce1f0430a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f7494e56700 1 -- 172.21.15.123:0/4019568832 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800e070 con 0x7f7490157cb0 2023-07-21T19:08:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f7494e56700 1 -- 172.21.15.123:0/4019568832 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748800b9c0 con 0x7f7490157cb0 2023-07-21T19:08:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 -- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7490157cb0 msgr2=0x7f7490158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 --2- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7490157cb0 0x7f7490158c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7488009e50 tx=0x7f748800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 -- 172.21.15.123:0/4019568832 shutdown_connections 2023-07-21T19:08:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 --2- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7490157cb0 0x7f7490158c70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 --2- 172.21.15.123:0/4019568832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f74900c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 -- 172.21.15.123:0/4019568832 >> 172.21.15.123:0/4019568832 conn(0x7f7490060320 msgr2=0x7f74900606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 -- 172.21.15.123:0/4019568832 shutdown_connections 2023-07-21T19:08:15.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.663+0000 7f74980bc700 1 -- 172.21.15.123:0/4019568832 wait complete. 2023-07-21T19:08:15.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.667+0000 7f74980bc700 1 Processor -- start 2023-07-21T19:08:15.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.667+0000 7f74980bc700 1 -- start start 2023-07-21T19:08:15.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.667+0000 7f74980bc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f7490157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.667+0000 7f74980bc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74900ce1e0 0x7f749015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f74980bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7490157cb0 0x7f749015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f7490157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f7490157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33902/0 (socket says 172.21.15.123:33902) 2023-07-21T19:08:15.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 -- 172.21.15.123:0/689792199 learned_addr learned my addr 172.21.15.123:0/689792199 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495657700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74900ce1e0 0x7f749015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74901701e0 con 0x7f7490157cb0 2023-07-21T19:08:15.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749016a390 con 0x7f74900ce1e0 2023-07-21T19:08:15.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7490157ad0 con 0x7f74900afbf0 2023-07-21T19:08:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7496659700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7490157cb0 0x7f749015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 -- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74900ce1e0 msgr2=0x7f749015a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74900ce1e0 0x7f749015a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 -- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7490157cb0 msgr2=0x7f749015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7490157cb0 0x7f749015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009b30 con 0x7f74900afbf0 2023-07-21T19:08:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7496659700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7490157cb0 0x7f749015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7f7495e58700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f7490157590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f748c00e760 tx=0x7f748c00ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7fedea2aa700 1 Processor -- start 2023-07-21T19:08:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.671+0000 7fedea2aa700 1 -- start start 2023-07-21T19:08:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 Processor -- start 2023-07-21T19:08:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fedea2aa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fede40ce680 0x7fede4160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fedea2aa700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fede40cad80 0x7fede40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fedea2aa700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede40cbd40 con 0x7fede415fd30 2023-07-21T19:08:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fedea2aa700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40cc020 con 0x7fede40ce680 2023-07-21T19:08:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fedea2aa700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40cc300 con 0x7fede40cad80 2023-07-21T19:08:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fede40ce680 0x7fede4160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fede40ce680 0x7fede4160100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51482/0 (socket says 172.21.15.123:51482) 2023-07-21T19:08:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 -- 172.21.15.123:0/472853770 learned_addr learned my addr 172.21.15.123:0/472853770 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 -- start start 2023-07-21T19:08:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede8847700 1 --2- 172.21.15.123:0/472853770 >> v2:172.21.15.145:3300/0 conn(0x7fede40cad80 0x7fede40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 -- 172.21.15.123:0/472853770 >> v2:172.21.15.145:3300/0 conn(0x7fede40cad80 msgr2=0x7fede40cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 --2- 172.21.15.123:0/472853770 >> v2:172.21.15.145:3300/0 conn(0x7fede40cad80 0x7fede40cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 -- 172.21.15.123:0/472853770 >> v1:172.21.15.145:6789/0 conn(0x7fede415fd30 legacy=0x7fede40cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7fede37fe700 1 -- 172.21.15.123:0/472853770 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede40cc5e0 con 0x7fede40ce680 2023-07-21T19:08:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69400b38b0 0x7f69400b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f69400ccb10 0x7f69400ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69400b3e20 con 0x7f694015f670 2023-07-21T19:08:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69400d0b20 con 0x7f69400b38b0 2023-07-21T19:08:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.675+0000 7f694858d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69400d0560 con 0x7f69400ccb10 2023-07-21T19:08:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69400b38b0 0x7f69400b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69400b38b0 0x7f69400b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51484/0 (socket says 172.21.15.123:51484) 2023-07-21T19:08:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 -- 172.21.15.123:0/1712468119 learned_addr learned my addr 172.21.15.123:0/1712468119 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6946b2a700 1 --2- 172.21.15.123:0/1712468119 >> v2:172.21.15.145:3300/0 conn(0x7f69400ccb10 0x7f69400ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c013610 con 0x7f74900afbf0 2023-07-21T19:08:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c013770 con 0x7f74900afbf0 2023-07-21T19:08:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c013ae0 con 0x7f74900afbf0 2023-07-21T19:08:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749016fc20 con 0x7f74900afbf0 2023-07-21T19:08:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fede37fe700 1 --2- 172.21.15.123:0/472853770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40ce680 0x7fede4160100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fede40cf120 tx=0x7feddc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ae28accb2b14a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 -- 172.21.15.123:0/1712468119 >> v2:172.21.15.145:3300/0 conn(0x7f69400ccb10 msgr2=0x7f69400ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 --2- 172.21.15.123:0/1712468119 >> v2:172.21.15.145:3300/0 conn(0x7f69400ccb10 0x7f69400ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 -- 172.21.15.123:0/1712468119 >> v1:172.21.15.145:6789/0 conn(0x7f694015f670 legacy=0x7f69400b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 -- 172.21.15.123:0/1712468119 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400d0840 con 0x7f69400b38b0 2023-07-21T19:08:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749016a020 con 0x7f74900afbf0 2023-07-21T19:08:15.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945b28700 1 --2- 172.21.15.123:0/1712468119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400b2530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f694008cc70 tx=0x7f693800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d76225ef7e9ccd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7490169e80 con 0x7f74900afbf0 2023-07-21T19:08:15.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fede2ffd700 1 -- 172.21.15.123:0/472853770 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00e070 con 0x7fede40ce680 2023-07-21T19:08:15.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fede2ffd700 1 -- 172.21.15.123:0/472853770 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc00b910 con 0x7fede40ce680 2023-07-21T19:08:15.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fede2ffd700 1 -- 172.21.15.123:0/472853770 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00bcc0 con 0x7fede40ce680 2023-07-21T19:08:15.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 -- 172.21.15.123:0/472853770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40ce680 msgr2=0x7fede4160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 --2- 172.21.15.123:0/472853770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40ce680 0x7fede4160100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fede40cf120 tx=0x7feddc00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:15.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 -- 172.21.15.123:0/472853770 shutdown_connections 2023-07-21T19:08:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 --2- 172.21.15.123:0/472853770 >> v2:172.21.15.145:3300/0 conn(0x7fede40cad80 0x7fede40cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 --2- 172.21.15.123:0/472853770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40ce680 0x7fede4160100 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fede40cf120 tx=0x7feddc00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 -- 172.21.15.123:0/472853770 >> 172.21.15.123:0/472853770 conn(0x7fede4060320 msgr2=0x7fede40606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 -- 172.21.15.123:0/472853770 shutdown_connections 2023-07-21T19:08:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945327700 1 -- 172.21.15.123:0/1712468119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800e070 con 0x7f69400b38b0 2023-07-21T19:08:15.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945327700 1 -- 172.21.15.123:0/1712468119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693800b910 con 0x7f69400b38b0 2023-07-21T19:08:15.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7f6945327700 1 -- 172.21.15.123:0/1712468119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800bca0 con 0x7f69400b38b0 2023-07-21T19:08:15.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 -- 172.21.15.123:0/1712468119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 msgr2=0x7f69400b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 --2- 172.21.15.123:0/1712468119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400b2530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f694008cc70 tx=0x7f693800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:15.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 -- 172.21.15.123:0/1712468119 shutdown_connections 2023-07-21T19:08:15.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 --2- 172.21.15.123:0/1712468119 >> v2:172.21.15.145:3300/0 conn(0x7f69400ccb10 0x7f69400ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 --2- 172.21.15.123:0/1712468119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400b2530 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 -- 172.21.15.123:0/1712468119 >> 172.21.15.123:0/1712468119 conn(0x7f6940060c40 msgr2=0x7f694009b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f748c013c40 con 0x7f74900afbf0 2023-07-21T19:08:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.679+0000 7fedea2aa700 1 -- 172.21.15.123:0/472853770 wait complete. 2023-07-21T19:08:15.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7fedea2aa700 1 Processor -- start 2023-07-21T19:08:15.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 -- 172.21.15.123:0/1712468119 shutdown_connections 2023-07-21T19:08:15.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f694858d700 1 -- 172.21.15.123:0/1712468119 wait complete. 2023-07-21T19:08:15.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f74867fc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7474066340 0x7f74740687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f748c083fe0 con 0x7f74900afbf0 2023-07-21T19:08:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7f7495657700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7474066340 0x7f74740687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f7495657700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7474066340 0x7f74740687f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f748800b370 tx=0x7f7488009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f748c054be0 con 0x7f74900afbf0 2023-07-21T19:08:15.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.683+0000 7fedea2aa700 1 -- start start 2023-07-21T19:08:15.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fedea2aa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40cad80 0x7fede4202160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 Processor -- start 2023-07-21T19:08:15.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40cad80 0x7fede4202160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40cad80 0x7fede4202160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51486/0 (socket says 172.21.15.123:51486) 2023-07-21T19:08:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede3fff700 1 -- 172.21.15.123:0/2072687160 learned_addr learned my addr 172.21.15.123:0/2072687160 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fede415fd30 0x7fede415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 -- start start 2023-07-21T19:08:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede415f4e0 0x7fede40c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede42026a0 con 0x7fede40cad80 2023-07-21T19:08:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede41f34c0 con 0x7fede415f4e0 2023-07-21T19:08:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede41f25d0 con 0x7fede415fd30 2023-07-21T19:08:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede37fe700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fede415fd30 0x7fede415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede8847700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede415f4e0 0x7fede40c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69400ccb10 0x7f69400c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 0x7f69400cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400c8720 con 0x7f69400b38b0 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400c5d50 con 0x7f69400ccb10 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f694858d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69400c7b10 con 0x7f694015f670 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f6946b2a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 0x7f69400cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f6946b2a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 0x7f69400cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33910/0 (socket says 172.21.15.123:33910) 2023-07-21T19:08:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f6946b2a700 1 -- 172.21.15.123:0/2731782960 learned_addr learned my addr 172.21.15.123:0/2731782960 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7f6945b28700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69400ccb10 0x7f69400c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 Processor -- start 2023-07-21T19:08:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede8847700 1 -- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fede415fd30 msgr2=0x7fede415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede8847700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fede415fd30 0x7fede415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede8847700 1 -- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40cad80 msgr2=0x7fede4202160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede8847700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40cad80 0x7fede4202160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.687+0000 7fede8847700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009b30 con 0x7fede415f4e0 2023-07-21T19:08:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946329700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 -- start start 2023-07-21T19:08:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946b2a700 1 -- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69400ccb10 msgr2=0x7f69400c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946b2a700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69400ccb10 0x7f69400c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946b2a700 1 -- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 msgr2=0x7f69400c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946b2a700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946b2a700 1 -- 172.21.15.123:0/2731782960 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938009b30 con 0x7f694015f670 2023-07-21T19:08:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6945b28700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69400ccb10 0x7f69400c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fede8847700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede415f4e0 0x7fede40c3be0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fedd400e860 tx=0x7fedd400eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6946b2a700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 0x7f69400cf1f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e7f0 tx=0x7f693c00eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4013680 con 0x7fede415f4e0 2023-07-21T19:08:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd40137e0 con 0x7fede415f4e0 2023-07-21T19:08:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4013b90 con 0x7fede415f4e0 2023-07-21T19:08:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede41f28b0 con 0x7fede415f4e0 2023-07-21T19:08:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c013680 con 0x7f694015f670 2023-07-21T19:08:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69400c7df0 con 0x7f694015f670 2023-07-21T19:08:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69400c83b0 con 0x7f694015f670 2023-07-21T19:08:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c15bff0 0x7fe80c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 0x7fe80c0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe80c0ceff0 0x7fe80c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0cd4c0 con 0x7fe80c0cd070 2023-07-21T19:08:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0af0a0 con 0x7fe80c0ceff0 2023-07-21T19:08:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe811769700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0cf470 con 0x7fe80c15bff0 2023-07-21T19:08:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede41f2e70 con 0x7fede415f4e0 2023-07-21T19:08:15.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe80a7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 0x7fe80c0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe80a7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 0x7fe80c0ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51506/0 (socket says 172.21.15.123:51506) 2023-07-21T19:08:15.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7fe80a7fc700 1 -- 172.21.15.123:0/220664517 learned_addr learned my addr 172.21.15.123:0/220664517 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.691+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c013800 con 0x7f694015f670 2023-07-21T19:08:15.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 --2- 172.21.15.123:0/220664517 >> v2:172.21.15.145:3300/0 conn(0x7fe80c0ceff0 0x7fe80c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80affd700 1 --2- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c15bff0 0x7fe80c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede40c9080 con 0x7fede415f4e0 2023-07-21T19:08:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c013bb0 con 0x7f694015f670 2023-07-21T19:08:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 -- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c15bff0 msgr2=0x7fe80c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 --2- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c15bff0 0x7fe80c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 -- 172.21.15.123:0/220664517 >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 msgr2=0x7fe80c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 --2- 172.21.15.123:0/220664517 >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 0x7fe80c0ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 -- 172.21.15.123:0/220664517 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0cf720 con 0x7fe80c0ceff0 2023-07-21T19:08:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80a7fc700 1 --2- 172.21.15.123:0/220664517 >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 0x7fe80c0ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69400b6030 con 0x7f694015f670 2023-07-21T19:08:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe80b7fe700 1 --2- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c0ceff0 0x7fe80c0d0020 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe80c08b700 tx=0x7fe7fc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b2dab6019eb17e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe809ffb700 1 -- 172.21.15.123:0/220664517 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc011830 con 0x7fe80c0ceff0 2023-07-21T19:08:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe809ffb700 1 -- 172.21.15.123:0/220664517 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc011990 con 0x7fe80c0ceff0 2023-07-21T19:08:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fe809ffb700 1 -- 172.21.15.123:0/220664517 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc011d20 con 0x7fe80c0ceff0 2023-07-21T19:08:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedd4013cf0 con 0x7fede415f4e0 2023-07-21T19:08:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fede0ff9700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fedd00663c0 0x7fedd0068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fedd4083b50 con 0x7fede415f4e0 2023-07-21T19:08:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.695+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f693c013d10 con 0x7f694015f670 2023-07-21T19:08:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 -- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c0ceff0 msgr2=0x7fe80c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 --2- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c0ceff0 0x7fe80c0d0020 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe80c08b700 tx=0x7fe7fc009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:15.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fede3fff700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fedd00663c0 0x7fedd0068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 -- 172.21.15.123:0/220664517 shutdown_connections 2023-07-21T19:08:15.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 --2- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c0ceff0 0x7fe80c0d0020 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 --2- 172.21.15.123:0/220664517 >> v2:172.21.15.123:3300/0 conn(0x7fe80c0cd070 0x7fe80c0ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 --2- 172.21.15.123:0/220664517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c15bff0 0x7fe80c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 -- 172.21.15.123:0/220664517 >> 172.21.15.123:0/220664517 conn(0x7fe80c060c40 msgr2=0x7fe80c09b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7f6936ffd700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6924066370 0x7f6924068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 -- 172.21.15.123:0/220664517 shutdown_connections 2023-07-21T19:08:15.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 -- 172.21.15.123:0/220664517 wait complete. 2023-07-21T19:08:15.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f693c083de0 con 0x7f694015f670 2023-07-21T19:08:15.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fede3fff700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fedd00663c0 0x7fedd0068870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fedd8001940 tx=0x7fedd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7f6946329700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6924066370 0x7f6924068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7f6946329700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6924066370 0x7f6924068820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f60 tx=0x7f6930009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 Processor -- start 2023-07-21T19:08:15.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.699+0000 7fe811769700 1 -- start start 2023-07-21T19:08:15.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 0x7fe80c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 0x7fe80c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 0x7fe80c147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51512/0 (socket says 172.21.15.123:51512) 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 -- 172.21.15.123:0/1999660438 learned_addr learned my addr 172.21.15.123:0/1999660438 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c0ceff0 0x7fe80c14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c15bff0 0x7fe80c0d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1481a0 con 0x7fe80c0cd070 2023-07-21T19:08:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c15d810 con 0x7fe80c15bff0 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c15dab0 con 0x7fe80c0ceff0 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80a7fc700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c0ceff0 0x7fe80c14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80b7fe700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c15bff0 0x7fe80c0d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 -- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c0ceff0 msgr2=0x7fe80c14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c0ceff0 0x7fe80c14d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 -- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c15bff0 msgr2=0x7fe80c0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c15bff0 0x7fe80c0d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800009570 con 0x7fe80c0cd070 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80a7fc700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c0ceff0 0x7fe80c14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe80affd700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 0x7fe80c147c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe804007e40 tx=0x7fe80400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400eea0 con 0x7fe80c0cd070 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804014420 con 0x7fe80c0cd070 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0094b0 con 0x7fe80c0cd070 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040147d0 con 0x7fe80c0cd070 2023-07-21T19:08:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.703+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c15e070 con 0x7fe80c0cd070 2023-07-21T19:08:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.707+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fedd4050cc0 con 0x7fede415f4e0 2023-07-21T19:08:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.707+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c066830 con 0x7fe80c0cd070 2023-07-21T19:08:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.707+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f693c051050 con 0x7f694015f670 2023-07-21T19:08:15.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.707+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe804014930 con 0x7fe80c0cd070 2023-07-21T19:08:15.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.707+0000 7fe7f37fe700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7f80662f0 0x7fe7f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.711+0000 7fe80a7fc700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7f80662f0 0x7fe7f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.711+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe804011260 con 0x7fe80c0cd070 2023-07-21T19:08:15.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.711+0000 7fe80a7fc700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7f80662f0 0x7fe7f80687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0d14a0 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.711+0000 7f068f5cd700 1 Processor -- start 2023-07-21T19:08:15.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe8040510e0 con 0x7fe80c0cd070 2023-07-21T19:08:15.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068f5cd700 1 -- start start 2023-07-21T19:08:15.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068f5cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0680036e80 0x7f068003a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068f5cd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f068003a640 0x7f06800528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068f5cd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800060c0 con 0x7f0680054800 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068f5cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800070b0 con 0x7f0680036e80 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068f5cd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800ded00 con 0x7f068003a640 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068d369700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0680054800 0x7f0680036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43484/0 (socket says 172.21.15.123:43484) 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068d369700 1 -- 172.21.15.123:0/2805329916 learned_addr learned my addr 172.21.15.123:0/2805329916 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068cb68700 1 --2- 172.21.15.123:0/2805329916 >> v2:172.21.15.123:3300/0 conn(0x7f0680036e80 0x7f068003a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.715+0000 7f068db6a700 1 --2- 172.21.15.123:0/2805329916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f068003a640 0x7f06800528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f068cb68700 1 -- 172.21.15.123:0/2805329916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f068003a640 msgr2=0x7f06800528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f068cb68700 1 --2- 172.21.15.123:0/2805329916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f068003a640 0x7f06800528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f068cb68700 1 -- 172.21.15.123:0/2805329916 >> v1:172.21.15.123:6789/0 conn(0x7f0680054800 legacy=0x7f0680036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f068cb68700 1 -- 172.21.15.123:0/2805329916 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068003aac0 con 0x7f0680036e80 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f068cb68700 1 --2- 172.21.15.123:0/2805329916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0680036e80 0x7f068003a100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f067800bb00 tx=0x7f067800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0519023545e09e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f067ffff700 1 -- 172.21.15.123:0/2805329916 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800db60 con 0x7f0680036e80 2023-07-21T19:08:15.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f067ffff700 1 -- 172.21.15.123:0/2805329916 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800dcc0 con 0x7f0680036e80 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.719+0000 7f067ffff700 1 -- 172.21.15.123:0/2805329916 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678004030 con 0x7f0680036e80 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 -- 172.21.15.123:0/2805329916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0680036e80 msgr2=0x7f068003a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 --2- 172.21.15.123:0/2805329916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0680036e80 0x7f068003a100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f067800bb00 tx=0x7f067800be10 comp rx=0 tx=0).stop 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 -- 172.21.15.123:0/2805329916 shutdown_connections 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 --2- 172.21.15.123:0/2805329916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f068003a640 0x7f06800528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 --2- 172.21.15.123:0/2805329916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0680036e80 0x7f068003a100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 -- 172.21.15.123:0/2805329916 >> 172.21.15.123:0/2805329916 conn(0x7f0680051770 msgr2=0x7f0680051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 -- 172.21.15.123:0/2805329916 shutdown_connections 2023-07-21T19:08:15.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.723+0000 7f068f5cd700 1 -- 172.21.15.123:0/2805329916 wait complete. 2023-07-21T19:08:15.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 Processor -- start 2023-07-21T19:08:15.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 -- start start 2023-07-21T19:08:15.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0680036e80 0x7f068017b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f068003a640 0x7f068004df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 0x7f068004e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800389b0 con 0x7f068003a640 2023-07-21T19:08:15.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800386d0 con 0x7f0680054800 2023-07-21T19:08:15.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068f5cd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800d9a90 con 0x7f0680036e80 2023-07-21T19:08:15.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068db6a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 0x7f068004e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068db6a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 0x7f068004e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:45996/0 (socket says 172.21.15.123:45996) 2023-07-21T19:08:15.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068db6a700 1 -- 172.21.15.123:0/3192217863 learned_addr learned my addr 172.21.15.123:0/3192217863 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068d369700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0680036e80 0x7f068017b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.727+0000 7f068cb68700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f068003a640 0x7f068004df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068db6a700 1 -- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0680036e80 msgr2=0x7f068017b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068db6a700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0680036e80 0x7f068017b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068db6a700 1 -- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f068003a640 msgr2=0x7f068004df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068db6a700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f068003a640 0x7f068004df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068db6a700 1 -- 172.21.15.123:0/3192217863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067800b760 con 0x7f0680054800 2023-07-21T19:08:15.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068db6a700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 0x7f068004e4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06880693f0 tx=0x7f068806fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688066a30 con 0x7f0680054800 2023-07-21T19:08:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800d9d70 con 0x7f0680054800 2023-07-21T19:08:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0680048d90 con 0x7f0680054800 2023-07-21T19:08:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688066b90 con 0x7f0680054800 2023-07-21T19:08:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688072d30 con 0x7f0680054800 2023-07-21T19:08:15.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c005310 con 0x7f0680054800 2023-07-21T19:08:15.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06880730a0 con 0x7f0680054800 2023-07-21T19:08:15.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f65408a6700 1 Processor -- start 2023-07-21T19:08:15.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.731+0000 7f65408a6700 1 -- start start 2023-07-21T19:08:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f067dffb700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0674066490 0x7f0674068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f65408a6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f653c15fd30 0x7f653c160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f068808f070 con 0x7f0680054800 2023-07-21T19:08:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f65408a6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f653c0cdf70 0x7f653c0ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f65408a6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0ce8e0 con 0x7f653c0cad80 2023-07-21T19:08:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f65408a6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c0cb8f0 con 0x7f653c0cdf70 2023-07-21T19:08:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f65408a6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c0cbd40 con 0x7f653c15fd30 2023-07-21T19:08:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f653bfff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f653c0cad80 0x7f653c0cb1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:36172/0 (socket says 172.21.15.123:36172) 2023-07-21T19:08:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f653bfff700 1 -- 172.21.15.123:0/1445107934 learned_addr learned my addr 172.21.15.123:0/1445107934 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.735+0000 7f068d369700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0674066490 0x7f0674068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653b7fe700 1 --2- 172.21.15.123:0/1445107934 >> v2:172.21.15.145:3300/0 conn(0x7f653c15fd30 0x7f653c160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f068d369700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0674066490 0x7f0674068940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06840049b0 tx=0x7f0684009470 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653affd700 1 --2- 172.21.15.123:0/1445107934 >> v2:172.21.15.123:3300/0 conn(0x7f653c0cdf70 0x7f653c0ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653affd700 1 -- 172.21.15.123:0/1445107934 >> v2:172.21.15.145:3300/0 conn(0x7f653c15fd30 msgr2=0x7f653c160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653affd700 1 --2- 172.21.15.123:0/1445107934 >> v2:172.21.15.145:3300/0 conn(0x7f653c15fd30 0x7f653c160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653affd700 1 -- 172.21.15.123:0/1445107934 >> v1:172.21.15.145:6789/0 conn(0x7f653c0cad80 legacy=0x7f653c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653affd700 1 -- 172.21.15.123:0/1445107934 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0cc020 con 0x7f653c0cdf70 2023-07-21T19:08:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653b7fe700 1 --2- 172.21.15.123:0/1445107934 >> v2:172.21.15.145:3300/0 conn(0x7f653c15fd30 0x7f653c160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653affd700 1 --2- 172.21.15.123:0/1445107934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c0cdf70 0x7f653c0ce3a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f653c0b0a20 tx=0x7f6530009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e7a437ec0186f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653a7fc700 1 -- 172.21.15.123:0/1445107934 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530011830 con 0x7f653c0cdf70 2023-07-21T19:08:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.739+0000 7f653a7fc700 1 -- 172.21.15.123:0/1445107934 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530011990 con 0x7f653c0cdf70 2023-07-21T19:08:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f06880caac0 con 0x7f0680054800 2023-07-21T19:08:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 -- 172.21.15.123:0/1445107934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c0cdf70 msgr2=0x7f653c0ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 --2- 172.21.15.123:0/1445107934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c0cdf70 0x7f653c0ce3a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f653c0b0a20 tx=0x7f6530009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 -- 172.21.15.123:0/1445107934 shutdown_connections 2023-07-21T19:08:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 --2- 172.21.15.123:0/1445107934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c0cdf70 0x7f653c0ce3a0 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f653c0b0a20 tx=0x7f6530009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 --2- 172.21.15.123:0/1445107934 >> v2:172.21.15.145:3300/0 conn(0x7f653c15fd30 0x7f653c160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 -- 172.21.15.123:0/1445107934 >> 172.21.15.123:0/1445107934 conn(0x7f653c060320 msgr2=0x7f653c0606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 -- 172.21.15.123:0/1445107934 shutdown_connections 2023-07-21T19:08:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.743+0000 7f65408a6700 1 -- 172.21.15.123:0/1445107934 wait complete. 2023-07-21T19:08:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 Processor -- start 2023-07-21T19:08:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 -- start start 2023-07-21T19:08:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f653c0cad80 0x7f653c0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c15fd30 0x7f653c161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 0x7f653c085600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0c51d0 con 0x7f653c15fd30 2023-07-21T19:08:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0b17d0 con 0x7f653c0cad80 2023-07-21T19:08:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f65408a6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0b1ab0 con 0x7f653c0b3480 2023-07-21T19:08:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f653bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 0x7f653c085600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f653bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 0x7f653c085600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:33952/0 (socket says 172.21.15.123:33952) 2023-07-21T19:08:15.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.747+0000 7f653bfff700 1 -- 172.21.15.123:0/3361795822 learned_addr learned my addr 172.21.15.123:0/3361795822 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:15.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f653bfff700 1 -- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f653c0cad80 msgr2=0x7f653c0b0ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T19:08:15.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f653bfff700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f653c0cad80 0x7f653c0b0ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f653bfff700 1 -- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c15fd30 msgr2=0x7f653c161c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T19:08:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f653bfff700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c15fd30 0x7f653c161c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f653bfff700 1 -- 172.21.15.123:0/3361795822 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0094b0 con 0x7f653c0b3480 2023-07-21T19:08:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f653bfff700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 0x7f653c085600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f653400caa0 tx=0x7f653400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400a7b0 con 0x7f653c0b3480 2023-07-21T19:08:15.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65300094b0 con 0x7f653c0b3480 2023-07-21T19:08:15.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c0b2070 con 0x7f653c0b3480 2023-07-21T19:08:15.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653400a910 con 0x7f653c0b3480 2023-07-21T19:08:15.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.751+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400ad00 con 0x7f653c0b3480 2023-07-21T19:08:15.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.755+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651c005310 con 0x7f653c0b3480 2023-07-21T19:08:15.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.755+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65340113a0 con 0x7f653c0b3480 2023-07-21T19:08:15.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.755+0000 7f6523fff700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066340 0x7f65280687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:15.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.759+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65340839f0 con 0x7f653c0b3480 2023-07-21T19:08:15.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.759+0000 7f653b7fe700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066340 0x7f65280687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.759+0000 7f653b7fe700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066340 0x7f65280687f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f652c009bb0 tx=0x7f652c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:15.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.763+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6534050bf0 con 0x7f653c0b3480 2023-07-21T19:08:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.919+0000 7f9b50d95700 1 -- 172.21.15.123:0/931981902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b2c0055c0 con 0x7f9b4c0caa70 2023-07-21T19:08:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.919+0000 7f9b33fff700 1 -- 172.21.15.123:0/931981902 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b44018020 con 0x7f9b4c0caa70 2023-07-21T19:08:15.935 INFO:teuthology.orchestra.run.smithi123.stdout:55834574859 2023-07-21T19:08:15.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 -- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b38066440 msgr2=0x7f9b380688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b38066440 0x7f9b380688f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c001940 tx=0x7f9b3c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:15.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 -- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 msgr2=0x7f9b4c0c2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 0x7f9b4c0c2540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ebc0 tx=0x7f9b4400eed0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 -- 172.21.15.123:0/931981902 shutdown_connections 2023-07-21T19:08:15.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b38066440 0x7f9b380688f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b4c0c2a80 0x7f9b4c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b4c0caa70 0x7f9b4c0c2540 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 --2- 172.21.15.123:0/931981902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b4c0c86b0 0x7f9b4c1f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.923+0000 7f9b31ffb700 1 -- 172.21.15.123:0/931981902 >> 172.21.15.123:0/931981902 conn(0x7f9b4c060320 msgr2=0x7f9b4c06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.927+0000 7f9b31ffb700 1 -- 172.21.15.123:0/931981902 shutdown_connections 2023-07-21T19:08:15.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.927+0000 7f9b31ffb700 1 -- 172.21.15.123:0/931981902 wait complete. 2023-07-21T19:08:15.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-07-21T19:08:15.962 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:15.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.955+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f74fc0055c0 con 0x7f75180caa70 2023-07-21T19:08:15.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.955+0000 7f7506ffd700 1 -- 172.21.15.123:0/3727569088 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7510054290 con 0x7f75180caa70 2023-07-21T19:08:15.969 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:15.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74f80662f0 msgr2=0x7f74f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74f80662f0 0x7f74f80687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75080090b0 tx=0x7f7508008030 comp rx=0 tx=0).stop 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 msgr2=0x7f75180cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180cccd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f751000cbc0 tx=0x7f751000cbf0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 shutdown_connections 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f74f80662f0 0x7f74f80687a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7518158c70 0x7f75180adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75180caa70 0x7f75180cccd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 --2- 172.21.15.123:0/3727569088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75180afbf0 0x7f75180c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:15.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 >> 172.21.15.123:0/3727569088 conn(0x7f7518060320 msgr2=0x7f75180aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:15.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 shutdown_connections 2023-07-21T19:08:15.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.959+0000 7f751cc89700 1 -- 172.21.15.123:0/3727569088 wait complete. 2023-07-21T19:08:15.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-07-21T19:08:15.998 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.995+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fede404e500 con 0x7fede415f4e0 2023-07-21T19:08:16.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fede0ff9700 1 -- 172.21.15.123:0/2072687160 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedd40542e0 con 0x7fede415f4e0 2023-07-21T19:08:16.012 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:16.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fedd00663c0 msgr2=0x7fedd0068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fedd00663c0 0x7fedd0068870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fedd8001940 tx=0x7fedd8009040 comp rx=0 tx=0).stop 2023-07-21T19:08:16.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede415f4e0 msgr2=0x7fede40c3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede415f4e0 0x7fede40c3be0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fedd400e860 tx=0x7fedd400eb70 comp rx=0 tx=0).stop 2023-07-21T19:08:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 shutdown_connections 2023-07-21T19:08:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fedd00663c0 0x7fedd0068870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede415f4e0 0x7fede40c3be0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fede415fd30 0x7fede415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 --2- 172.21.15.123:0/2072687160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fede40cad80 0x7fede4202160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 >> 172.21.15.123:0/2072687160 conn(0x7fede4060320 msgr2=0x7fede40ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 shutdown_connections 2023-07-21T19:08:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:15.999+0000 7fedea2aa700 1 -- 172.21.15.123:0/2072687160 wait complete. 2023-07-21T19:08:16.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-07-21T19:08:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.015+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7490169e80 con 0x7f74900afbf0 2023-07-21T19:08:16.032 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.019+0000 7f74867fc700 1 -- 172.21.15.123:0/689792199 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7490169e80 con 0x7f74900afbf0 2023-07-21T19:08:16.034 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:16.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.019+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f066c005890 con 0x7f0680054800 2023-07-21T19:08:16.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7474066340 msgr2=0x7f74740687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7474066340 0x7f74740687f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f748800b370 tx=0x7f7488009000 comp rx=0 tx=0).stop 2023-07-21T19:08:16.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 msgr2=0x7f7490157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f7490157590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f748c00e760 tx=0x7f748c00ea70 comp rx=0 tx=0).stop 2023-07-21T19:08:16.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 shutdown_connections 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7474066340 0x7f74740687f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74900ce1e0 0x7f749015a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7490157cb0 0x7f749015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 --2- 172.21.15.123:0/689792199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74900afbf0 0x7f7490157590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 >> 172.21.15.123:0/689792199 conn(0x7f7490060320 msgr2=0x7f74900aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 shutdown_connections 2023-07-21T19:08:16.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f74980bc700 1 -- 172.21.15.123:0/689792199 wait complete. 2023-07-21T19:08:16.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f067dffb700 1 -- 172.21.15.123:0/3192217863 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06880ce0e0 con 0x7f0680054800 2023-07-21T19:08:16.038 INFO:teuthology.orchestra.run.smithi123.stdout:55834574859 2023-07-21T19:08:16.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0674066490 msgr2=0x7f0674068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0674066490 0x7f0674068940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06840049b0 tx=0x7f0684009470 comp rx=0 tx=0).stop 2023-07-21T19:08:16.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 msgr2=0x7f068004e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 0x7f068004e4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06880693f0 tx=0x7f068806fdc0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 shutdown_connections 2023-07-21T19:08:16.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0674066490 0x7f0674068940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0680054800 0x7f068004e4d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f068003a640 0x7f068004df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 --2- 172.21.15.123:0/3192217863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0680036e80 0x7f068017b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 >> 172.21.15.123:0/3192217863 conn(0x7f0680051770 msgr2=0x7f0680051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 shutdown_connections 2023-07-21T19:08:16.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f068f5cd700 1 -- 172.21.15.123:0/3192217863 wait complete. 2023-07-21T19:08:16.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.023+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f694004e500 con 0x7f694015f670 2023-07-21T19:08:16.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f6936ffd700 1 -- 172.21.15.123:0/2731782960 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f693c054670 con 0x7f694015f670 2023-07-21T19:08:16.041 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:16.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6924066370 msgr2=0x7f6924068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6924066370 0x7f6924068820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f60 tx=0x7f6930009040 comp rx=0 tx=0).stop 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 msgr2=0x7f69400cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 0x7f69400cf1f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e7f0 tx=0x7f693c00eb00 comp rx=0 tx=0).stop 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 shutdown_connections 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6924066370 0x7f6924068820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69400ccb10 0x7f69400c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f694015f670 0x7f69400cf1f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 --2- 172.21.15.123:0/2731782960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69400b38b0 0x7f69400c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 >> 172.21.15.123:0/2731782960 conn(0x7f6940060c40 msgr2=0x7f69400b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 shutdown_connections 2023-07-21T19:08:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.027+0000 7f694858d700 1 -- 172.21.15.123:0/2731782960 wait complete. 2023-07-21T19:08:16.045 INFO:teuthology.orchestra.run.smithi123.stdout:55834574858 2023-07-21T19:08:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.031+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe80c04e500 con 0x7fe80c0cd070 2023-07-21T19:08:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.031+0000 7fe7f37fe700 1 -- 172.21.15.123:0/1999660438 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe804054700 con 0x7fe80c0cd070 2023-07-21T19:08:16.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7f80662f0 msgr2=0x7fe7f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7f80662f0 0x7fe7f80687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0d14a0 tx=0x7fe800008040 comp rx=0 tx=0).stop 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 msgr2=0x7fe80c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 0x7fe80c147c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe804007e40 tx=0x7fe80400e3c0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 shutdown_connections 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe7f80662f0 0x7fe7f80687a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe80c15bff0 0x7fe80c0d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe80c0ceff0 0x7fe80c14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 --2- 172.21.15.123:0/1999660438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe80c0cd070 0x7fe80c147c60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 >> 172.21.15.123:0/1999660438 conn(0x7fe80c060c40 msgr2=0x7fe80c071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 shutdown_connections 2023-07-21T19:08:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.035+0000 7fe811769700 1 -- 172.21.15.123:0/1999660438 wait complete. 2023-07-21T19:08:16.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-07-21T19:08:16.059 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-07-21T19:08:16.063 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-07-21T19:08:16.064 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-07-21T19:08:16.066 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.067+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f651c0055c0 con 0x7f653c0b3480 2023-07-21T19:08:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.067+0000 7f6523fff700 1 -- 172.21.15.123:0/3361795822 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f653400ae60 con 0x7f653c0b3480 2023-07-21T19:08:16.081 INFO:teuthology.orchestra.run.smithi123.stdout:55834574857 2023-07-21T19:08:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066340 msgr2=0x7f65280687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066340 0x7f65280687f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f652c009bb0 tx=0x7f652c009240 comp rx=0 tx=0).stop 2023-07-21T19:08:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 msgr2=0x7f653c085600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 0x7f653c085600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f653400caa0 tx=0x7f653400cb80 comp rx=0 tx=0).stop 2023-07-21T19:08:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 shutdown_connections 2023-07-21T19:08:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066340 0x7f65280687f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f653c0b3480 0x7f653c085600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f653c15fd30 0x7f653c161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 --2- 172.21.15.123:0/3361795822 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f653c0cad80 0x7f653c0b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 >> 172.21.15.123:0/3361795822 conn(0x7f653c060320 msgr2=0x7f653c1642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 shutdown_connections 2023-07-21T19:08:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.071+0000 7f65408a6700 1 -- 172.21.15.123:0/3361795822 wait complete. 2023-07-21T19:08:16.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-07-21T19:08:16.106 DEBUG:teuthology.parallel:result is None 2023-07-21T19:08:16.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T19:08:16.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T19:08:16.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 Processor -- start 2023-07-21T19:08:16.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 -- start start 2023-07-21T19:08:16.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f358406d860 0x7f35840cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406be70 0x7f358406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35840cc1b0 con 0x7f35840c1e00 2023-07-21T19:08:16.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358406e170 con 0x7f358406d860 2023-07-21T19:08:16.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.295+0000 7f358c63b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840cd690 con 0x7f358406be70 2023-07-21T19:08:16.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f358406d860 0x7f35840cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f358406d860 0x7f35840cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:46028/0 (socket says 172.21.15.123:46028) 2023-07-21T19:08:16.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 -- 172.21.15.123:0/997627022 learned_addr learned my addr 172.21.15.123:0/997627022 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:16.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f3589bd6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406be70 0x7f358406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 -- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406be70 msgr2=0x7f358406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:16.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 --2- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406be70 0x7f358406dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 -- 172.21.15.123:0/997627022 >> v1:172.21.15.145:6789/0 conn(0x7f35840c1e00 legacy=0x7f35840cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 -- 172.21.15.123:0/997627022 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840cd970 con 0x7f358406d860 2023-07-21T19:08:16.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358a3d7700 1 --2- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f358406d860 0x7f35840cb840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3580009940 tx=0x7f3580009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a723457adcc27d8a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:16.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f35893d5700 1 -- 172.21.15.123:0/997627022 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580011830 con 0x7f358406d860 2023-07-21T19:08:16.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f35893d5700 1 -- 172.21.15.123:0/997627022 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580011990 con 0x7f358406d860 2023-07-21T19:08:16.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f35893d5700 1 -- 172.21.15.123:0/997627022 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580011d20 con 0x7f358406d860 2023-07-21T19:08:16.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 -- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f358406d860 msgr2=0x7f35840cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 --2- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f358406d860 0x7f35840cb840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3580009940 tx=0x7f3580009c50 comp rx=0 tx=0).stop 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 -- 172.21.15.123:0/997627022 shutdown_connections 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 --2- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406be70 0x7f358406dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 --2- 172.21.15.123:0/997627022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f358406d860 0x7f35840cb840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 -- 172.21.15.123:0/997627022 >> 172.21.15.123:0/997627022 conn(0x7f35840cad30 msgr2=0x7f35840cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 -- 172.21.15.123:0/997627022 shutdown_connections 2023-07-21T19:08:16.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.299+0000 7f358c63b700 1 -- 172.21.15.123:0/997627022 wait complete. 2023-07-21T19:08:16.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 Processor -- start 2023-07-21T19:08:16.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 -- start start 2023-07-21T19:08:16.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 0x7f3584154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406d860 0x7f35840ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35840c1e00 0x7f35840c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840ad1e0 con 0x7f358406be70 2023-07-21T19:08:16.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584154e80 con 0x7f35840c1e00 2023-07-21T19:08:16.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358c63b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840ac140 con 0x7f358406d860 2023-07-21T19:08:16.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 0x7f3584154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 0x7f3584154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51552/0 (socket says 172.21.15.123:51552) 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 -- 172.21.15.123:0/4178793007 learned_addr learned my addr 172.21.15.123:0/4178793007 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f3589bd6700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406d860 0x7f35840ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358abd8700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35840c1e00 0x7f35840c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 -- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406d860 msgr2=0x7f35840ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406d860 0x7f35840ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 -- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35840c1e00 msgr2=0x7f35840c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.303+0000 7f358a3d7700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35840c1e00 0x7f35840c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f358a3d7700 1 -- 172.21.15.123:0/4178793007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3580009570 con 0x7f358406be70 2023-07-21T19:08:16.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f3589bd6700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406d860 0x7f35840ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:16.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f358a3d7700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 0x7f3584154940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35840700e0 tx=0x7f3580004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:16.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580004240 con 0x7f358406be70 2023-07-21T19:08:16.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358001f070 con 0x7f358406be70 2023-07-21T19:08:16.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840ac420 con 0x7f358406be70 2023-07-21T19:08:16.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580004600 con 0x7f358406be70 2023-07-21T19:08:16.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35840ac9e0 con 0x7f358406be70 2023-07-21T19:08:16.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.307+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358404dcb0 con 0x7f358406be70 2023-07-21T19:08:16.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.311+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3580021030 con 0x7f358406be70 2023-07-21T19:08:16.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.311+0000 7f357affd700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35680662f0 0x7f35680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.311+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3580085230 con 0x7f358406be70 2023-07-21T19:08:16.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.311+0000 7f3589bd6700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35680662f0 0x7f35680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.311+0000 7f3589bd6700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35680662f0 0x7f35680687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f35840caae0 tx=0x7f3574009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:16.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.319+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f35800523b0 con 0x7f358406be70 2023-07-21T19:08:16.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.475+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 --> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35840cdf30 con 0x7f35680662f0 2023-07-21T19:08:16.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.491+0000 7f357affd700 1 -- 172.21.15.123:0/4178793007 <== mgr.4104 v2:172.21.15.123:6832/1650121890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367081 (secure 0 0 0) 0x7f3574011c20 con 0x7f35680662f0 2023-07-21T19:08:16.507 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:16.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35680662f0 msgr2=0x7f35680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35680662f0 0x7f35680687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f35840caae0 tx=0x7f3574009240 comp rx=0 tx=0).stop 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 msgr2=0x7f3584154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 0x7f3584154940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35840700e0 tx=0x7f3580004770 comp rx=0 tx=0).stop 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 shutdown_connections 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f35680662f0 0x7f35680687a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35840c1e00 0x7f35840c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f358406d860 0x7f35840ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 --2- 172.21.15.123:0/4178793007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f358406be70 0x7f3584154940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 >> 172.21.15.123:0/4178793007 conn(0x7f35840cad30 msgr2=0x7f35840703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 shutdown_connections 2023-07-21T19:08:16.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.499+0000 7f358c63b700 1 -- 172.21.15.123:0/4178793007 wait complete. 2023-07-21T19:08:16.514 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-07-21T19:08:16.537 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-21T19:08:15.889920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223304,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751416,"statfs":{"total":773094113280,"available":772865449984,"internally_reserved":0,"allocated":3678208,"data_stored":2186494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007025"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837152+0000","last_change":"2023-07-21T19:07:52.526013+0000","last_active":"2023-07-21T19:07:53.837152+0000","last_peered":"2023-07-21T19:07:53.837152+0000","last_clean":"2023-07-21T19:07:53.837152+0000","last_became_active":"2023-07-21T19:07:52.525619+0000","last_became_peered":"2023-07-21T19:07:52.525619+0000","last_unstale":"2023-07-21T19:07:53.837152+0000","last_undegraded":"2023-07-21T19:07:53.837152+0000","last_fullsized":"2023-07-21T19:07:53.837152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:21.893772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525160+0000","last_change":"2023-07-21T19:07:47.420098+0000","last_active":"2023-07-21T19:07:53.525160+0000","last_peered":"2023-07-21T19:07:53.525160+0000","last_clean":"2023-07-21T19:07:53.525160+0000","last_became_active":"2023-07-21T19:07:47.419764+0000","last_became_peered":"2023-07-21T19:07:47.419764+0000","last_unstale":"2023-07-21T19:07:53.525160+0000","last_undegraded":"2023-07-21T19:07:53.525160+0000","last_fullsized":"2023-07-21T19:07:53.525160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522584+0000","last_change":"2023-07-21T19:07:48.458192+0000","last_active":"2023-07-21T19:07:53.522584+0000","last_peered":"2023-07-21T19:07:53.522584+0000","last_clean":"2023-07-21T19:07:53.522584+0000","last_became_active":"2023-07-21T19:07:48.457841+0000","last_became_peered":"2023-07-21T19:07:48.457841+0000","last_unstale":"2023-07-21T19:07:53.522584+0000","last_undegraded":"2023-07-21T19:07:53.522584+0000","last_fullsized":"2023-07-21T19:07:53.522584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:34.793452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522466+0000","last_change":"2023-07-21T19:07:52.521292+0000","last_active":"2023-07-21T19:07:53.522466+0000","last_peered":"2023-07-21T19:07:53.522466+0000","last_clean":"2023-07-21T19:07:53.522466+0000","last_became_active":"2023-07-21T19:07:52.512373+0000","last_became_peered":"2023-07-21T19:07:52.512373+0000","last_unstale":"2023-07-21T19:07:53.522466+0000","last_undegraded":"2023-07-21T19:07:53.522466+0000","last_fullsized":"2023-07-21T19:07:53.522466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:16.920553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834575+0000","last_change":"2023-07-21T19:07:47.418823+0000","last_active":"2023-07-21T19:07:53.834575+0000","last_peered":"2023-07-21T19:07:53.834575+0000","last_clean":"2023-07-21T19:07:53.834575+0000","last_became_active":"2023-07-21T19:07:47.418529+0000","last_became_peered":"2023-07-21T19:07:47.418529+0000","last_unstale":"2023-07-21T19:07:53.834575+0000","last_undegraded":"2023-07-21T19:07:53.834575+0000","last_fullsized":"2023-07-21T19:07:53.834575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834847+0000","last_change":"2023-07-21T19:07:48.460406+0000","last_active":"2023-07-21T19:07:53.834847+0000","last_peered":"2023-07-21T19:07:53.834847+0000","last_clean":"2023-07-21T19:07:53.834847+0000","last_became_active":"2023-07-21T19:07:48.459868+0000","last_became_peered":"2023-07-21T19:07:48.459868+0000","last_unstale":"2023-07-21T19:07:53.834847+0000","last_undegraded":"2023-07-21T19:07:53.834847+0000","last_fullsized":"2023-07-21T19:07:53.834847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523950+0000","last_change":"2023-07-21T19:07:52.514421+0000","last_active":"2023-07-21T19:07:53.523950+0000","last_peered":"2023-07-21T19:07:53.523950+0000","last_clean":"2023-07-21T19:07:53.523950+0000","last_became_active":"2023-07-21T19:07:52.514037+0000","last_became_peered":"2023-07-21T19:07:52.514037+0000","last_unstale":"2023-07-21T19:07:53.523950+0000","last_undegraded":"2023-07-21T19:07:53.523950+0000","last_fullsized":"2023-07-21T19:07:53.523950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:16.918863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525195+0000","last_change":"2023-07-21T19:07:47.429875+0000","last_active":"2023-07-21T19:07:53.525195+0000","last_peered":"2023-07-21T19:07:53.525195+0000","last_clean":"2023-07-21T19:07:53.525195+0000","last_became_active":"2023-07-21T19:07:47.429597+0000","last_became_peered":"2023-07-21T19:07:47.429597+0000","last_unstale":"2023-07-21T19:07:53.525195+0000","last_undegraded":"2023-07-21T19:07:53.525195+0000","last_fullsized":"2023-07-21T19:07:53.525195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523434+0000","last_change":"2023-07-21T19:07:48.445883+0000","last_active":"2023-07-21T19:07:53.523434+0000","last_peered":"2023-07-21T19:07:53.523434+0000","last_clean":"2023-07-21T19:07:53.523434+0000","last_became_active":"2023-07-21T19:07:48.445660+0000","last_became_peered":"2023-07-21T19:07:48.445660+0000","last_unstale":"2023-07-21T19:07:53.523434+0000","last_undegraded":"2023-07-21T19:07:53.523434+0000","last_fullsized":"2023-07-21T19:07:53.523434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:52.906045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832775+0000","last_change":"2023-07-21T19:07:52.524081+0000","last_active":"2023-07-21T19:07:53.832775+0000","last_peered":"2023-07-21T19:07:53.832775+0000","last_clean":"2023-07-21T19:07:53.832775+0000","last_became_active":"2023-07-21T19:07:52.523354+0000","last_became_peered":"2023-07-21T19:07:52.523354+0000","last_unstale":"2023-07-21T19:07:53.832775+0000","last_undegraded":"2023-07-21T19:07:53.832775+0000","last_fullsized":"2023-07-21T19:07:53.832775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524027+0000","last_change":"2023-07-21T19:07:47.429333+0000","last_active":"2023-07-21T19:07:53.524027+0000","last_peered":"2023-07-21T19:07:53.524027+0000","last_clean":"2023-07-21T19:07:53.524027+0000","last_became_active":"2023-07-21T19:07:47.428959+0000","last_became_peered":"2023-07-21T19:07:47.428959+0000","last_unstale":"2023-07-21T19:07:53.524027+0000","last_undegraded":"2023-07-21T19:07:53.524027+0000","last_fullsized":"2023-07-21T19:07:53.524027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524172+0000","last_change":"2023-07-21T19:07:48.454559+0000","last_active":"2023-07-21T19:07:53.524172+0000","last_peered":"2023-07-21T19:07:53.524172+0000","last_clean":"2023-07-21T19:07:53.524172+0000","last_became_active":"2023-07-21T19:07:48.454270+0000","last_became_peered":"2023-07-21T19:07:48.454270+0000","last_unstale":"2023-07-21T19:07:53.524172+0000","last_undegraded":"2023-07-21T19:07:53.524172+0000","last_fullsized":"2023-07-21T19:07:53.524172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:14.890349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838309+0000","last_change":"2023-07-21T19:07:52.521872+0000","last_active":"2023-07-21T19:07:53.838309+0000","last_peered":"2023-07-21T19:07:53.838309+0000","last_clean":"2023-07-21T19:07:53.838309+0000","last_became_active":"2023-07-21T19:07:52.521417+0000","last_became_peered":"2023-07-21T19:07:52.521417+0000","last_unstale":"2023-07-21T19:07:53.838309+0000","last_undegraded":"2023-07-21T19:07:53.838309+0000","last_fullsized":"2023-07-21T19:07:53.838309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:57.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524569+0000","last_change":"2023-07-21T19:07:47.435498+0000","last_active":"2023-07-21T19:07:53.524569+0000","last_peered":"2023-07-21T19:07:53.524569+0000","last_clean":"2023-07-21T19:07:53.524569+0000","last_became_active":"2023-07-21T19:07:47.435167+0000","last_became_peered":"2023-07-21T19:07:47.435167+0000","last_unstale":"2023-07-21T19:07:53.524569+0000","last_undegraded":"2023-07-21T19:07:53.524569+0000","last_fullsized":"2023-07-21T19:07:53.524569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:28.227019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838212+0000","last_change":"2023-07-21T19:07:48.464638+0000","last_active":"2023-07-21T19:07:53.838212+0000","last_peered":"2023-07-21T19:07:53.838212+0000","last_clean":"2023-07-21T19:07:53.838212+0000","last_became_active":"2023-07-21T19:07:48.463719+0000","last_became_peered":"2023-07-21T19:07:48.463719+0000","last_unstale":"2023-07-21T19:07:53.838212+0000","last_undegraded":"2023-07-21T19:07:53.838212+0000","last_fullsized":"2023-07-21T19:07:53.838212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:59.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524735+0000","last_change":"2023-07-21T19:07:52.520166+0000","last_active":"2023-07-21T19:07:53.524735+0000","last_peered":"2023-07-21T19:07:53.524735+0000","last_clean":"2023-07-21T19:07:53.524735+0000","last_became_active":"2023-07-21T19:07:52.519664+0000","last_became_peered":"2023-07-21T19:07:52.519664+0000","last_unstale":"2023-07-21T19:07:53.524735+0000","last_undegraded":"2023-07-21T19:07:53.524735+0000","last_fullsized":"2023-07-21T19:07:53.524735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:12.671068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523715+0000","last_change":"2023-07-21T19:07:47.428335+0000","last_active":"2023-07-21T19:07:53.523715+0000","last_peered":"2023-07-21T19:07:53.523715+0000","last_clean":"2023-07-21T19:07:53.523715+0000","last_became_active":"2023-07-21T19:07:47.428024+0000","last_became_peered":"2023-07-21T19:07:47.428024+0000","last_unstale":"2023-07-21T19:07:53.523715+0000","last_undegraded":"2023-07-21T19:07:53.523715+0000","last_fullsized":"2023-07-21T19:07:53.523715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:06.868264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835070+0000","last_change":"2023-07-21T19:07:48.460771+0000","last_active":"2023-07-21T19:07:53.835070+0000","last_peered":"2023-07-21T19:07:53.835070+0000","last_clean":"2023-07-21T19:07:53.835070+0000","last_became_active":"2023-07-21T19:07:48.460408+0000","last_became_peered":"2023-07-21T19:07:48.460408+0000","last_unstale":"2023-07-21T19:07:53.835070+0000","last_undegraded":"2023-07-21T19:07:53.835070+0000","last_fullsized":"2023-07-21T19:07:53.835070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834859+0000","last_change":"2023-07-21T19:07:52.515758+0000","last_active":"2023-07-21T19:07:53.834859+0000","last_peered":"2023-07-21T19:07:53.834859+0000","last_clean":"2023-07-21T19:07:53.834859+0000","last_became_active":"2023-07-21T19:07:52.515364+0000","last_became_peered":"2023-07-21T19:07:52.515364+0000","last_unstale":"2023-07-21T19:07:53.834859+0000","last_undegraded":"2023-07-21T19:07:53.834859+0000","last_fullsized":"2023-07-21T19:07:53.834859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:32.112276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838565+0000","last_change":"2023-07-21T19:07:47.432465+0000","last_active":"2023-07-21T19:07:53.838565+0000","last_peered":"2023-07-21T19:07:53.838565+0000","last_clean":"2023-07-21T19:07:53.838565+0000","last_became_active":"2023-07-21T19:07:47.432078+0000","last_became_peered":"2023-07-21T19:07:47.432078+0000","last_unstale":"2023-07-21T19:07:53.838565+0000","last_undegraded":"2023-07-21T19:07:53.838565+0000","last_fullsized":"2023-07-21T19:07:53.838565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524687+0000","last_change":"2023-07-21T19:07:48.460469+0000","last_active":"2023-07-21T19:07:53.524687+0000","last_peered":"2023-07-21T19:07:53.524687+0000","last_clean":"2023-07-21T19:07:53.524687+0000","last_became_active":"2023-07-21T19:07:48.460211+0000","last_became_peered":"2023-07-21T19:07:48.460211+0000","last_unstale":"2023-07-21T19:07:53.524687+0000","last_undegraded":"2023-07-21T19:07:53.524687+0000","last_fullsized":"2023-07-21T19:07:53.524687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525137+0000","last_change":"2023-07-21T19:07:52.515243+0000","last_active":"2023-07-21T19:07:53.525137+0000","last_peered":"2023-07-21T19:07:53.525137+0000","last_clean":"2023-07-21T19:07:53.525137+0000","last_became_active":"2023-07-21T19:07:52.514858+0000","last_became_peered":"2023-07-21T19:07:52.514858+0000","last_unstale":"2023-07-21T19:07:53.525137+0000","last_undegraded":"2023-07-21T19:07:53.525137+0000","last_fullsized":"2023-07-21T19:07:53.525137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:48.667564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834262+0000","last_change":"2023-07-21T19:07:47.423653+0000","last_active":"2023-07-21T19:07:53.834262+0000","last_peered":"2023-07-21T19:07:53.834262+0000","last_clean":"2023-07-21T19:07:53.834262+0000","last_became_active":"2023-07-21T19:07:47.423336+0000","last_became_peered":"2023-07-21T19:07:47.423336+0000","last_unstale":"2023-07-21T19:07:53.834262+0000","last_undegraded":"2023-07-21T19:07:53.834262+0000","last_fullsized":"2023-07-21T19:07:53.834262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:43.201925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835020+0000","last_change":"2023-07-21T19:07:48.453898+0000","last_active":"2023-07-21T19:07:53.835020+0000","last_peered":"2023-07-21T19:07:53.835020+0000","last_clean":"2023-07-21T19:07:53.835020+0000","last_became_active":"2023-07-21T19:07:48.453048+0000","last_became_peered":"2023-07-21T19:07:48.453048+0000","last_unstale":"2023-07-21T19:07:53.835020+0000","last_undegraded":"2023-07-21T19:07:53.835020+0000","last_fullsized":"2023-07-21T19:07:53.835020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:02.564475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833703+0000","last_change":"2023-07-21T19:07:48.467565+0000","last_active":"2023-07-21T19:07:53.833703+0000","last_peered":"2023-07-21T19:07:53.833703+0000","last_clean":"2023-07-21T19:07:53.833703+0000","last_became_active":"2023-07-21T19:07:48.467121+0000","last_became_peered":"2023-07-21T19:07:48.467121+0000","last_unstale":"2023-07-21T19:07:53.833703+0000","last_undegraded":"2023-07-21T19:07:53.833703+0000","last_fullsized":"2023-07-21T19:07:53.833703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525240+0000","last_change":"2023-07-21T19:07:47.419807+0000","last_active":"2023-07-21T19:07:53.525240+0000","last_peered":"2023-07-21T19:07:53.525240+0000","last_clean":"2023-07-21T19:07:53.525240+0000","last_became_active":"2023-07-21T19:07:47.419458+0000","last_became_peered":"2023-07-21T19:07:47.419458+0000","last_unstale":"2023-07-21T19:07:53.525240+0000","last_undegraded":"2023-07-21T19:07:53.525240+0000","last_fullsized":"2023-07-21T19:07:53.525240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832798+0000","last_change":"2023-07-21T19:07:52.512833+0000","last_active":"2023-07-21T19:07:53.832798+0000","last_peered":"2023-07-21T19:07:53.832798+0000","last_clean":"2023-07-21T19:07:53.832798+0000","last_became_active":"2023-07-21T19:07:52.512452+0000","last_became_peered":"2023-07-21T19:07:52.512452+0000","last_unstale":"2023-07-21T19:07:53.832798+0000","last_undegraded":"2023-07-21T19:07:53.832798+0000","last_fullsized":"2023-07-21T19:07:53.832798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:18.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834692+0000","last_change":"2023-07-21T19:07:48.455667+0000","last_active":"2023-07-21T19:07:53.834692+0000","last_peered":"2023-07-21T19:07:53.834692+0000","last_clean":"2023-07-21T19:07:53.834692+0000","last_became_active":"2023-07-21T19:07:48.455414+0000","last_became_peered":"2023-07-21T19:07:48.455414+0000","last_unstale":"2023-07-21T19:07:53.834692+0000","last_undegraded":"2023-07-21T19:07:53.834692+0000","last_fullsized":"2023-07-21T19:07:53.834692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:59.756485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524944+0000","last_change":"2023-07-21T19:07:47.419752+0000","last_active":"2023-07-21T19:07:53.524944+0000","last_peered":"2023-07-21T19:07:53.524944+0000","last_clean":"2023-07-21T19:07:53.524944+0000","last_became_active":"2023-07-21T19:07:47.419344+0000","last_became_peered":"2023-07-21T19:07:47.419344+0000","last_unstale":"2023-07-21T19:07:53.524944+0000","last_undegraded":"2023-07-21T19:07:53.524944+0000","last_fullsized":"2023-07-21T19:07:53.524944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:35.799862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833166+0000","last_change":"2023-07-21T19:07:52.535682+0000","last_active":"2023-07-21T19:07:53.833166+0000","last_peered":"2023-07-21T19:07:53.833166+0000","last_clean":"2023-07-21T19:07:53.833166+0000","last_became_active":"2023-07-21T19:07:52.534938+0000","last_became_peered":"2023-07-21T19:07:52.534938+0000","last_unstale":"2023-07-21T19:07:53.833166+0000","last_undegraded":"2023-07-21T19:07:53.833166+0000","last_fullsized":"2023-07-21T19:07:53.833166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833508+0000","last_change":"2023-07-21T19:07:47.428893+0000","last_active":"2023-07-21T19:07:53.833508+0000","last_peered":"2023-07-21T19:07:53.833508+0000","last_clean":"2023-07-21T19:07:53.833508+0000","last_became_active":"2023-07-21T19:07:47.428562+0000","last_became_peered":"2023-07-21T19:07:47.428562+0000","last_unstale":"2023-07-21T19:07:53.833508+0000","last_undegraded":"2023-07-21T19:07:53.833508+0000","last_fullsized":"2023-07-21T19:07:53.833508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:26.575918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838495+0000","last_change":"2023-07-21T19:07:48.458970+0000","last_active":"2023-07-21T19:07:53.838495+0000","last_peered":"2023-07-21T19:07:53.838495+0000","last_clean":"2023-07-21T19:07:53.838495+0000","last_became_active":"2023-07-21T19:07:48.458737+0000","last_became_peered":"2023-07-21T19:07:48.458737+0000","last_unstale":"2023-07-21T19:07:53.838495+0000","last_undegraded":"2023-07-21T19:07:53.838495+0000","last_fullsized":"2023-07-21T19:07:53.838495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833652+0000","last_change":"2023-07-21T19:07:52.529054+0000","last_active":"2023-07-21T19:07:53.833652+0000","last_peered":"2023-07-21T19:07:53.833652+0000","last_clean":"2023-07-21T19:07:53.833652+0000","last_became_active":"2023-07-21T19:07:52.528619+0000","last_became_peered":"2023-07-21T19:07:52.528619+0000","last_unstale":"2023-07-21T19:07:53.833652+0000","last_undegraded":"2023-07-21T19:07:53.833652+0000","last_fullsized":"2023-07-21T19:07:53.833652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:44.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:08:06.078351+0000","last_change":"2023-07-21T19:07:47.424409+0000","last_active":"2023-07-21T19:08:06.078351+0000","last_peered":"2023-07-21T19:08:06.078351+0000","last_clean":"2023-07-21T19:08:06.078351+0000","last_became_active":"2023-07-21T19:07:47.424101+0000","last_became_peered":"2023-07-21T19:07:47.424101+0000","last_unstale":"2023-07-21T19:08:06.078351+0000","last_undegraded":"2023-07-21T19:08:06.078351+0000","last_fullsized":"2023-07-21T19:08:06.078351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:06:04.934694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524300+0000","last_change":"2023-07-21T19:07:48.458540+0000","last_active":"2023-07-21T19:07:53.524300+0000","last_peered":"2023-07-21T19:07:53.524300+0000","last_clean":"2023-07-21T19:07:53.524300+0000","last_became_active":"2023-07-21T19:07:48.458216+0000","last_became_peered":"2023-07-21T19:07:48.458216+0000","last_unstale":"2023-07-21T19:07:53.524300+0000","last_undegraded":"2023-07-21T19:07:53.524300+0000","last_fullsized":"2023-07-21T19:07:53.524300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:04.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838155+0000","last_change":"2023-07-21T19:07:52.525973+0000","last_active":"2023-07-21T19:07:53.838155+0000","last_peered":"2023-07-21T19:07:53.838155+0000","last_clean":"2023-07-21T19:07:53.838155+0000","last_became_active":"2023-07-21T19:07:52.525557+0000","last_became_peered":"2023-07-21T19:07:52.525557+0000","last_unstale":"2023-07-21T19:07:53.838155+0000","last_undegraded":"2023-07-21T19:07:53.838155+0000","last_fullsized":"2023-07-21T19:07:53.838155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:04.238744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522891+0000","last_change":"2023-07-21T19:07:48.450182+0000","last_active":"2023-07-21T19:07:53.522891+0000","last_peered":"2023-07-21T19:07:53.522891+0000","last_clean":"2023-07-21T19:07:53.522891+0000","last_became_active":"2023-07-21T19:07:48.449903+0000","last_became_peered":"2023-07-21T19:07:48.449903+0000","last_unstale":"2023-07-21T19:07:53.522891+0000","last_undegraded":"2023-07-21T19:07:53.522891+0000","last_fullsized":"2023-07-21T19:07:53.522891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:58.318651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835029+0000","last_change":"2023-07-21T19:07:42.363227+0000","last_active":"2023-07-21T19:07:53.835029+0000","last_peered":"2023-07-21T19:07:53.835029+0000","last_clean":"2023-07-21T19:07:53.835029+0000","last_became_active":"2023-07-21T19:07:42.362873+0000","last_became_peered":"2023-07-21T19:07:42.362873+0000","last_unstale":"2023-07-21T19:07:53.835029+0000","last_undegraded":"2023-07-21T19:07:53.835029+0000","last_fullsized":"2023-07-21T19:07:53.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:40.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525002+0000","last_change":"2023-07-21T19:07:47.423281+0000","last_active":"2023-07-21T19:07:53.525002+0000","last_peered":"2023-07-21T19:07:53.525002+0000","last_clean":"2023-07-21T19:07:53.525002+0000","last_became_active":"2023-07-21T19:07:47.422972+0000","last_became_peered":"2023-07-21T19:07:47.422972+0000","last_unstale":"2023-07-21T19:07:53.525002+0000","last_undegraded":"2023-07-21T19:07:53.525002+0000","last_fullsized":"2023-07-21T19:07:53.525002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833700+0000","last_change":"2023-07-21T19:07:52.538404+0000","last_active":"2023-07-21T19:07:53.833700+0000","last_peered":"2023-07-21T19:07:53.833700+0000","last_clean":"2023-07-21T19:07:53.833700+0000","last_became_active":"2023-07-21T19:07:52.537940+0000","last_became_peered":"2023-07-21T19:07:52.537940+0000","last_unstale":"2023-07-21T19:07:53.833700+0000","last_undegraded":"2023-07-21T19:07:53.833700+0000","last_fullsized":"2023-07-21T19:07:53.833700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833968+0000","last_change":"2023-07-21T19:07:48.462660+0000","last_active":"2023-07-21T19:07:53.833968+0000","last_peered":"2023-07-21T19:07:53.833968+0000","last_clean":"2023-07-21T19:07:53.833968+0000","last_became_active":"2023-07-21T19:07:48.461577+0000","last_became_peered":"2023-07-21T19:07:48.461577+0000","last_unstale":"2023-07-21T19:07:53.833968+0000","last_undegraded":"2023-07-21T19:07:53.833968+0000","last_fullsized":"2023-07-21T19:07:53.833968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838321+0000","last_change":"2023-07-21T19:07:42.367585+0000","last_active":"2023-07-21T19:07:53.838321+0000","last_peered":"2023-07-21T19:07:53.838321+0000","last_clean":"2023-07-21T19:07:53.838321+0000","last_became_active":"2023-07-21T19:07:42.367246+0000","last_became_peered":"2023-07-21T19:07:42.367246+0000","last_unstale":"2023-07-21T19:07:53.838321+0000","last_undegraded":"2023-07-21T19:07:53.838321+0000","last_fullsized":"2023-07-21T19:07:53.838321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:03.305963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835676+0000","last_change":"2023-07-21T19:07:47.423871+0000","last_active":"2023-07-21T19:07:53.835676+0000","last_peered":"2023-07-21T19:07:53.835676+0000","last_clean":"2023-07-21T19:07:53.835676+0000","last_became_active":"2023-07-21T19:07:47.423601+0000","last_became_peered":"2023-07-21T19:07:47.423601+0000","last_unstale":"2023-07-21T19:07:53.835676+0000","last_undegraded":"2023-07-21T19:07:53.835676+0000","last_fullsized":"2023-07-21T19:07:53.835676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522467+0000","last_change":"2023-07-21T19:07:52.520565+0000","last_active":"2023-07-21T19:07:53.522467+0000","last_peered":"2023-07-21T19:07:53.522467+0000","last_clean":"2023-07-21T19:07:53.522467+0000","last_became_active":"2023-07-21T19:07:52.519706+0000","last_became_peered":"2023-07-21T19:07:52.519706+0000","last_unstale":"2023-07-21T19:07:53.522467+0000","last_undegraded":"2023-07-21T19:07:53.522467+0000","last_fullsized":"2023-07-21T19:07:53.522467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:16.197136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523919+0000","last_change":"2023-07-21T19:07:48.453983+0000","last_active":"2023-07-21T19:07:53.523919+0000","last_peered":"2023-07-21T19:07:53.523919+0000","last_clean":"2023-07-21T19:07:53.523919+0000","last_became_active":"2023-07-21T19:07:48.453574+0000","last_became_peered":"2023-07-21T19:07:48.453574+0000","last_unstale":"2023-07-21T19:07:53.523919+0000","last_undegraded":"2023-07-21T19:07:53.523919+0000","last_fullsized":"2023-07-21T19:07:53.523919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833947+0000","last_change":"2023-07-21T19:07:42.365391+0000","last_active":"2023-07-21T19:07:53.833947+0000","last_peered":"2023-07-21T19:07:53.833947+0000","last_clean":"2023-07-21T19:07:53.833947+0000","last_became_active":"2023-07-21T19:07:42.364406+0000","last_became_peered":"2023-07-21T19:07:42.364406+0000","last_unstale":"2023-07-21T19:07:53.833947+0000","last_undegraded":"2023-07-21T19:07:53.833947+0000","last_fullsized":"2023-07-21T19:07:53.833947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:30.769824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837437+0000","last_change":"2023-07-21T19:07:47.425674+0000","last_active":"2023-07-21T19:07:53.837437+0000","last_peered":"2023-07-21T19:07:53.837437+0000","last_clean":"2023-07-21T19:07:53.837437+0000","last_became_active":"2023-07-21T19:07:47.425400+0000","last_became_peered":"2023-07-21T19:07:47.425400+0000","last_unstale":"2023-07-21T19:07:53.837437+0000","last_undegraded":"2023-07-21T19:07:53.837437+0000","last_fullsized":"2023-07-21T19:07:53.837437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:35.849154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832757+0000","last_change":"2023-07-21T19:07:52.521137+0000","last_active":"2023-07-21T19:07:53.832757+0000","last_peered":"2023-07-21T19:07:53.832757+0000","last_clean":"2023-07-21T19:07:53.832757+0000","last_became_active":"2023-07-21T19:07:52.520674+0000","last_became_peered":"2023-07-21T19:07:52.520674+0000","last_unstale":"2023-07-21T19:07:53.832757+0000","last_undegraded":"2023-07-21T19:07:53.832757+0000","last_fullsized":"2023-07-21T19:07:53.832757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:00.674447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838395+0000","last_change":"2023-07-21T19:07:48.456486+0000","last_active":"2023-07-21T19:07:53.838395+0000","last_peered":"2023-07-21T19:07:53.838395+0000","last_clean":"2023-07-21T19:07:53.838395+0000","last_became_active":"2023-07-21T19:07:48.456220+0000","last_became_peered":"2023-07-21T19:07:48.456220+0000","last_unstale":"2023-07-21T19:07:53.838395+0000","last_undegraded":"2023-07-21T19:07:53.838395+0000","last_fullsized":"2023-07-21T19:07:53.838395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837749+0000","last_change":"2023-07-21T19:07:42.367917+0000","last_active":"2023-07-21T19:07:53.837749+0000","last_peered":"2023-07-21T19:07:53.837749+0000","last_clean":"2023-07-21T19:07:53.837749+0000","last_became_active":"2023-07-21T19:07:42.367308+0000","last_became_peered":"2023-07-21T19:07:42.367308+0000","last_unstale":"2023-07-21T19:07:53.837749+0000","last_undegraded":"2023-07-21T19:07:53.837749+0000","last_fullsized":"2023-07-21T19:07:53.837749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:35.449270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525321+0000","last_change":"2023-07-21T19:07:47.423617+0000","last_active":"2023-07-21T19:07:53.525321+0000","last_peered":"2023-07-21T19:07:53.525321+0000","last_clean":"2023-07-21T19:07:53.525321+0000","last_became_active":"2023-07-21T19:07:47.423355+0000","last_became_peered":"2023-07-21T19:07:47.423355+0000","last_unstale":"2023-07-21T19:07:53.525321+0000","last_undegraded":"2023-07-21T19:07:53.525321+0000","last_fullsized":"2023-07-21T19:07:53.525321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523743+0000","last_change":"2023-07-21T19:07:52.528456+0000","last_active":"2023-07-21T19:07:53.523743+0000","last_peered":"2023-07-21T19:07:53.523743+0000","last_clean":"2023-07-21T19:07:53.523743+0000","last_became_active":"2023-07-21T19:07:52.528085+0000","last_became_peered":"2023-07-21T19:07:52.528085+0000","last_unstale":"2023-07-21T19:07:53.523743+0000","last_undegraded":"2023-07-21T19:07:53.523743+0000","last_fullsized":"2023-07-21T19:07:53.523743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:25.346160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837279+0000","last_change":"2023-07-21T19:07:48.467636+0000","last_active":"2023-07-21T19:07:53.837279+0000","last_peered":"2023-07-21T19:07:53.837279+0000","last_clean":"2023-07-21T19:07:53.837279+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.837279+0000","last_undegraded":"2023-07-21T19:07:53.837279+0000","last_fullsized":"2023-07-21T19:07:53.837279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:21.256996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524424+0000","last_change":"2023-07-21T19:07:47.424470+0000","last_active":"2023-07-21T19:07:53.524424+0000","last_peered":"2023-07-21T19:07:53.524424+0000","last_clean":"2023-07-21T19:07:53.524424+0000","last_became_active":"2023-07-21T19:07:47.424180+0000","last_became_peered":"2023-07-21T19:07:47.424180+0000","last_unstale":"2023-07-21T19:07:53.524424+0000","last_undegraded":"2023-07-21T19:07:53.524424+0000","last_fullsized":"2023-07-21T19:07:53.524424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:06.662020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523611+0000","last_change":"2023-07-21T19:07:42.362561+0000","last_active":"2023-07-21T19:07:53.523611+0000","last_peered":"2023-07-21T19:07:53.523611+0000","last_clean":"2023-07-21T19:07:53.523611+0000","last_became_active":"2023-07-21T19:07:42.362127+0000","last_became_peered":"2023-07-21T19:07:42.362127+0000","last_unstale":"2023-07-21T19:07:53.523611+0000","last_undegraded":"2023-07-21T19:07:53.523611+0000","last_fullsized":"2023-07-21T19:07:53.523611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:35.933835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524354+0000","last_change":"2023-07-21T19:07:52.516158+0000","last_active":"2023-07-21T19:07:53.524354+0000","last_peered":"2023-07-21T19:07:53.524354+0000","last_clean":"2023-07-21T19:07:53.524354+0000","last_became_active":"2023-07-21T19:07:52.515733+0000","last_became_peered":"2023-07-21T19:07:52.515733+0000","last_unstale":"2023-07-21T19:07:53.524354+0000","last_undegraded":"2023-07-21T19:07:53.524354+0000","last_fullsized":"2023-07-21T19:07:53.524354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837125+0000","last_change":"2023-07-21T19:07:48.456327+0000","last_active":"2023-07-21T19:07:53.837125+0000","last_peered":"2023-07-21T19:07:53.837125+0000","last_clean":"2023-07-21T19:07:53.837125+0000","last_became_active":"2023-07-21T19:07:48.456006+0000","last_became_peered":"2023-07-21T19:07:48.456006+0000","last_unstale":"2023-07-21T19:07:53.837125+0000","last_undegraded":"2023-07-21T19:07:53.837125+0000","last_fullsized":"2023-07-21T19:07:53.837125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:29.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836564+0000","last_change":"2023-07-21T19:07:47.421721+0000","last_active":"2023-07-21T19:07:53.836564+0000","last_peered":"2023-07-21T19:07:53.836564+0000","last_clean":"2023-07-21T19:07:53.836564+0000","last_became_active":"2023-07-21T19:07:47.421381+0000","last_became_peered":"2023-07-21T19:07:47.421381+0000","last_unstale":"2023-07-21T19:07:53.836564+0000","last_undegraded":"2023-07-21T19:07:53.836564+0000","last_fullsized":"2023-07-21T19:07:53.836564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:39.711801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836660+0000","last_change":"2023-07-21T19:07:42.603235+0000","last_active":"2023-07-21T19:07:53.836660+0000","last_peered":"2023-07-21T19:07:53.836660+0000","last_clean":"2023-07-21T19:07:53.836660+0000","last_became_active":"2023-07-21T19:07:42.602762+0000","last_became_peered":"2023-07-21T19:07:42.602762+0000","last_unstale":"2023-07-21T19:07:53.836660+0000","last_undegraded":"2023-07-21T19:07:53.836660+0000","last_fullsized":"2023-07-21T19:07:53.836660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:30:32.377809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838524+0000","last_change":"2023-07-21T19:07:52.527041+0000","last_active":"2023-07-21T19:07:53.838524+0000","last_peered":"2023-07-21T19:07:53.838524+0000","last_clean":"2023-07-21T19:07:53.838524+0000","last_became_active":"2023-07-21T19:07:52.526709+0000","last_became_peered":"2023-07-21T19:07:52.526709+0000","last_unstale":"2023-07-21T19:07:53.838524+0000","last_undegraded":"2023-07-21T19:07:53.838524+0000","last_fullsized":"2023-07-21T19:07:53.838524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:39.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524830+0000","last_change":"2023-07-21T19:07:48.463144+0000","last_active":"2023-07-21T19:07:53.524830+0000","last_peered":"2023-07-21T19:07:53.524830+0000","last_clean":"2023-07-21T19:07:53.524830+0000","last_became_active":"2023-07-21T19:07:48.462845+0000","last_became_peered":"2023-07-21T19:07:48.462845+0000","last_unstale":"2023-07-21T19:07:53.524830+0000","last_undegraded":"2023-07-21T19:07:53.524830+0000","last_fullsized":"2023-07-21T19:07:53.524830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:09.348453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523238+0000","last_change":"2023-07-21T19:07:47.431757+0000","last_active":"2023-07-21T19:07:53.523238+0000","last_peered":"2023-07-21T19:07:53.523238+0000","last_clean":"2023-07-21T19:07:53.523238+0000","last_became_active":"2023-07-21T19:07:47.431418+0000","last_became_peered":"2023-07-21T19:07:47.431418+0000","last_unstale":"2023-07-21T19:07:53.523238+0000","last_undegraded":"2023-07-21T19:07:53.523238+0000","last_fullsized":"2023-07-21T19:07:53.523238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:29.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832922+0000","last_change":"2023-07-21T19:07:42.365054+0000","last_active":"2023-07-21T19:07:53.832922+0000","last_peered":"2023-07-21T19:07:53.832922+0000","last_clean":"2023-07-21T19:07:53.832922+0000","last_became_active":"2023-07-21T19:07:42.364497+0000","last_became_peered":"2023-07-21T19:07:42.364497+0000","last_unstale":"2023-07-21T19:07:53.832922+0000","last_undegraded":"2023-07-21T19:07:53.832922+0000","last_fullsized":"2023-07-21T19:07:53.832922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:14.792794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525146+0000","last_change":"2023-07-21T19:07:52.521002+0000","last_active":"2023-07-21T19:07:53.525146+0000","last_peered":"2023-07-21T19:07:53.525146+0000","last_clean":"2023-07-21T19:07:53.525146+0000","last_became_active":"2023-07-21T19:07:52.520183+0000","last_became_peered":"2023-07-21T19:07:52.520183+0000","last_unstale":"2023-07-21T19:07:53.525146+0000","last_undegraded":"2023-07-21T19:07:53.525146+0000","last_fullsized":"2023-07-21T19:07:53.525146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:04.157404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835018+0000","last_change":"2023-07-21T19:07:48.450486+0000","last_active":"2023-07-21T19:07:53.835018+0000","last_peered":"2023-07-21T19:07:53.835018+0000","last_clean":"2023-07-21T19:07:53.835018+0000","last_became_active":"2023-07-21T19:07:48.450113+0000","last_became_peered":"2023-07-21T19:07:48.450113+0000","last_unstale":"2023-07-21T19:07:53.835018+0000","last_undegraded":"2023-07-21T19:07:53.835018+0000","last_fullsized":"2023-07-21T19:07:53.835018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:42.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834245+0000","last_change":"2023-07-21T19:07:47.423195+0000","last_active":"2023-07-21T19:07:53.834245+0000","last_peered":"2023-07-21T19:07:53.834245+0000","last_clean":"2023-07-21T19:07:53.834245+0000","last_became_active":"2023-07-21T19:07:47.422860+0000","last_became_peered":"2023-07-21T19:07:47.422860+0000","last_unstale":"2023-07-21T19:07:53.834245+0000","last_undegraded":"2023-07-21T19:07:53.834245+0000","last_fullsized":"2023-07-21T19:07:53.834245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:55.435800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524131+0000","last_change":"2023-07-21T19:07:42.362560+0000","last_active":"2023-07-21T19:07:53.524131+0000","last_peered":"2023-07-21T19:07:53.524131+0000","last_clean":"2023-07-21T19:07:53.524131+0000","last_became_active":"2023-07-21T19:07:42.362066+0000","last_became_peered":"2023-07-21T19:07:42.362066+0000","last_unstale":"2023-07-21T19:07:53.524131+0000","last_undegraded":"2023-07-21T19:07:53.524131+0000","last_fullsized":"2023-07-21T19:07:53.524131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:45.371360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833450+0000","last_change":"2023-07-21T19:07:37.495346+0000","last_active":"2023-07-21T19:07:53.833450+0000","last_peered":"2023-07-21T19:07:53.833450+0000","last_clean":"2023-07-21T19:07:53.833450+0000","last_became_active":"2023-07-21T19:07:37.492842+0000","last_became_peered":"2023-07-21T19:07:37.492842+0000","last_unstale":"2023-07-21T19:07:53.833450+0000","last_undegraded":"2023-07-21T19:07:53.833450+0000","last_fullsized":"2023-07-21T19:07:53.833450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_clean_scrub_stamp":"2023-07-21T19:07:36.226507+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:43.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833439+0000","last_change":"2023-07-21T19:07:52.522487+0000","last_active":"2023-07-21T19:07:53.833439+0000","last_peered":"2023-07-21T19:07:53.833439+0000","last_clean":"2023-07-21T19:07:53.833439+0000","last_became_active":"2023-07-21T19:07:52.522124+0000","last_became_peered":"2023-07-21T19:07:52.522124+0000","last_unstale":"2023-07-21T19:07:53.833439+0000","last_undegraded":"2023-07-21T19:07:53.833439+0000","last_fullsized":"2023-07-21T19:07:53.833439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836991+0000","last_change":"2023-07-21T19:07:48.464190+0000","last_active":"2023-07-21T19:07:53.836991+0000","last_peered":"2023-07-21T19:07:53.836991+0000","last_clean":"2023-07-21T19:07:53.836991+0000","last_became_active":"2023-07-21T19:07:48.463260+0000","last_became_peered":"2023-07-21T19:07:48.463260+0000","last_unstale":"2023-07-21T19:07:53.836991+0000","last_undegraded":"2023-07-21T19:07:53.836991+0000","last_fullsized":"2023-07-21T19:07:53.836991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:30.223087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834539+0000","last_change":"2023-07-21T19:07:47.423593+0000","last_active":"2023-07-21T19:07:53.834539+0000","last_peered":"2023-07-21T19:07:53.834539+0000","last_clean":"2023-07-21T19:07:53.834539+0000","last_became_active":"2023-07-21T19:07:47.423276+0000","last_became_peered":"2023-07-21T19:07:47.423276+0000","last_unstale":"2023-07-21T19:07:53.834539+0000","last_undegraded":"2023-07-21T19:07:53.834539+0000","last_fullsized":"2023-07-21T19:07:53.834539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525405+0000","last_change":"2023-07-21T19:07:52.529461+0000","last_active":"2023-07-21T19:07:53.525405+0000","last_peered":"2023-07-21T19:07:53.525405+0000","last_clean":"2023-07-21T19:07:53.525405+0000","last_became_active":"2023-07-21T19:07:52.528852+0000","last_became_peered":"2023-07-21T19:07:52.528852+0000","last_unstale":"2023-07-21T19:07:53.525405+0000","last_undegraded":"2023-07-21T19:07:53.525405+0000","last_fullsized":"2023-07-21T19:07:53.525405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:30.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525377+0000","last_change":"2023-07-21T19:07:48.458201+0000","last_active":"2023-07-21T19:07:53.525377+0000","last_peered":"2023-07-21T19:07:53.525377+0000","last_clean":"2023-07-21T19:07:53.525377+0000","last_became_active":"2023-07-21T19:07:48.457846+0000","last_became_peered":"2023-07-21T19:07:48.457846+0000","last_unstale":"2023-07-21T19:07:53.525377+0000","last_undegraded":"2023-07-21T19:07:53.525377+0000","last_fullsized":"2023-07-21T19:07:53.525377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:09.687359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522942+0000","last_change":"2023-07-21T19:07:47.425071+0000","last_active":"2023-07-21T19:07:53.522942+0000","last_peered":"2023-07-21T19:07:53.522942+0000","last_clean":"2023-07-21T19:07:53.522942+0000","last_became_active":"2023-07-21T19:07:47.424794+0000","last_became_peered":"2023-07-21T19:07:47.424794+0000","last_unstale":"2023-07-21T19:07:53.522942+0000","last_undegraded":"2023-07-21T19:07:53.522942+0000","last_fullsized":"2023-07-21T19:07:53.522942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:51:34.225679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524727+0000","last_change":"2023-07-21T19:07:52.521246+0000","last_active":"2023-07-21T19:07:53.524727+0000","last_peered":"2023-07-21T19:07:53.524727+0000","last_clean":"2023-07-21T19:07:53.524727+0000","last_became_active":"2023-07-21T19:07:52.520645+0000","last_became_peered":"2023-07-21T19:07:52.520645+0000","last_unstale":"2023-07-21T19:07:53.524727+0000","last_undegraded":"2023-07-21T19:07:53.524727+0000","last_fullsized":"2023-07-21T19:07:53.524727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524230+0000","last_change":"2023-07-21T19:07:48.461186+0000","last_active":"2023-07-21T19:07:53.524230+0000","last_peered":"2023-07-21T19:07:53.524230+0000","last_clean":"2023-07-21T19:07:53.524230+0000","last_became_active":"2023-07-21T19:07:48.460686+0000","last_became_peered":"2023-07-21T19:07:48.460686+0000","last_unstale":"2023-07-21T19:07:53.524230+0000","last_undegraded":"2023-07-21T19:07:53.524230+0000","last_fullsized":"2023-07-21T19:07:53.524230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:34.225618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834185+0000","last_change":"2023-07-21T19:07:47.429361+0000","last_active":"2023-07-21T19:07:53.834185+0000","last_peered":"2023-07-21T19:07:53.834185+0000","last_clean":"2023-07-21T19:07:53.834185+0000","last_became_active":"2023-07-21T19:07:47.429045+0000","last_became_peered":"2023-07-21T19:07:47.429045+0000","last_unstale":"2023-07-21T19:07:53.834185+0000","last_undegraded":"2023-07-21T19:07:53.834185+0000","last_fullsized":"2023-07-21T19:07:53.834185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:46.738002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836869+0000","last_change":"2023-07-21T19:07:52.519252+0000","last_active":"2023-07-21T19:07:53.836869+0000","last_peered":"2023-07-21T19:07:53.836869+0000","last_clean":"2023-07-21T19:07:53.836869+0000","last_became_active":"2023-07-21T19:07:52.518688+0000","last_became_peered":"2023-07-21T19:07:52.518688+0000","last_unstale":"2023-07-21T19:07:53.836869+0000","last_undegraded":"2023-07-21T19:07:53.836869+0000","last_fullsized":"2023-07-21T19:07:53.836869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:50.938236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525123+0000","last_change":"2023-07-21T19:07:48.447289+0000","last_active":"2023-07-21T19:07:53.525123+0000","last_peered":"2023-07-21T19:07:53.525123+0000","last_clean":"2023-07-21T19:07:53.525123+0000","last_became_active":"2023-07-21T19:07:48.446841+0000","last_became_peered":"2023-07-21T19:07:48.446841+0000","last_unstale":"2023-07-21T19:07:53.525123+0000","last_undegraded":"2023-07-21T19:07:53.525123+0000","last_fullsized":"2023-07-21T19:07:53.525123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:02.284757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834212+0000","last_change":"2023-07-21T19:07:47.428249+0000","last_active":"2023-07-21T19:07:53.834212+0000","last_peered":"2023-07-21T19:07:53.834212+0000","last_clean":"2023-07-21T19:07:53.834212+0000","last_became_active":"2023-07-21T19:07:47.425547+0000","last_became_peered":"2023-07-21T19:07:47.425547+0000","last_unstale":"2023-07-21T19:07:53.834212+0000","last_undegraded":"2023-07-21T19:07:53.834212+0000","last_fullsized":"2023-07-21T19:07:53.834212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:08.336001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836450+0000","last_change":"2023-07-21T19:07:52.527359+0000","last_active":"2023-07-21T19:07:53.836450+0000","last_peered":"2023-07-21T19:07:53.836450+0000","last_clean":"2023-07-21T19:07:53.836450+0000","last_became_active":"2023-07-21T19:07:52.526874+0000","last_became_peered":"2023-07-21T19:07:52.526874+0000","last_unstale":"2023-07-21T19:07:53.836450+0000","last_undegraded":"2023-07-21T19:07:53.836450+0000","last_fullsized":"2023-07-21T19:07:53.836450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:31:40.974408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523734+0000","last_change":"2023-07-21T19:07:48.455173+0000","last_active":"2023-07-21T19:07:53.523734+0000","last_peered":"2023-07-21T19:07:53.523734+0000","last_clean":"2023-07-21T19:07:53.523734+0000","last_became_active":"2023-07-21T19:07:48.454831+0000","last_became_peered":"2023-07-21T19:07:48.454831+0000","last_unstale":"2023-07-21T19:07:53.523734+0000","last_undegraded":"2023-07-21T19:07:53.523734+0000","last_fullsized":"2023-07-21T19:07:53.523734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:36.861607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524469+0000","last_change":"2023-07-21T19:07:47.423659+0000","last_active":"2023-07-21T19:07:53.524469+0000","last_peered":"2023-07-21T19:07:53.524469+0000","last_clean":"2023-07-21T19:07:53.524469+0000","last_became_active":"2023-07-21T19:07:47.423361+0000","last_became_peered":"2023-07-21T19:07:47.423361+0000","last_unstale":"2023-07-21T19:07:53.524469+0000","last_undegraded":"2023-07-21T19:07:53.524469+0000","last_fullsized":"2023-07-21T19:07:53.524469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:39.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837028+0000","last_change":"2023-07-21T19:07:52.521996+0000","last_active":"2023-07-21T19:07:53.837028+0000","last_peered":"2023-07-21T19:07:53.837028+0000","last_clean":"2023-07-21T19:07:53.837028+0000","last_became_active":"2023-07-21T19:07:52.521602+0000","last_became_peered":"2023-07-21T19:07:52.521602+0000","last_unstale":"2023-07-21T19:07:53.837028+0000","last_undegraded":"2023-07-21T19:07:53.837028+0000","last_fullsized":"2023-07-21T19:07:53.837028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:10.532572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833328+0000","last_change":"2023-07-21T19:07:48.467352+0000","last_active":"2023-07-21T19:07:53.833328+0000","last_peered":"2023-07-21T19:07:53.833328+0000","last_clean":"2023-07-21T19:07:53.833328+0000","last_became_active":"2023-07-21T19:07:48.467124+0000","last_became_peered":"2023-07-21T19:07:48.467124+0000","last_unstale":"2023-07-21T19:07:53.833328+0000","last_undegraded":"2023-07-21T19:07:53.833328+0000","last_fullsized":"2023-07-21T19:07:53.833328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:00:50.853377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833618+0000","last_change":"2023-07-21T19:07:47.419617+0000","last_active":"2023-07-21T19:07:53.833618+0000","last_peered":"2023-07-21T19:07:53.833618+0000","last_clean":"2023-07-21T19:07:53.833618+0000","last_became_active":"2023-07-21T19:07:47.419364+0000","last_became_peered":"2023-07-21T19:07:47.419364+0000","last_unstale":"2023-07-21T19:07:53.833618+0000","last_undegraded":"2023-07-21T19:07:53.833618+0000","last_fullsized":"2023-07-21T19:07:53.833618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:09.580592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837324+0000","last_change":"2023-07-21T19:07:52.529056+0000","last_active":"2023-07-21T19:07:53.837324+0000","last_peered":"2023-07-21T19:07:53.837324+0000","last_clean":"2023-07-21T19:07:53.837324+0000","last_became_active":"2023-07-21T19:07:52.528625+0000","last_became_peered":"2023-07-21T19:07:52.528625+0000","last_unstale":"2023-07-21T19:07:53.837324+0000","last_undegraded":"2023-07-21T19:07:53.837324+0000","last_fullsized":"2023-07-21T19:07:53.837324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:18:02.894869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522766+0000","last_change":"2023-07-21T19:07:48.448246+0000","last_active":"2023-07-21T19:07:53.522766+0000","last_peered":"2023-07-21T19:07:53.522766+0000","last_clean":"2023-07-21T19:07:53.522766+0000","last_became_active":"2023-07-21T19:07:48.447965+0000","last_became_peered":"2023-07-21T19:07:48.447965+0000","last_unstale":"2023-07-21T19:07:53.522766+0000","last_undegraded":"2023-07-21T19:07:53.522766+0000","last_fullsized":"2023-07-21T19:07:53.522766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:21.169814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833962+0000","last_change":"2023-07-21T19:07:47.431735+0000","last_active":"2023-07-21T19:07:53.833962+0000","last_peered":"2023-07-21T19:07:53.833962+0000","last_clean":"2023-07-21T19:07:53.833962+0000","last_became_active":"2023-07-21T19:07:47.431420+0000","last_became_peered":"2023-07-21T19:07:47.431420+0000","last_unstale":"2023-07-21T19:07:53.833962+0000","last_undegraded":"2023-07-21T19:07:53.833962+0000","last_fullsized":"2023-07-21T19:07:53.833962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:00.446483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836462+0000","last_change":"2023-07-21T19:07:52.516923+0000","last_active":"2023-07-21T19:07:53.836462+0000","last_peered":"2023-07-21T19:07:53.836462+0000","last_clean":"2023-07-21T19:07:53.836462+0000","last_became_active":"2023-07-21T19:07:52.516533+0000","last_became_peered":"2023-07-21T19:07:52.516533+0000","last_unstale":"2023-07-21T19:07:53.836462+0000","last_undegraded":"2023-07-21T19:07:53.836462+0000","last_fullsized":"2023-07-21T19:07:53.836462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:22.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523297+0000","last_change":"2023-07-21T19:07:48.459424+0000","last_active":"2023-07-21T19:07:53.523297+0000","last_peered":"2023-07-21T19:07:53.523297+0000","last_clean":"2023-07-21T19:07:53.523297+0000","last_became_active":"2023-07-21T19:07:48.459144+0000","last_became_peered":"2023-07-21T19:07:48.459144+0000","last_unstale":"2023-07-21T19:07:53.523297+0000","last_undegraded":"2023-07-21T19:07:53.523297+0000","last_fullsized":"2023-07-21T19:07:53.523297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834289+0000","last_change":"2023-07-21T19:07:47.429355+0000","last_active":"2023-07-21T19:07:53.834289+0000","last_peered":"2023-07-21T19:07:53.834289+0000","last_clean":"2023-07-21T19:07:53.834289+0000","last_became_active":"2023-07-21T19:07:47.429099+0000","last_became_peered":"2023-07-21T19:07:47.429099+0000","last_unstale":"2023-07-21T19:07:53.834289+0000","last_undegraded":"2023-07-21T19:07:53.834289+0000","last_fullsized":"2023-07-21T19:07:53.834289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833072+0000","last_change":"2023-07-21T19:07:52.535684+0000","last_active":"2023-07-21T19:07:53.833072+0000","last_peered":"2023-07-21T19:07:53.833072+0000","last_clean":"2023-07-21T19:07:53.833072+0000","last_became_active":"2023-07-21T19:07:52.534977+0000","last_became_peered":"2023-07-21T19:07:52.534977+0000","last_unstale":"2023-07-21T19:07:53.833072+0000","last_undegraded":"2023-07-21T19:07:53.833072+0000","last_fullsized":"2023-07-21T19:07:53.833072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:55.503014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524655+0000","last_change":"2023-07-21T19:07:52.524161+0000","last_active":"2023-07-21T19:07:53.524655+0000","last_peered":"2023-07-21T19:07:53.524655+0000","last_clean":"2023-07-21T19:07:53.524655+0000","last_became_active":"2023-07-21T19:07:52.521210+0000","last_became_peered":"2023-07-21T19:07:52.521210+0000","last_unstale":"2023-07-21T19:07:53.524655+0000","last_undegraded":"2023-07-21T19:07:53.524655+0000","last_fullsized":"2023-07-21T19:07:53.524655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833020+0000","last_change":"2023-07-21T19:07:47.415004+0000","last_active":"2023-07-21T19:07:53.833020+0000","last_peered":"2023-07-21T19:07:53.833020+0000","last_clean":"2023-07-21T19:07:53.833020+0000","last_became_active":"2023-07-21T19:07:47.414722+0000","last_became_peered":"2023-07-21T19:07:47.414722+0000","last_unstale":"2023-07-21T19:07:53.833020+0000","last_undegraded":"2023-07-21T19:07:53.833020+0000","last_fullsized":"2023-07-21T19:07:53.833020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:24.856635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835510+0000","last_change":"2023-07-21T19:07:48.455578+0000","last_active":"2023-07-21T19:07:53.835510+0000","last_peered":"2023-07-21T19:07:53.835510+0000","last_clean":"2023-07-21T19:07:53.835510+0000","last_became_active":"2023-07-21T19:07:48.455308+0000","last_became_peered":"2023-07-21T19:07:48.455308+0000","last_unstale":"2023-07-21T19:07:53.835510+0000","last_undegraded":"2023-07-21T19:07:53.835510+0000","last_fullsized":"2023-07-21T19:07:53.835510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835286+0000","last_change":"2023-07-21T19:07:52.523627+0000","last_active":"2023-07-21T19:07:53.835286+0000","last_peered":"2023-07-21T19:07:53.835286+0000","last_clean":"2023-07-21T19:07:53.835286+0000","last_became_active":"2023-07-21T19:07:52.523029+0000","last_became_peered":"2023-07-21T19:07:52.523029+0000","last_unstale":"2023-07-21T19:07:53.835286+0000","last_undegraded":"2023-07-21T19:07:53.835286+0000","last_fullsized":"2023-07-21T19:07:53.835286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833239+0000","last_change":"2023-07-21T19:07:47.431726+0000","last_active":"2023-07-21T19:07:53.833239+0000","last_peered":"2023-07-21T19:07:53.833239+0000","last_clean":"2023-07-21T19:07:53.833239+0000","last_became_active":"2023-07-21T19:07:47.431482+0000","last_became_peered":"2023-07-21T19:07:47.431482+0000","last_unstale":"2023-07-21T19:07:53.833239+0000","last_undegraded":"2023-07-21T19:07:53.833239+0000","last_fullsized":"2023-07-21T19:07:53.833239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:43.739221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524914+0000","last_change":"2023-07-21T19:07:48.451700+0000","last_active":"2023-07-21T19:07:53.524914+0000","last_peered":"2023-07-21T19:07:53.524914+0000","last_clean":"2023-07-21T19:07:53.524914+0000","last_became_active":"2023-07-21T19:07:48.451403+0000","last_became_peered":"2023-07-21T19:07:48.451403+0000","last_unstale":"2023-07-21T19:07:53.524914+0000","last_undegraded":"2023-07-21T19:07:53.524914+0000","last_fullsized":"2023-07-21T19:07:53.524914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523591+0000","last_change":"2023-07-21T19:07:47.423135+0000","last_active":"2023-07-21T19:07:53.523591+0000","last_peered":"2023-07-21T19:07:53.523591+0000","last_clean":"2023-07-21T19:07:53.523591+0000","last_became_active":"2023-07-21T19:07:47.422803+0000","last_became_peered":"2023-07-21T19:07:47.422803+0000","last_unstale":"2023-07-21T19:07:53.523591+0000","last_undegraded":"2023-07-21T19:07:53.523591+0000","last_fullsized":"2023-07-21T19:07:53.523591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:28.397260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525042+0000","last_change":"2023-07-21T19:07:48.457131+0000","last_active":"2023-07-21T19:07:53.525042+0000","last_peered":"2023-07-21T19:07:53.525042+0000","last_clean":"2023-07-21T19:07:53.525042+0000","last_became_active":"2023-07-21T19:07:48.456793+0000","last_became_peered":"2023-07-21T19:07:48.456793+0000","last_unstale":"2023-07-21T19:07:53.525042+0000","last_undegraded":"2023-07-21T19:07:53.525042+0000","last_fullsized":"2023-07-21T19:07:53.525042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:01.458935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834400+0000","last_change":"2023-07-21T19:07:52.518169+0000","last_active":"2023-07-21T19:07:53.834400+0000","last_peered":"2023-07-21T19:07:53.834400+0000","last_clean":"2023-07-21T19:07:53.834400+0000","last_became_active":"2023-07-21T19:07:52.517772+0000","last_became_peered":"2023-07-21T19:07:52.517772+0000","last_unstale":"2023-07-21T19:07:53.834400+0000","last_undegraded":"2023-07-21T19:07:53.834400+0000","last_fullsized":"2023-07-21T19:07:53.834400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:51.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834407+0000","last_change":"2023-07-21T19:07:47.432451+0000","last_active":"2023-07-21T19:07:53.834407+0000","last_peered":"2023-07-21T19:07:53.834407+0000","last_clean":"2023-07-21T19:07:53.834407+0000","last_became_active":"2023-07-21T19:07:47.432158+0000","last_became_peered":"2023-07-21T19:07:47.432158+0000","last_unstale":"2023-07-21T19:07:53.834407+0000","last_undegraded":"2023-07-21T19:07:53.834407+0000","last_fullsized":"2023-07-21T19:07:53.834407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834759+0000","last_change":"2023-07-21T19:07:48.468705+0000","last_active":"2023-07-21T19:07:53.834759+0000","last_peered":"2023-07-21T19:07:53.834759+0000","last_clean":"2023-07-21T19:07:53.834759+0000","last_became_active":"2023-07-21T19:07:48.467669+0000","last_became_peered":"2023-07-21T19:07:48.467669+0000","last_unstale":"2023-07-21T19:07:53.834759+0000","last_undegraded":"2023-07-21T19:07:53.834759+0000","last_fullsized":"2023-07-21T19:07:53.834759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524694+0000","last_change":"2023-07-21T19:07:52.520703+0000","last_active":"2023-07-21T19:07:53.524694+0000","last_peered":"2023-07-21T19:07:53.524694+0000","last_clean":"2023-07-21T19:07:53.524694+0000","last_became_active":"2023-07-21T19:07:52.520253+0000","last_became_peered":"2023-07-21T19:07:52.520253+0000","last_unstale":"2023-07-21T19:07:53.524694+0000","last_undegraded":"2023-07-21T19:07:53.524694+0000","last_fullsized":"2023-07-21T19:07:53.524694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:48.840837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832788+0000","last_change":"2023-07-21T19:07:48.450536+0000","last_active":"2023-07-21T19:07:53.832788+0000","last_peered":"2023-07-21T19:07:53.832788+0000","last_clean":"2023-07-21T19:07:53.832788+0000","last_became_active":"2023-07-21T19:07:48.450167+0000","last_became_peered":"2023-07-21T19:07:48.450167+0000","last_unstale":"2023-07-21T19:07:53.832788+0000","last_undegraded":"2023-07-21T19:07:53.832788+0000","last_fullsized":"2023-07-21T19:07:53.832788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:38.287958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834518+0000","last_change":"2023-07-21T19:07:48.468556+0000","last_active":"2023-07-21T19:07:53.834518+0000","last_peered":"2023-07-21T19:07:53.834518+0000","last_clean":"2023-07-21T19:07:53.834518+0000","last_became_active":"2023-07-21T19:07:48.468254+0000","last_became_peered":"2023-07-21T19:07:48.468254+0000","last_unstale":"2023-07-21T19:07:53.834518+0000","last_undegraded":"2023-07-21T19:07:53.834518+0000","last_fullsized":"2023-07-21T19:07:53.834518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:44.578401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523567+0000","last_change":"2023-07-21T19:07:48.458141+0000","last_active":"2023-07-21T19:07:53.523567+0000","last_peered":"2023-07-21T19:07:53.523567+0000","last_clean":"2023-07-21T19:07:53.523567+0000","last_became_active":"2023-07-21T19:07:48.457777+0000","last_became_peered":"2023-07-21T19:07:48.457777+0000","last_unstale":"2023-07-21T19:07:53.523567+0000","last_undegraded":"2023-07-21T19:07:53.523567+0000","last_fullsized":"2023-07-21T19:07:53.523567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:26.864071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834004+0000","last_change":"2023-07-21T19:07:48.461028+0000","last_active":"2023-07-21T19:07:53.834004+0000","last_peered":"2023-07-21T19:07:53.834004+0000","last_clean":"2023-07-21T19:07:53.834004+0000","last_became_active":"2023-07-21T19:07:48.460706+0000","last_became_peered":"2023-07-21T19:07:48.460706+0000","last_unstale":"2023-07-21T19:07:53.834004+0000","last_undegraded":"2023-07-21T19:07:53.834004+0000","last_fullsized":"2023-07-21T19:07:53.834004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837596+0000","last_change":"2023-07-21T19:07:48.465807+0000","last_active":"2023-07-21T19:07:53.837596+0000","last_peered":"2023-07-21T19:07:53.837596+0000","last_clean":"2023-07-21T19:07:53.837596+0000","last_became_active":"2023-07-21T19:07:48.465438+0000","last_became_peered":"2023-07-21T19:07:48.465438+0000","last_unstale":"2023-07-21T19:07:53.837596+0000","last_undegraded":"2023-07-21T19:07:53.837596+0000","last_fullsized":"2023-07-21T19:07:53.837596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524894+0000","last_change":"2023-07-21T19:07:48.457206+0000","last_active":"2023-07-21T19:07:53.524894+0000","last_peered":"2023-07-21T19:07:53.524894+0000","last_clean":"2023-07-21T19:07:53.524894+0000","last_became_active":"2023-07-21T19:07:48.456904+0000","last_became_peered":"2023-07-21T19:07:48.456904+0000","last_unstale":"2023-07-21T19:07:53.524894+0000","last_undegraded":"2023-07-21T19:07:53.524894+0000","last_fullsized":"2023-07-21T19:07:53.524894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:27.588370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838192+0000","last_change":"2023-07-21T19:07:48.466649+0000","last_active":"2023-07-21T19:07:53.838192+0000","last_peered":"2023-07-21T19:07:53.838192+0000","last_clean":"2023-07-21T19:07:53.838192+0000","last_became_active":"2023-07-21T19:07:48.466399+0000","last_became_peered":"2023-07-21T19:07:48.466399+0000","last_unstale":"2023-07-21T19:07:53.838192+0000","last_undegraded":"2023-07-21T19:07:53.838192+0000","last_fullsized":"2023-07-21T19:07:53.838192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836840+0000","last_change":"2023-07-21T19:07:48.457556+0000","last_active":"2023-07-21T19:07:53.836840+0000","last_peered":"2023-07-21T19:07:53.836840+0000","last_clean":"2023-07-21T19:07:53.836840+0000","last_became_active":"2023-07-21T19:07:48.457008+0000","last_became_peered":"2023-07-21T19:07:48.457008+0000","last_unstale":"2023-07-21T19:07:53.836840+0000","last_undegraded":"2023-07-21T19:07:53.836840+0000","last_fullsized":"2023-07-21T19:07:53.836840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832601+0000","last_change":"2023-07-21T19:07:48.459157+0000","last_active":"2023-07-21T19:07:53.832601+0000","last_peered":"2023-07-21T19:07:53.832601+0000","last_clean":"2023-07-21T19:07:53.832601+0000","last_became_active":"2023-07-21T19:07:48.458742+0000","last_became_peered":"2023-07-21T19:07:48.458742+0000","last_unstale":"2023-07-21T19:07:53.832601+0000","last_undegraded":"2023-07-21T19:07:53.832601+0000","last_fullsized":"2023-07-21T19:07:53.832601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834329+0000","last_change":"2023-07-21T19:07:48.460206+0000","last_active":"2023-07-21T19:07:53.834329+0000","last_peered":"2023-07-21T19:07:53.834329+0000","last_clean":"2023-07-21T19:07:53.834329+0000","last_became_active":"2023-07-21T19:07:48.459889+0000","last_became_peered":"2023-07-21T19:07:48.459889+0000","last_unstale":"2023-07-21T19:07:53.834329+0000","last_undegraded":"2023-07-21T19:07:53.834329+0000","last_fullsized":"2023-07-21T19:07:53.834329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523456+0000","last_change":"2023-07-21T19:07:48.467621+0000","last_active":"2023-07-21T19:07:53.523456+0000","last_peered":"2023-07-21T19:07:53.523456+0000","last_clean":"2023-07-21T19:07:53.523456+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.523456+0000","last_undegraded":"2023-07-21T19:07:53.523456+0000","last_fullsized":"2023-07-21T19:07:53.523456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:17.804609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834253+0000","last_change":"2023-07-21T19:07:48.460711+0000","last_active":"2023-07-21T19:07:53.834253+0000","last_peered":"2023-07-21T19:07:53.834253+0000","last_clean":"2023-07-21T19:07:53.834253+0000","last_became_active":"2023-07-21T19:07:48.459973+0000","last_became_peered":"2023-07-21T19:07:48.459973+0000","last_unstale":"2023-07-21T19:07:53.834253+0000","last_undegraded":"2023-07-21T19:07:53.834253+0000","last_fullsized":"2023-07-21T19:07:53.834253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:00.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524979+0000","last_change":"2023-07-21T19:07:48.458886+0000","last_active":"2023-07-21T19:07:53.524979+0000","last_peered":"2023-07-21T19:07:53.524979+0000","last_clean":"2023-07-21T19:07:53.524979+0000","last_became_active":"2023-07-21T19:07:48.458061+0000","last_became_peered":"2023-07-21T19:07:48.458061+0000","last_unstale":"2023-07-21T19:07:53.524979+0000","last_undegraded":"2023-07-21T19:07:53.524979+0000","last_fullsized":"2023-07-21T19:07:53.524979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:33.659391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836557+0000","last_change":"2023-07-21T19:07:48.462686+0000","last_active":"2023-07-21T19:07:53.836557+0000","last_peered":"2023-07-21T19:07:53.836557+0000","last_clean":"2023-07-21T19:07:53.836557+0000","last_became_active":"2023-07-21T19:07:48.462297+0000","last_became_peered":"2023-07-21T19:07:48.462297+0000","last_unstale":"2023-07-21T19:07:53.836557+0000","last_undegraded":"2023-07-21T19:07:53.836557+0000","last_fullsized":"2023-07-21T19:07:53.836557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:34:16.617396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523127+0000","last_change":"2023-07-21T19:07:48.447297+0000","last_active":"2023-07-21T19:07:53.523127+0000","last_peered":"2023-07-21T19:07:53.523127+0000","last_clean":"2023-07-21T19:07:53.523127+0000","last_became_active":"2023-07-21T19:07:48.446963+0000","last_became_peered":"2023-07-21T19:07:48.446963+0000","last_unstale":"2023-07-21T19:07:53.523127+0000","last_undegraded":"2023-07-21T19:07:53.523127+0000","last_fullsized":"2023-07-21T19:07:53.523127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:33.698602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525034+0000","last_change":"2023-07-21T19:07:48.459709+0000","last_active":"2023-07-21T19:07:53.525034+0000","last_peered":"2023-07-21T19:07:53.525034+0000","last_clean":"2023-07-21T19:07:53.525034+0000","last_became_active":"2023-07-21T19:07:48.459450+0000","last_became_peered":"2023-07-21T19:07:48.459450+0000","last_unstale":"2023-07-21T19:07:53.525034+0000","last_undegraded":"2023-07-21T19:07:53.525034+0000","last_fullsized":"2023-07-21T19:07:53.525034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522497+0000","last_change":"2023-07-21T19:07:48.451039+0000","last_active":"2023-07-21T19:07:53.522497+0000","last_peered":"2023-07-21T19:07:53.522497+0000","last_clean":"2023-07-21T19:07:53.522497+0000","last_became_active":"2023-07-21T19:07:48.450731+0000","last_became_peered":"2023-07-21T19:07:48.450731+0000","last_unstale":"2023-07-21T19:07:53.522497+0000","last_undegraded":"2023-07-21T19:07:53.522497+0000","last_fullsized":"2023-07-21T19:07:53.522497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:26:01.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833016+0000","last_change":"2023-07-21T19:07:48.472483+0000","last_active":"2023-07-21T19:07:53.833016+0000","last_peered":"2023-07-21T19:07:53.833016+0000","last_clean":"2023-07-21T19:07:53.833016+0000","last_became_active":"2023-07-21T19:07:48.472205+0000","last_became_peered":"2023-07-21T19:07:48.472205+0000","last_unstale":"2023-07-21T19:07:53.833016+0000","last_undegraded":"2023-07-21T19:07:53.833016+0000","last_fullsized":"2023-07-21T19:07:53.833016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:40.712184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523605+0000","last_change":"2023-07-21T19:07:48.450016+0000","last_active":"2023-07-21T19:07:53.523605+0000","last_peered":"2023-07-21T19:07:53.523605+0000","last_clean":"2023-07-21T19:07:53.523605+0000","last_became_active":"2023-07-21T19:07:48.449429+0000","last_became_peered":"2023-07-21T19:07:48.449429+0000","last_unstale":"2023-07-21T19:07:53.523605+0000","last_undegraded":"2023-07-21T19:07:53.523605+0000","last_fullsized":"2023-07-21T19:07:53.523605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837435+0000","last_change":"2023-07-21T19:07:48.458714+0000","last_active":"2023-07-21T19:07:53.837435+0000","last_peered":"2023-07-21T19:07:53.837435+0000","last_clean":"2023-07-21T19:07:53.837435+0000","last_became_active":"2023-07-21T19:07:48.458388+0000","last_became_peered":"2023-07-21T19:07:48.458388+0000","last_unstale":"2023-07-21T19:07:53.837435+0000","last_undegraded":"2023-07-21T19:07:53.837435+0000","last_fullsized":"2023-07-21T19:07:53.837435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:07.621195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838125+0000","last_change":"2023-07-21T19:07:48.449982+0000","last_active":"2023-07-21T19:07:53.838125+0000","last_peered":"2023-07-21T19:07:53.838125+0000","last_clean":"2023-07-21T19:07:53.838125+0000","last_became_active":"2023-07-21T19:07:48.449092+0000","last_became_peered":"2023-07-21T19:07:48.449092+0000","last_unstale":"2023-07-21T19:07:53.838125+0000","last_undegraded":"2023-07-21T19:07:53.838125+0000","last_fullsized":"2023-07-21T19:07:53.838125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:10.674404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524046+0000","last_change":"2023-07-21T19:07:48.460970+0000","last_active":"2023-07-21T19:07:53.524046+0000","last_peered":"2023-07-21T19:07:53.524046+0000","last_clean":"2023-07-21T19:07:53.524046+0000","last_became_active":"2023-07-21T19:07:48.460263+0000","last_became_peered":"2023-07-21T19:07:48.460263+0000","last_unstale":"2023-07-21T19:07:53.524046+0000","last_undegraded":"2023-07-21T19:07:53.524046+0000","last_fullsized":"2023-07-21T19:07:53.524046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:09.964570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524908+0000","last_change":"2023-07-21T19:07:48.460703+0000","last_active":"2023-07-21T19:07:53.524908+0000","last_peered":"2023-07-21T19:07:53.524908+0000","last_clean":"2023-07-21T19:07:53.524908+0000","last_became_active":"2023-07-21T19:07:48.460406+0000","last_became_peered":"2023-07-21T19:07:48.460406+0000","last_unstale":"2023-07-21T19:07:53.524908+0000","last_undegraded":"2023-07-21T19:07:53.524908+0000","last_fullsized":"2023-07-21T19:07:53.524908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:10.593044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524839+0000","last_change":"2023-07-21T19:07:48.452496+0000","last_active":"2023-07-21T19:07:53.524839+0000","last_peered":"2023-07-21T19:07:53.524839+0000","last_clean":"2023-07-21T19:07:53.524839+0000","last_became_active":"2023-07-21T19:07:48.452235+0000","last_became_peered":"2023-07-21T19:07:48.452235+0000","last_unstale":"2023-07-21T19:07:53.524839+0000","last_undegraded":"2023-07-21T19:07:53.524839+0000","last_fullsized":"2023-07-21T19:07:53.524839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523126+0000","last_change":"2023-07-21T19:07:48.445166+0000","last_active":"2023-07-21T19:07:53.523126+0000","last_peered":"2023-07-21T19:07:53.523126+0000","last_clean":"2023-07-21T19:07:53.523126+0000","last_became_active":"2023-07-21T19:07:48.444852+0000","last_became_peered":"2023-07-21T19:07:48.444852+0000","last_unstale":"2023-07-21T19:07:53.523126+0000","last_undegraded":"2023-07-21T19:07:53.523126+0000","last_fullsized":"2023-07-21T19:07:53.523126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832791+0000","last_change":"2023-07-21T19:07:48.468451+0000","last_active":"2023-07-21T19:07:53.832791+0000","last_peered":"2023-07-21T19:07:53.832791+0000","last_clean":"2023-07-21T19:07:53.832791+0000","last_became_active":"2023-07-21T19:07:48.468185+0000","last_became_peered":"2023-07-21T19:07:48.468185+0000","last_unstale":"2023-07-21T19:07:53.832791+0000","last_undegraded":"2023-07-21T19:07:53.832791+0000","last_fullsized":"2023-07-21T19:07:53.832791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523196+0000","last_change":"2023-07-21T19:07:48.449895+0000","last_active":"2023-07-21T19:07:53.523196+0000","last_peered":"2023-07-21T19:07:53.523196+0000","last_clean":"2023-07-21T19:07:53.523196+0000","last_became_active":"2023-07-21T19:07:48.449511+0000","last_became_peered":"2023-07-21T19:07:48.449511+0000","last_unstale":"2023-07-21T19:07:53.523196+0000","last_undegraded":"2023-07-21T19:07:53.523196+0000","last_fullsized":"2023-07-21T19:07:53.523196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:55.510661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524314+0000","last_change":"2023-07-21T19:07:48.458380+0000","last_active":"2023-07-21T19:07:53.524314+0000","last_peered":"2023-07-21T19:07:53.524314+0000","last_clean":"2023-07-21T19:07:53.524314+0000","last_became_active":"2023-07-21T19:07:48.458092+0000","last_became_peered":"2023-07-21T19:07:48.458092+0000","last_unstale":"2023-07-21T19:07:53.524314+0000","last_undegraded":"2023-07-21T19:07:53.524314+0000","last_fullsized":"2023-07-21T19:07:53.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834522+0000","last_change":"2023-07-21T19:07:48.458478+0000","last_active":"2023-07-21T19:07:53.834522+0000","last_peered":"2023-07-21T19:07:53.834522+0000","last_clean":"2023-07-21T19:07:53.834522+0000","last_became_active":"2023-07-21T19:07:48.458191+0000","last_became_peered":"2023-07-21T19:07:48.458191+0000","last_unstale":"2023-07-21T19:07:53.834522+0000","last_undegraded":"2023-07-21T19:07:53.834522+0000","last_fullsized":"2023-07-21T19:07:53.834522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:04.609626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523852+0000","last_change":"2023-07-21T19:07:48.456833+0000","last_active":"2023-07-21T19:07:53.523852+0000","last_peered":"2023-07-21T19:07:53.523852+0000","last_clean":"2023-07-21T19:07:53.523852+0000","last_became_active":"2023-07-21T19:07:48.456319+0000","last_became_peered":"2023-07-21T19:07:48.456319+0000","last_unstale":"2023-07-21T19:07:53.523852+0000","last_undegraded":"2023-07-21T19:07:53.523852+0000","last_fullsized":"2023-07-21T19:07:53.523852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:40.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524737+0000","last_change":"2023-07-21T19:07:48.453854+0000","last_active":"2023-07-21T19:07:53.524737+0000","last_peered":"2023-07-21T19:07:53.524737+0000","last_clean":"2023-07-21T19:07:53.524737+0000","last_became_active":"2023-07-21T19:07:48.453560+0000","last_became_peered":"2023-07-21T19:07:48.453560+0000","last_unstale":"2023-07-21T19:07:53.524737+0000","last_undegraded":"2023-07-21T19:07:53.524737+0000","last_fullsized":"2023-07-21T19:07:53.524737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:54.789012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838394+0000","last_change":"2023-07-21T19:07:48.451024+0000","last_active":"2023-07-21T19:07:53.838394+0000","last_peered":"2023-07-21T19:07:53.838394+0000","last_clean":"2023-07-21T19:07:53.838394+0000","last_became_active":"2023-07-21T19:07:48.450678+0000","last_became_peered":"2023-07-21T19:07:48.450678+0000","last_unstale":"2023-07-21T19:07:53.838394+0000","last_undegraded":"2023-07-21T19:07:53.838394+0000","last_fullsized":"2023-07-21T19:07:53.838394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:56:56.585283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T19:08:16.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T19:08:16.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.731+0000 7f2e557d9700 1 Processor -- start 2023-07-21T19:08:16.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.731+0000 7f2e557d9700 1 -- start start 2023-07-21T19:08:16.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e557d9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 0x7f2e500ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e557d9700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2e5015d7f0 0x7f2e5015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e557d9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500b0ef0 con 0x7f2e50159f20 2023-07-21T19:08:16.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e557d9700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e500ce9c0 con 0x7f2e5015d7f0 2023-07-21T19:08:16.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e557d9700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500cee50 con 0x7f2e500c9d90 2023-07-21T19:08:16.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2e50159f20 0x7f2e500caa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43500/0 (socket says 172.21.15.123:43500) 2023-07-21T19:08:16.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4f7fe700 1 -- 172.21.15.123:0/3375464040 learned_addr learned my addr 172.21.15.123:0/3375464040 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:16.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 0x7f2e500ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e54fd8700 1 --2- 172.21.15.123:0/3375464040 >> v2:172.21.15.145:3300/0 conn(0x7f2e5015d7f0 0x7f2e5015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506373443 0 0) 0x7f2e500b0ef0 con 0x7f2e50159f20 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e380035d0 con 0x7f2e50159f20 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513980074 0 0) 0x7f2e380035d0 con 0x7f2e50159f20 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 msgr2=0x7f2e500ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 0x7f2e500ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 >> v2:172.21.15.145:3300/0 conn(0x7f2e5015d7f0 msgr2=0x7f2e5015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 --2- 172.21.15.123:0/3375464040 >> v2:172.21.15.145:3300/0 conn(0x7f2e5015d7f0 0x7f2e5015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e500ca6a0 con 0x7f2e50159f20 2023-07-21T19:08:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f2e44001670 con 0x7f2e50159f20 2023-07-21T19:08:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 >> v1:172.21.15.123:6789/0 conn(0x7f2e50159f20 legacy=0x7f2e500caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e38003a20 0x7f2e38003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 0x7f2e38004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38004db0 0x7f2e38005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500ce9c0 con 0x7f2e38003a20 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500cee50 con 0x7f2e38004db0 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3800ba30 con 0x7f2e500c9d90 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e38003a20 0x7f2e38003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4f7fe700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 0x7f2e38004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e54fd8700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38004db0 0x7f2e38005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 msgr2=0x7f2e38004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c9d90 0x7f2e38004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38004db0 msgr2=0x7f2e38005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38004db0 0x7f2e38005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3375464040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e380035d0 con 0x7f2e38003a20 2023-07-21T19:08:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.735+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e38003a20 0x7f2e38003e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009fc0 tx=0x7f2e380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d559f8a6b65b5ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800ebd0 con 0x7f2e38003a20 2023-07-21T19:08:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4800f040 con 0x7f2e38003a20 2023-07-21T19:08:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e4effd700 1 -- 172.21.15.123:0/3375464040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48014480 con 0x7f2e38003a20 2023-07-21T19:08:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 -- 172.21.15.123:0/3375464040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e38003a20 msgr2=0x7f2e38003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3375464040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e38003a20 0x7f2e38003e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009fc0 tx=0x7f2e380058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e54fd8700 1 -- 172.21.15.123:0/3375464040 reap_dead start 2023-07-21T19:08:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 -- 172.21.15.123:0/3375464040 shutdown_connections 2023-07-21T19:08:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 -- 172.21.15.123:0/3375464040 >> 172.21.15.123:0/3375464040 conn(0x7f2e5006e960 msgr2=0x7f2e5006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 -- 172.21.15.123:0/3375464040 shutdown_connections 2023-07-21T19:08:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 -- 172.21.15.123:0/3375464040 wait complete. 2023-07-21T19:08:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.739+0000 7f2e557d9700 1 Processor -- start 2023-07-21T19:08:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 -- start start 2023-07-21T19:08:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 0x7f2e500b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c3b40 0x7f2e500c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e50151fd0 0x7f2e500ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500c2280 con 0x7f2e50151fd0 2023-07-21T19:08:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500c60f0 con 0x7f2e38003a20 2023-07-21T19:08:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500c4320 con 0x7f2e500c3b40 2023-07-21T19:08:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 0x7f2e500b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e54fd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e50151fd0 0x7f2e500ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 0x7f2e500b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:46074/0 (socket says 172.21.15.123:46074) 2023-07-21T19:08:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3080961858 learned_addr learned my addr 172.21.15.123:0/3080961858 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4f7fe700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c3b40 0x7f2e500c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c3b40 msgr2=0x7f2e500c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c3b40 0x7f2e500c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e50151fd0 msgr2=0x7f2e500ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:16.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e50151fd0 0x7f2e500ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:16.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 -- 172.21.15.123:0/3080961858 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e500c1c30 con 0x7f2e38003a20 2023-07-21T19:08:16.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4ffff700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 0x7f2e500b3a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800eed0 tx=0x7f2e48009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:16.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48004450 con 0x7f2e38003a20 2023-07-21T19:08:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e480045d0 con 0x7f2e38003a20 2023-07-21T19:08:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e500c1f10 con 0x7f2e38003a20 2023-07-21T19:08:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48004980 con 0x7f2e38003a20 2023-07-21T19:08:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.743+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e500c4600 con 0x7f2e38003a20 2023-07-21T19:08:16.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.747+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5004e500 con 0x7f2e38003a20 2023-07-21T19:08:16.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.747+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e48014480 con 0x7f2e38003a20 2023-07-21T19:08:16.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.747+0000 7f2e4cff9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2e3c066340 0x7f2e3c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:16.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.747+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e480861b0 con 0x7f2e38003a20 2023-07-21T19:08:16.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.747+0000 7f2e4f7fe700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2e3c066340 0x7f2e3c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:16.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.751+0000 7f2e4f7fe700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2e3c066340 0x7f2e3c0687f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e44001820 tx=0x7f2e44007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:16.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.755+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e480534f0 con 0x7f2e38003a20 2023-07-21T19:08:16.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.911+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 --> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e500ce090 con 0x7f2e3c066340 2023-07-21T19:08:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.931+0000 7f2e4cff9700 1 -- 172.21.15.123:0/3080961858 <== mgr.4104 v2:172.21.15.123:6832/1650121890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367081 (secure 0 0 0) 0x7f2e440117c0 con 0x7f2e3c066340 2023-07-21T19:08:17.036 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:17.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2e3c066340 msgr2=0x7f2e3c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2e3c066340 0x7f2e3c0687f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e44001820 tx=0x7f2e44007040 comp rx=0 tx=0).stop 2023-07-21T19:08:17.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 msgr2=0x7f2e500b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 0x7f2e500b3a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800eed0 tx=0x7f2e48009750 comp rx=0 tx=0).stop 2023-07-21T19:08:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 shutdown_connections 2023-07-21T19:08:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2e3c066340 0x7f2e3c0687f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e50151fd0 0x7f2e500ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e500c3b40 0x7f2e500c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 --2- 172.21.15.123:0/3080961858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e38003a20 0x7f2e500b3a70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 >> 172.21.15.123:0/3080961858 conn(0x7f2e5006e960 msgr2=0x7f2e500c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 shutdown_connections 2023-07-21T19:08:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:16.939+0000 7f2e557d9700 1 -- 172.21.15.123:0/3080961858 wait complete. 2023-07-21T19:08:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-07-21T19:08:17.044 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-21T19:08:15.889920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223304,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751416,"statfs":{"total":773094113280,"available":772865449984,"internally_reserved":0,"allocated":3678208,"data_stored":2186494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007025"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837152+0000","last_change":"2023-07-21T19:07:52.526013+0000","last_active":"2023-07-21T19:07:53.837152+0000","last_peered":"2023-07-21T19:07:53.837152+0000","last_clean":"2023-07-21T19:07:53.837152+0000","last_became_active":"2023-07-21T19:07:52.525619+0000","last_became_peered":"2023-07-21T19:07:52.525619+0000","last_unstale":"2023-07-21T19:07:53.837152+0000","last_undegraded":"2023-07-21T19:07:53.837152+0000","last_fullsized":"2023-07-21T19:07:53.837152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:21.893772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525160+0000","last_change":"2023-07-21T19:07:47.420098+0000","last_active":"2023-07-21T19:07:53.525160+0000","last_peered":"2023-07-21T19:07:53.525160+0000","last_clean":"2023-07-21T19:07:53.525160+0000","last_became_active":"2023-07-21T19:07:47.419764+0000","last_became_peered":"2023-07-21T19:07:47.419764+0000","last_unstale":"2023-07-21T19:07:53.525160+0000","last_undegraded":"2023-07-21T19:07:53.525160+0000","last_fullsized":"2023-07-21T19:07:53.525160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522584+0000","last_change":"2023-07-21T19:07:48.458192+0000","last_active":"2023-07-21T19:07:53.522584+0000","last_peered":"2023-07-21T19:07:53.522584+0000","last_clean":"2023-07-21T19:07:53.522584+0000","last_became_active":"2023-07-21T19:07:48.457841+0000","last_became_peered":"2023-07-21T19:07:48.457841+0000","last_unstale":"2023-07-21T19:07:53.522584+0000","last_undegraded":"2023-07-21T19:07:53.522584+0000","last_fullsized":"2023-07-21T19:07:53.522584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:34.793452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522466+0000","last_change":"2023-07-21T19:07:52.521292+0000","last_active":"2023-07-21T19:07:53.522466+0000","last_peered":"2023-07-21T19:07:53.522466+0000","last_clean":"2023-07-21T19:07:53.522466+0000","last_became_active":"2023-07-21T19:07:52.512373+0000","last_became_peered":"2023-07-21T19:07:52.512373+0000","last_unstale":"2023-07-21T19:07:53.522466+0000","last_undegraded":"2023-07-21T19:07:53.522466+0000","last_fullsized":"2023-07-21T19:07:53.522466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:16.920553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834575+0000","last_change":"2023-07-21T19:07:47.418823+0000","last_active":"2023-07-21T19:07:53.834575+0000","last_peered":"2023-07-21T19:07:53.834575+0000","last_clean":"2023-07-21T19:07:53.834575+0000","last_became_active":"2023-07-21T19:07:47.418529+0000","last_became_peered":"2023-07-21T19:07:47.418529+0000","last_unstale":"2023-07-21T19:07:53.834575+0000","last_undegraded":"2023-07-21T19:07:53.834575+0000","last_fullsized":"2023-07-21T19:07:53.834575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834847+0000","last_change":"2023-07-21T19:07:48.460406+0000","last_active":"2023-07-21T19:07:53.834847+0000","last_peered":"2023-07-21T19:07:53.834847+0000","last_clean":"2023-07-21T19:07:53.834847+0000","last_became_active":"2023-07-21T19:07:48.459868+0000","last_became_peered":"2023-07-21T19:07:48.459868+0000","last_unstale":"2023-07-21T19:07:53.834847+0000","last_undegraded":"2023-07-21T19:07:53.834847+0000","last_fullsized":"2023-07-21T19:07:53.834847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523950+0000","last_change":"2023-07-21T19:07:52.514421+0000","last_active":"2023-07-21T19:07:53.523950+0000","last_peered":"2023-07-21T19:07:53.523950+0000","last_clean":"2023-07-21T19:07:53.523950+0000","last_became_active":"2023-07-21T19:07:52.514037+0000","last_became_peered":"2023-07-21T19:07:52.514037+0000","last_unstale":"2023-07-21T19:07:53.523950+0000","last_undegraded":"2023-07-21T19:07:53.523950+0000","last_fullsized":"2023-07-21T19:07:53.523950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:16.918863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525195+0000","last_change":"2023-07-21T19:07:47.429875+0000","last_active":"2023-07-21T19:07:53.525195+0000","last_peered":"2023-07-21T19:07:53.525195+0000","last_clean":"2023-07-21T19:07:53.525195+0000","last_became_active":"2023-07-21T19:07:47.429597+0000","last_became_peered":"2023-07-21T19:07:47.429597+0000","last_unstale":"2023-07-21T19:07:53.525195+0000","last_undegraded":"2023-07-21T19:07:53.525195+0000","last_fullsized":"2023-07-21T19:07:53.525195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523434+0000","last_change":"2023-07-21T19:07:48.445883+0000","last_active":"2023-07-21T19:07:53.523434+0000","last_peered":"2023-07-21T19:07:53.523434+0000","last_clean":"2023-07-21T19:07:53.523434+0000","last_became_active":"2023-07-21T19:07:48.445660+0000","last_became_peered":"2023-07-21T19:07:48.445660+0000","last_unstale":"2023-07-21T19:07:53.523434+0000","last_undegraded":"2023-07-21T19:07:53.523434+0000","last_fullsized":"2023-07-21T19:07:53.523434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:52.906045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832775+0000","last_change":"2023-07-21T19:07:52.524081+0000","last_active":"2023-07-21T19:07:53.832775+0000","last_peered":"2023-07-21T19:07:53.832775+0000","last_clean":"2023-07-21T19:07:53.832775+0000","last_became_active":"2023-07-21T19:07:52.523354+0000","last_became_peered":"2023-07-21T19:07:52.523354+0000","last_unstale":"2023-07-21T19:07:53.832775+0000","last_undegraded":"2023-07-21T19:07:53.832775+0000","last_fullsized":"2023-07-21T19:07:53.832775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524027+0000","last_change":"2023-07-21T19:07:47.429333+0000","last_active":"2023-07-21T19:07:53.524027+0000","last_peered":"2023-07-21T19:07:53.524027+0000","last_clean":"2023-07-21T19:07:53.524027+0000","last_became_active":"2023-07-21T19:07:47.428959+0000","last_became_peered":"2023-07-21T19:07:47.428959+0000","last_unstale":"2023-07-21T19:07:53.524027+0000","last_undegraded":"2023-07-21T19:07:53.524027+0000","last_fullsized":"2023-07-21T19:07:53.524027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524172+0000","last_change":"2023-07-21T19:07:48.454559+0000","last_active":"2023-07-21T19:07:53.524172+0000","last_peered":"2023-07-21T19:07:53.524172+0000","last_clean":"2023-07-21T19:07:53.524172+0000","last_became_active":"2023-07-21T19:07:48.454270+0000","last_became_peered":"2023-07-21T19:07:48.454270+0000","last_unstale":"2023-07-21T19:07:53.524172+0000","last_undegraded":"2023-07-21T19:07:53.524172+0000","last_fullsized":"2023-07-21T19:07:53.524172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:14.890349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838309+0000","last_change":"2023-07-21T19:07:52.521872+0000","last_active":"2023-07-21T19:07:53.838309+0000","last_peered":"2023-07-21T19:07:53.838309+0000","last_clean":"2023-07-21T19:07:53.838309+0000","last_became_active":"2023-07-21T19:07:52.521417+0000","last_became_peered":"2023-07-21T19:07:52.521417+0000","last_unstale":"2023-07-21T19:07:53.838309+0000","last_undegraded":"2023-07-21T19:07:53.838309+0000","last_fullsized":"2023-07-21T19:07:53.838309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:57.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524569+0000","last_change":"2023-07-21T19:07:47.435498+0000","last_active":"2023-07-21T19:07:53.524569+0000","last_peered":"2023-07-21T19:07:53.524569+0000","last_clean":"2023-07-21T19:07:53.524569+0000","last_became_active":"2023-07-21T19:07:47.435167+0000","last_became_peered":"2023-07-21T19:07:47.435167+0000","last_unstale":"2023-07-21T19:07:53.524569+0000","last_undegraded":"2023-07-21T19:07:53.524569+0000","last_fullsized":"2023-07-21T19:07:53.524569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:28.227019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838212+0000","last_change":"2023-07-21T19:07:48.464638+0000","last_active":"2023-07-21T19:07:53.838212+0000","last_peered":"2023-07-21T19:07:53.838212+0000","last_clean":"2023-07-21T19:07:53.838212+0000","last_became_active":"2023-07-21T19:07:48.463719+0000","last_became_peered":"2023-07-21T19:07:48.463719+0000","last_unstale":"2023-07-21T19:07:53.838212+0000","last_undegraded":"2023-07-21T19:07:53.838212+0000","last_fullsized":"2023-07-21T19:07:53.838212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:49:59.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524735+0000","last_change":"2023-07-21T19:07:52.520166+0000","last_active":"2023-07-21T19:07:53.524735+0000","last_peered":"2023-07-21T19:07:53.524735+0000","last_clean":"2023-07-21T19:07:53.524735+0000","last_became_active":"2023-07-21T19:07:52.519664+0000","last_became_peered":"2023-07-21T19:07:52.519664+0000","last_unstale":"2023-07-21T19:07:53.524735+0000","last_undegraded":"2023-07-21T19:07:53.524735+0000","last_fullsized":"2023-07-21T19:07:53.524735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:12.671068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523715+0000","last_change":"2023-07-21T19:07:47.428335+0000","last_active":"2023-07-21T19:07:53.523715+0000","last_peered":"2023-07-21T19:07:53.523715+0000","last_clean":"2023-07-21T19:07:53.523715+0000","last_became_active":"2023-07-21T19:07:47.428024+0000","last_became_peered":"2023-07-21T19:07:47.428024+0000","last_unstale":"2023-07-21T19:07:53.523715+0000","last_undegraded":"2023-07-21T19:07:53.523715+0000","last_fullsized":"2023-07-21T19:07:53.523715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:06.868264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835070+0000","last_change":"2023-07-21T19:07:48.460771+0000","last_active":"2023-07-21T19:07:53.835070+0000","last_peered":"2023-07-21T19:07:53.835070+0000","last_clean":"2023-07-21T19:07:53.835070+0000","last_became_active":"2023-07-21T19:07:48.460408+0000","last_became_peered":"2023-07-21T19:07:48.460408+0000","last_unstale":"2023-07-21T19:07:53.835070+0000","last_undegraded":"2023-07-21T19:07:53.835070+0000","last_fullsized":"2023-07-21T19:07:53.835070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834859+0000","last_change":"2023-07-21T19:07:52.515758+0000","last_active":"2023-07-21T19:07:53.834859+0000","last_peered":"2023-07-21T19:07:53.834859+0000","last_clean":"2023-07-21T19:07:53.834859+0000","last_became_active":"2023-07-21T19:07:52.515364+0000","last_became_peered":"2023-07-21T19:07:52.515364+0000","last_unstale":"2023-07-21T19:07:53.834859+0000","last_undegraded":"2023-07-21T19:07:53.834859+0000","last_fullsized":"2023-07-21T19:07:53.834859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:32.112276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838565+0000","last_change":"2023-07-21T19:07:47.432465+0000","last_active":"2023-07-21T19:07:53.838565+0000","last_peered":"2023-07-21T19:07:53.838565+0000","last_clean":"2023-07-21T19:07:53.838565+0000","last_became_active":"2023-07-21T19:07:47.432078+0000","last_became_peered":"2023-07-21T19:07:47.432078+0000","last_unstale":"2023-07-21T19:07:53.838565+0000","last_undegraded":"2023-07-21T19:07:53.838565+0000","last_fullsized":"2023-07-21T19:07:53.838565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524687+0000","last_change":"2023-07-21T19:07:48.460469+0000","last_active":"2023-07-21T19:07:53.524687+0000","last_peered":"2023-07-21T19:07:53.524687+0000","last_clean":"2023-07-21T19:07:53.524687+0000","last_became_active":"2023-07-21T19:07:48.460211+0000","last_became_peered":"2023-07-21T19:07:48.460211+0000","last_unstale":"2023-07-21T19:07:53.524687+0000","last_undegraded":"2023-07-21T19:07:53.524687+0000","last_fullsized":"2023-07-21T19:07:53.524687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525137+0000","last_change":"2023-07-21T19:07:52.515243+0000","last_active":"2023-07-21T19:07:53.525137+0000","last_peered":"2023-07-21T19:07:53.525137+0000","last_clean":"2023-07-21T19:07:53.525137+0000","last_became_active":"2023-07-21T19:07:52.514858+0000","last_became_peered":"2023-07-21T19:07:52.514858+0000","last_unstale":"2023-07-21T19:07:53.525137+0000","last_undegraded":"2023-07-21T19:07:53.525137+0000","last_fullsized":"2023-07-21T19:07:53.525137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:48.667564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834262+0000","last_change":"2023-07-21T19:07:47.423653+0000","last_active":"2023-07-21T19:07:53.834262+0000","last_peered":"2023-07-21T19:07:53.834262+0000","last_clean":"2023-07-21T19:07:53.834262+0000","last_became_active":"2023-07-21T19:07:47.423336+0000","last_became_peered":"2023-07-21T19:07:47.423336+0000","last_unstale":"2023-07-21T19:07:53.834262+0000","last_undegraded":"2023-07-21T19:07:53.834262+0000","last_fullsized":"2023-07-21T19:07:53.834262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:43.201925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835020+0000","last_change":"2023-07-21T19:07:48.453898+0000","last_active":"2023-07-21T19:07:53.835020+0000","last_peered":"2023-07-21T19:07:53.835020+0000","last_clean":"2023-07-21T19:07:53.835020+0000","last_became_active":"2023-07-21T19:07:48.453048+0000","last_became_peered":"2023-07-21T19:07:48.453048+0000","last_unstale":"2023-07-21T19:07:53.835020+0000","last_undegraded":"2023-07-21T19:07:53.835020+0000","last_fullsized":"2023-07-21T19:07:53.835020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:02.564475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833703+0000","last_change":"2023-07-21T19:07:48.467565+0000","last_active":"2023-07-21T19:07:53.833703+0000","last_peered":"2023-07-21T19:07:53.833703+0000","last_clean":"2023-07-21T19:07:53.833703+0000","last_became_active":"2023-07-21T19:07:48.467121+0000","last_became_peered":"2023-07-21T19:07:48.467121+0000","last_unstale":"2023-07-21T19:07:53.833703+0000","last_undegraded":"2023-07-21T19:07:53.833703+0000","last_fullsized":"2023-07-21T19:07:53.833703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525240+0000","last_change":"2023-07-21T19:07:47.419807+0000","last_active":"2023-07-21T19:07:53.525240+0000","last_peered":"2023-07-21T19:07:53.525240+0000","last_clean":"2023-07-21T19:07:53.525240+0000","last_became_active":"2023-07-21T19:07:47.419458+0000","last_became_peered":"2023-07-21T19:07:47.419458+0000","last_unstale":"2023-07-21T19:07:53.525240+0000","last_undegraded":"2023-07-21T19:07:53.525240+0000","last_fullsized":"2023-07-21T19:07:53.525240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:39.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832798+0000","last_change":"2023-07-21T19:07:52.512833+0000","last_active":"2023-07-21T19:07:53.832798+0000","last_peered":"2023-07-21T19:07:53.832798+0000","last_clean":"2023-07-21T19:07:53.832798+0000","last_became_active":"2023-07-21T19:07:52.512452+0000","last_became_peered":"2023-07-21T19:07:52.512452+0000","last_unstale":"2023-07-21T19:07:53.832798+0000","last_undegraded":"2023-07-21T19:07:53.832798+0000","last_fullsized":"2023-07-21T19:07:53.832798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:18.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834692+0000","last_change":"2023-07-21T19:07:48.455667+0000","last_active":"2023-07-21T19:07:53.834692+0000","last_peered":"2023-07-21T19:07:53.834692+0000","last_clean":"2023-07-21T19:07:53.834692+0000","last_became_active":"2023-07-21T19:07:48.455414+0000","last_became_peered":"2023-07-21T19:07:48.455414+0000","last_unstale":"2023-07-21T19:07:53.834692+0000","last_undegraded":"2023-07-21T19:07:53.834692+0000","last_fullsized":"2023-07-21T19:07:53.834692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:59.756485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524944+0000","last_change":"2023-07-21T19:07:47.419752+0000","last_active":"2023-07-21T19:07:53.524944+0000","last_peered":"2023-07-21T19:07:53.524944+0000","last_clean":"2023-07-21T19:07:53.524944+0000","last_became_active":"2023-07-21T19:07:47.419344+0000","last_became_peered":"2023-07-21T19:07:47.419344+0000","last_unstale":"2023-07-21T19:07:53.524944+0000","last_undegraded":"2023-07-21T19:07:53.524944+0000","last_fullsized":"2023-07-21T19:07:53.524944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:35.799862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833166+0000","last_change":"2023-07-21T19:07:52.535682+0000","last_active":"2023-07-21T19:07:53.833166+0000","last_peered":"2023-07-21T19:07:53.833166+0000","last_clean":"2023-07-21T19:07:53.833166+0000","last_became_active":"2023-07-21T19:07:52.534938+0000","last_became_peered":"2023-07-21T19:07:52.534938+0000","last_unstale":"2023-07-21T19:07:53.833166+0000","last_undegraded":"2023-07-21T19:07:53.833166+0000","last_fullsized":"2023-07-21T19:07:53.833166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833508+0000","last_change":"2023-07-21T19:07:47.428893+0000","last_active":"2023-07-21T19:07:53.833508+0000","last_peered":"2023-07-21T19:07:53.833508+0000","last_clean":"2023-07-21T19:07:53.833508+0000","last_became_active":"2023-07-21T19:07:47.428562+0000","last_became_peered":"2023-07-21T19:07:47.428562+0000","last_unstale":"2023-07-21T19:07:53.833508+0000","last_undegraded":"2023-07-21T19:07:53.833508+0000","last_fullsized":"2023-07-21T19:07:53.833508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:26.575918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838495+0000","last_change":"2023-07-21T19:07:48.458970+0000","last_active":"2023-07-21T19:07:53.838495+0000","last_peered":"2023-07-21T19:07:53.838495+0000","last_clean":"2023-07-21T19:07:53.838495+0000","last_became_active":"2023-07-21T19:07:48.458737+0000","last_became_peered":"2023-07-21T19:07:48.458737+0000","last_unstale":"2023-07-21T19:07:53.838495+0000","last_undegraded":"2023-07-21T19:07:53.838495+0000","last_fullsized":"2023-07-21T19:07:53.838495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833652+0000","last_change":"2023-07-21T19:07:52.529054+0000","last_active":"2023-07-21T19:07:53.833652+0000","last_peered":"2023-07-21T19:07:53.833652+0000","last_clean":"2023-07-21T19:07:53.833652+0000","last_became_active":"2023-07-21T19:07:52.528619+0000","last_became_peered":"2023-07-21T19:07:52.528619+0000","last_unstale":"2023-07-21T19:07:53.833652+0000","last_undegraded":"2023-07-21T19:07:53.833652+0000","last_fullsized":"2023-07-21T19:07:53.833652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:44.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:08:06.078351+0000","last_change":"2023-07-21T19:07:47.424409+0000","last_active":"2023-07-21T19:08:06.078351+0000","last_peered":"2023-07-21T19:08:06.078351+0000","last_clean":"2023-07-21T19:08:06.078351+0000","last_became_active":"2023-07-21T19:07:47.424101+0000","last_became_peered":"2023-07-21T19:07:47.424101+0000","last_unstale":"2023-07-21T19:08:06.078351+0000","last_undegraded":"2023-07-21T19:08:06.078351+0000","last_fullsized":"2023-07-21T19:08:06.078351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:06:04.934694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524300+0000","last_change":"2023-07-21T19:07:48.458540+0000","last_active":"2023-07-21T19:07:53.524300+0000","last_peered":"2023-07-21T19:07:53.524300+0000","last_clean":"2023-07-21T19:07:53.524300+0000","last_became_active":"2023-07-21T19:07:48.458216+0000","last_became_peered":"2023-07-21T19:07:48.458216+0000","last_unstale":"2023-07-21T19:07:53.524300+0000","last_undegraded":"2023-07-21T19:07:53.524300+0000","last_fullsized":"2023-07-21T19:07:53.524300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:04.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838155+0000","last_change":"2023-07-21T19:07:52.525973+0000","last_active":"2023-07-21T19:07:53.838155+0000","last_peered":"2023-07-21T19:07:53.838155+0000","last_clean":"2023-07-21T19:07:53.838155+0000","last_became_active":"2023-07-21T19:07:52.525557+0000","last_became_peered":"2023-07-21T19:07:52.525557+0000","last_unstale":"2023-07-21T19:07:53.838155+0000","last_undegraded":"2023-07-21T19:07:53.838155+0000","last_fullsized":"2023-07-21T19:07:53.838155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:04.238744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522891+0000","last_change":"2023-07-21T19:07:48.450182+0000","last_active":"2023-07-21T19:07:53.522891+0000","last_peered":"2023-07-21T19:07:53.522891+0000","last_clean":"2023-07-21T19:07:53.522891+0000","last_became_active":"2023-07-21T19:07:48.449903+0000","last_became_peered":"2023-07-21T19:07:48.449903+0000","last_unstale":"2023-07-21T19:07:53.522891+0000","last_undegraded":"2023-07-21T19:07:53.522891+0000","last_fullsized":"2023-07-21T19:07:53.522891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:58.318651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835029+0000","last_change":"2023-07-21T19:07:42.363227+0000","last_active":"2023-07-21T19:07:53.835029+0000","last_peered":"2023-07-21T19:07:53.835029+0000","last_clean":"2023-07-21T19:07:53.835029+0000","last_became_active":"2023-07-21T19:07:42.362873+0000","last_became_peered":"2023-07-21T19:07:42.362873+0000","last_unstale":"2023-07-21T19:07:53.835029+0000","last_undegraded":"2023-07-21T19:07:53.835029+0000","last_fullsized":"2023-07-21T19:07:53.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:50:40.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525002+0000","last_change":"2023-07-21T19:07:47.423281+0000","last_active":"2023-07-21T19:07:53.525002+0000","last_peered":"2023-07-21T19:07:53.525002+0000","last_clean":"2023-07-21T19:07:53.525002+0000","last_became_active":"2023-07-21T19:07:47.422972+0000","last_became_peered":"2023-07-21T19:07:47.422972+0000","last_unstale":"2023-07-21T19:07:53.525002+0000","last_undegraded":"2023-07-21T19:07:53.525002+0000","last_fullsized":"2023-07-21T19:07:53.525002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:46.818657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833700+0000","last_change":"2023-07-21T19:07:52.538404+0000","last_active":"2023-07-21T19:07:53.833700+0000","last_peered":"2023-07-21T19:07:53.833700+0000","last_clean":"2023-07-21T19:07:53.833700+0000","last_became_active":"2023-07-21T19:07:52.537940+0000","last_became_peered":"2023-07-21T19:07:52.537940+0000","last_unstale":"2023-07-21T19:07:53.833700+0000","last_undegraded":"2023-07-21T19:07:53.833700+0000","last_fullsized":"2023-07-21T19:07:53.833700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833968+0000","last_change":"2023-07-21T19:07:48.462660+0000","last_active":"2023-07-21T19:07:53.833968+0000","last_peered":"2023-07-21T19:07:53.833968+0000","last_clean":"2023-07-21T19:07:53.833968+0000","last_became_active":"2023-07-21T19:07:48.461577+0000","last_became_peered":"2023-07-21T19:07:48.461577+0000","last_unstale":"2023-07-21T19:07:53.833968+0000","last_undegraded":"2023-07-21T19:07:53.833968+0000","last_fullsized":"2023-07-21T19:07:53.833968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:53.312850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838321+0000","last_change":"2023-07-21T19:07:42.367585+0000","last_active":"2023-07-21T19:07:53.838321+0000","last_peered":"2023-07-21T19:07:53.838321+0000","last_clean":"2023-07-21T19:07:53.838321+0000","last_became_active":"2023-07-21T19:07:42.367246+0000","last_became_peered":"2023-07-21T19:07:42.367246+0000","last_unstale":"2023-07-21T19:07:53.838321+0000","last_undegraded":"2023-07-21T19:07:53.838321+0000","last_fullsized":"2023-07-21T19:07:53.838321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:03.305963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835676+0000","last_change":"2023-07-21T19:07:47.423871+0000","last_active":"2023-07-21T19:07:53.835676+0000","last_peered":"2023-07-21T19:07:53.835676+0000","last_clean":"2023-07-21T19:07:53.835676+0000","last_became_active":"2023-07-21T19:07:47.423601+0000","last_became_peered":"2023-07-21T19:07:47.423601+0000","last_unstale":"2023-07-21T19:07:53.835676+0000","last_undegraded":"2023-07-21T19:07:53.835676+0000","last_fullsized":"2023-07-21T19:07:53.835676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:19.822832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522467+0000","last_change":"2023-07-21T19:07:52.520565+0000","last_active":"2023-07-21T19:07:53.522467+0000","last_peered":"2023-07-21T19:07:53.522467+0000","last_clean":"2023-07-21T19:07:53.522467+0000","last_became_active":"2023-07-21T19:07:52.519706+0000","last_became_peered":"2023-07-21T19:07:52.519706+0000","last_unstale":"2023-07-21T19:07:53.522467+0000","last_undegraded":"2023-07-21T19:07:53.522467+0000","last_fullsized":"2023-07-21T19:07:53.522467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:16.197136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523919+0000","last_change":"2023-07-21T19:07:48.453983+0000","last_active":"2023-07-21T19:07:53.523919+0000","last_peered":"2023-07-21T19:07:53.523919+0000","last_clean":"2023-07-21T19:07:53.523919+0000","last_became_active":"2023-07-21T19:07:48.453574+0000","last_became_peered":"2023-07-21T19:07:48.453574+0000","last_unstale":"2023-07-21T19:07:53.523919+0000","last_undegraded":"2023-07-21T19:07:53.523919+0000","last_fullsized":"2023-07-21T19:07:53.523919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833947+0000","last_change":"2023-07-21T19:07:42.365391+0000","last_active":"2023-07-21T19:07:53.833947+0000","last_peered":"2023-07-21T19:07:53.833947+0000","last_clean":"2023-07-21T19:07:53.833947+0000","last_became_active":"2023-07-21T19:07:42.364406+0000","last_became_peered":"2023-07-21T19:07:42.364406+0000","last_unstale":"2023-07-21T19:07:53.833947+0000","last_undegraded":"2023-07-21T19:07:53.833947+0000","last_fullsized":"2023-07-21T19:07:53.833947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:10:30.769824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837437+0000","last_change":"2023-07-21T19:07:47.425674+0000","last_active":"2023-07-21T19:07:53.837437+0000","last_peered":"2023-07-21T19:07:53.837437+0000","last_clean":"2023-07-21T19:07:53.837437+0000","last_became_active":"2023-07-21T19:07:47.425400+0000","last_became_peered":"2023-07-21T19:07:47.425400+0000","last_unstale":"2023-07-21T19:07:53.837437+0000","last_undegraded":"2023-07-21T19:07:53.837437+0000","last_fullsized":"2023-07-21T19:07:53.837437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:35.849154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832757+0000","last_change":"2023-07-21T19:07:52.521137+0000","last_active":"2023-07-21T19:07:53.832757+0000","last_peered":"2023-07-21T19:07:53.832757+0000","last_clean":"2023-07-21T19:07:53.832757+0000","last_became_active":"2023-07-21T19:07:52.520674+0000","last_became_peered":"2023-07-21T19:07:52.520674+0000","last_unstale":"2023-07-21T19:07:53.832757+0000","last_undegraded":"2023-07-21T19:07:53.832757+0000","last_fullsized":"2023-07-21T19:07:53.832757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:00.674447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838395+0000","last_change":"2023-07-21T19:07:48.456486+0000","last_active":"2023-07-21T19:07:53.838395+0000","last_peered":"2023-07-21T19:07:53.838395+0000","last_clean":"2023-07-21T19:07:53.838395+0000","last_became_active":"2023-07-21T19:07:48.456220+0000","last_became_peered":"2023-07-21T19:07:48.456220+0000","last_unstale":"2023-07-21T19:07:53.838395+0000","last_undegraded":"2023-07-21T19:07:53.838395+0000","last_fullsized":"2023-07-21T19:07:53.838395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837749+0000","last_change":"2023-07-21T19:07:42.367917+0000","last_active":"2023-07-21T19:07:53.837749+0000","last_peered":"2023-07-21T19:07:53.837749+0000","last_clean":"2023-07-21T19:07:53.837749+0000","last_became_active":"2023-07-21T19:07:42.367308+0000","last_became_peered":"2023-07-21T19:07:42.367308+0000","last_unstale":"2023-07-21T19:07:53.837749+0000","last_undegraded":"2023-07-21T19:07:53.837749+0000","last_fullsized":"2023-07-21T19:07:53.837749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:35.449270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525321+0000","last_change":"2023-07-21T19:07:47.423617+0000","last_active":"2023-07-21T19:07:53.525321+0000","last_peered":"2023-07-21T19:07:53.525321+0000","last_clean":"2023-07-21T19:07:53.525321+0000","last_became_active":"2023-07-21T19:07:47.423355+0000","last_became_peered":"2023-07-21T19:07:47.423355+0000","last_unstale":"2023-07-21T19:07:53.525321+0000","last_undegraded":"2023-07-21T19:07:53.525321+0000","last_fullsized":"2023-07-21T19:07:53.525321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523743+0000","last_change":"2023-07-21T19:07:52.528456+0000","last_active":"2023-07-21T19:07:53.523743+0000","last_peered":"2023-07-21T19:07:53.523743+0000","last_clean":"2023-07-21T19:07:53.523743+0000","last_became_active":"2023-07-21T19:07:52.528085+0000","last_became_peered":"2023-07-21T19:07:52.528085+0000","last_unstale":"2023-07-21T19:07:53.523743+0000","last_undegraded":"2023-07-21T19:07:53.523743+0000","last_fullsized":"2023-07-21T19:07:53.523743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:25.346160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837279+0000","last_change":"2023-07-21T19:07:48.467636+0000","last_active":"2023-07-21T19:07:53.837279+0000","last_peered":"2023-07-21T19:07:53.837279+0000","last_clean":"2023-07-21T19:07:53.837279+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.837279+0000","last_undegraded":"2023-07-21T19:07:53.837279+0000","last_fullsized":"2023-07-21T19:07:53.837279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:21.256996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524424+0000","last_change":"2023-07-21T19:07:47.424470+0000","last_active":"2023-07-21T19:07:53.524424+0000","last_peered":"2023-07-21T19:07:53.524424+0000","last_clean":"2023-07-21T19:07:53.524424+0000","last_became_active":"2023-07-21T19:07:47.424180+0000","last_became_peered":"2023-07-21T19:07:47.424180+0000","last_unstale":"2023-07-21T19:07:53.524424+0000","last_undegraded":"2023-07-21T19:07:53.524424+0000","last_fullsized":"2023-07-21T19:07:53.524424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:06.662020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523611+0000","last_change":"2023-07-21T19:07:42.362561+0000","last_active":"2023-07-21T19:07:53.523611+0000","last_peered":"2023-07-21T19:07:53.523611+0000","last_clean":"2023-07-21T19:07:53.523611+0000","last_became_active":"2023-07-21T19:07:42.362127+0000","last_became_peered":"2023-07-21T19:07:42.362127+0000","last_unstale":"2023-07-21T19:07:53.523611+0000","last_undegraded":"2023-07-21T19:07:53.523611+0000","last_fullsized":"2023-07-21T19:07:53.523611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:35.933835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524354+0000","last_change":"2023-07-21T19:07:52.516158+0000","last_active":"2023-07-21T19:07:53.524354+0000","last_peered":"2023-07-21T19:07:53.524354+0000","last_clean":"2023-07-21T19:07:53.524354+0000","last_became_active":"2023-07-21T19:07:52.515733+0000","last_became_peered":"2023-07-21T19:07:52.515733+0000","last_unstale":"2023-07-21T19:07:53.524354+0000","last_undegraded":"2023-07-21T19:07:53.524354+0000","last_fullsized":"2023-07-21T19:07:53.524354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:45.580924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837125+0000","last_change":"2023-07-21T19:07:48.456327+0000","last_active":"2023-07-21T19:07:53.837125+0000","last_peered":"2023-07-21T19:07:53.837125+0000","last_clean":"2023-07-21T19:07:53.837125+0000","last_became_active":"2023-07-21T19:07:48.456006+0000","last_became_peered":"2023-07-21T19:07:48.456006+0000","last_unstale":"2023-07-21T19:07:53.837125+0000","last_undegraded":"2023-07-21T19:07:53.837125+0000","last_fullsized":"2023-07-21T19:07:53.837125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:29.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836564+0000","last_change":"2023-07-21T19:07:47.421721+0000","last_active":"2023-07-21T19:07:53.836564+0000","last_peered":"2023-07-21T19:07:53.836564+0000","last_clean":"2023-07-21T19:07:53.836564+0000","last_became_active":"2023-07-21T19:07:47.421381+0000","last_became_peered":"2023-07-21T19:07:47.421381+0000","last_unstale":"2023-07-21T19:07:53.836564+0000","last_undegraded":"2023-07-21T19:07:53.836564+0000","last_fullsized":"2023-07-21T19:07:53.836564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:39.711801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836660+0000","last_change":"2023-07-21T19:07:42.603235+0000","last_active":"2023-07-21T19:07:53.836660+0000","last_peered":"2023-07-21T19:07:53.836660+0000","last_clean":"2023-07-21T19:07:53.836660+0000","last_became_active":"2023-07-21T19:07:42.602762+0000","last_became_peered":"2023-07-21T19:07:42.602762+0000","last_unstale":"2023-07-21T19:07:53.836660+0000","last_undegraded":"2023-07-21T19:07:53.836660+0000","last_fullsized":"2023-07-21T19:07:53.836660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:30:32.377809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838524+0000","last_change":"2023-07-21T19:07:52.527041+0000","last_active":"2023-07-21T19:07:53.838524+0000","last_peered":"2023-07-21T19:07:53.838524+0000","last_clean":"2023-07-21T19:07:53.838524+0000","last_became_active":"2023-07-21T19:07:52.526709+0000","last_became_peered":"2023-07-21T19:07:52.526709+0000","last_unstale":"2023-07-21T19:07:53.838524+0000","last_undegraded":"2023-07-21T19:07:53.838524+0000","last_fullsized":"2023-07-21T19:07:53.838524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:39.886059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524830+0000","last_change":"2023-07-21T19:07:48.463144+0000","last_active":"2023-07-21T19:07:53.524830+0000","last_peered":"2023-07-21T19:07:53.524830+0000","last_clean":"2023-07-21T19:07:53.524830+0000","last_became_active":"2023-07-21T19:07:48.462845+0000","last_became_peered":"2023-07-21T19:07:48.462845+0000","last_unstale":"2023-07-21T19:07:53.524830+0000","last_undegraded":"2023-07-21T19:07:53.524830+0000","last_fullsized":"2023-07-21T19:07:53.524830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:09.348453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523238+0000","last_change":"2023-07-21T19:07:47.431757+0000","last_active":"2023-07-21T19:07:53.523238+0000","last_peered":"2023-07-21T19:07:53.523238+0000","last_clean":"2023-07-21T19:07:53.523238+0000","last_became_active":"2023-07-21T19:07:47.431418+0000","last_became_peered":"2023-07-21T19:07:47.431418+0000","last_unstale":"2023-07-21T19:07:53.523238+0000","last_undegraded":"2023-07-21T19:07:53.523238+0000","last_fullsized":"2023-07-21T19:07:53.523238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:29.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832922+0000","last_change":"2023-07-21T19:07:42.365054+0000","last_active":"2023-07-21T19:07:53.832922+0000","last_peered":"2023-07-21T19:07:53.832922+0000","last_clean":"2023-07-21T19:07:53.832922+0000","last_became_active":"2023-07-21T19:07:42.364497+0000","last_became_peered":"2023-07-21T19:07:42.364497+0000","last_unstale":"2023-07-21T19:07:53.832922+0000","last_undegraded":"2023-07-21T19:07:53.832922+0000","last_fullsized":"2023-07-21T19:07:53.832922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:39:14.792794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525146+0000","last_change":"2023-07-21T19:07:52.521002+0000","last_active":"2023-07-21T19:07:53.525146+0000","last_peered":"2023-07-21T19:07:53.525146+0000","last_clean":"2023-07-21T19:07:53.525146+0000","last_became_active":"2023-07-21T19:07:52.520183+0000","last_became_peered":"2023-07-21T19:07:52.520183+0000","last_unstale":"2023-07-21T19:07:53.525146+0000","last_undegraded":"2023-07-21T19:07:53.525146+0000","last_fullsized":"2023-07-21T19:07:53.525146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:04.157404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835018+0000","last_change":"2023-07-21T19:07:48.450486+0000","last_active":"2023-07-21T19:07:53.835018+0000","last_peered":"2023-07-21T19:07:53.835018+0000","last_clean":"2023-07-21T19:07:53.835018+0000","last_became_active":"2023-07-21T19:07:48.450113+0000","last_became_peered":"2023-07-21T19:07:48.450113+0000","last_unstale":"2023-07-21T19:07:53.835018+0000","last_undegraded":"2023-07-21T19:07:53.835018+0000","last_fullsized":"2023-07-21T19:07:53.835018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:42.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834245+0000","last_change":"2023-07-21T19:07:47.423195+0000","last_active":"2023-07-21T19:07:53.834245+0000","last_peered":"2023-07-21T19:07:53.834245+0000","last_clean":"2023-07-21T19:07:53.834245+0000","last_became_active":"2023-07-21T19:07:47.422860+0000","last_became_peered":"2023-07-21T19:07:47.422860+0000","last_unstale":"2023-07-21T19:07:53.834245+0000","last_undegraded":"2023-07-21T19:07:53.834245+0000","last_fullsized":"2023-07-21T19:07:53.834245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:55.435800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524131+0000","last_change":"2023-07-21T19:07:42.362560+0000","last_active":"2023-07-21T19:07:53.524131+0000","last_peered":"2023-07-21T19:07:53.524131+0000","last_clean":"2023-07-21T19:07:53.524131+0000","last_became_active":"2023-07-21T19:07:42.362066+0000","last_became_peered":"2023-07-21T19:07:42.362066+0000","last_unstale":"2023-07-21T19:07:53.524131+0000","last_undegraded":"2023-07-21T19:07:53.524131+0000","last_fullsized":"2023-07-21T19:07:53.524131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:45.371360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833450+0000","last_change":"2023-07-21T19:07:37.495346+0000","last_active":"2023-07-21T19:07:53.833450+0000","last_peered":"2023-07-21T19:07:53.833450+0000","last_clean":"2023-07-21T19:07:53.833450+0000","last_became_active":"2023-07-21T19:07:37.492842+0000","last_became_peered":"2023-07-21T19:07:37.492842+0000","last_unstale":"2023-07-21T19:07:53.833450+0000","last_undegraded":"2023-07-21T19:07:53.833450+0000","last_fullsized":"2023-07-21T19:07:53.833450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_clean_scrub_stamp":"2023-07-21T19:07:36.226507+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:43.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833439+0000","last_change":"2023-07-21T19:07:52.522487+0000","last_active":"2023-07-21T19:07:53.833439+0000","last_peered":"2023-07-21T19:07:53.833439+0000","last_clean":"2023-07-21T19:07:53.833439+0000","last_became_active":"2023-07-21T19:07:52.522124+0000","last_became_peered":"2023-07-21T19:07:52.522124+0000","last_unstale":"2023-07-21T19:07:53.833439+0000","last_undegraded":"2023-07-21T19:07:53.833439+0000","last_fullsized":"2023-07-21T19:07:53.833439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836991+0000","last_change":"2023-07-21T19:07:48.464190+0000","last_active":"2023-07-21T19:07:53.836991+0000","last_peered":"2023-07-21T19:07:53.836991+0000","last_clean":"2023-07-21T19:07:53.836991+0000","last_became_active":"2023-07-21T19:07:48.463260+0000","last_became_peered":"2023-07-21T19:07:48.463260+0000","last_unstale":"2023-07-21T19:07:53.836991+0000","last_undegraded":"2023-07-21T19:07:53.836991+0000","last_fullsized":"2023-07-21T19:07:53.836991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:30.223087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834539+0000","last_change":"2023-07-21T19:07:47.423593+0000","last_active":"2023-07-21T19:07:53.834539+0000","last_peered":"2023-07-21T19:07:53.834539+0000","last_clean":"2023-07-21T19:07:53.834539+0000","last_became_active":"2023-07-21T19:07:47.423276+0000","last_became_peered":"2023-07-21T19:07:47.423276+0000","last_unstale":"2023-07-21T19:07:53.834539+0000","last_undegraded":"2023-07-21T19:07:53.834539+0000","last_fullsized":"2023-07-21T19:07:53.834539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:04.041873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525405+0000","last_change":"2023-07-21T19:07:52.529461+0000","last_active":"2023-07-21T19:07:53.525405+0000","last_peered":"2023-07-21T19:07:53.525405+0000","last_clean":"2023-07-21T19:07:53.525405+0000","last_became_active":"2023-07-21T19:07:52.528852+0000","last_became_peered":"2023-07-21T19:07:52.528852+0000","last_unstale":"2023-07-21T19:07:53.525405+0000","last_undegraded":"2023-07-21T19:07:53.525405+0000","last_fullsized":"2023-07-21T19:07:53.525405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:10:30.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525377+0000","last_change":"2023-07-21T19:07:48.458201+0000","last_active":"2023-07-21T19:07:53.525377+0000","last_peered":"2023-07-21T19:07:53.525377+0000","last_clean":"2023-07-21T19:07:53.525377+0000","last_became_active":"2023-07-21T19:07:48.457846+0000","last_became_peered":"2023-07-21T19:07:48.457846+0000","last_unstale":"2023-07-21T19:07:53.525377+0000","last_undegraded":"2023-07-21T19:07:53.525377+0000","last_fullsized":"2023-07-21T19:07:53.525377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:09.687359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522942+0000","last_change":"2023-07-21T19:07:47.425071+0000","last_active":"2023-07-21T19:07:53.522942+0000","last_peered":"2023-07-21T19:07:53.522942+0000","last_clean":"2023-07-21T19:07:53.522942+0000","last_became_active":"2023-07-21T19:07:47.424794+0000","last_became_peered":"2023-07-21T19:07:47.424794+0000","last_unstale":"2023-07-21T19:07:53.522942+0000","last_undegraded":"2023-07-21T19:07:53.522942+0000","last_fullsized":"2023-07-21T19:07:53.522942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:51:34.225679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524727+0000","last_change":"2023-07-21T19:07:52.521246+0000","last_active":"2023-07-21T19:07:53.524727+0000","last_peered":"2023-07-21T19:07:53.524727+0000","last_clean":"2023-07-21T19:07:53.524727+0000","last_became_active":"2023-07-21T19:07:52.520645+0000","last_became_peered":"2023-07-21T19:07:52.520645+0000","last_unstale":"2023-07-21T19:07:53.524727+0000","last_undegraded":"2023-07-21T19:07:53.524727+0000","last_fullsized":"2023-07-21T19:07:53.524727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:44.264010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524230+0000","last_change":"2023-07-21T19:07:48.461186+0000","last_active":"2023-07-21T19:07:53.524230+0000","last_peered":"2023-07-21T19:07:53.524230+0000","last_clean":"2023-07-21T19:07:53.524230+0000","last_became_active":"2023-07-21T19:07:48.460686+0000","last_became_peered":"2023-07-21T19:07:48.460686+0000","last_unstale":"2023-07-21T19:07:53.524230+0000","last_undegraded":"2023-07-21T19:07:53.524230+0000","last_fullsized":"2023-07-21T19:07:53.524230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:53:34.225618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834185+0000","last_change":"2023-07-21T19:07:47.429361+0000","last_active":"2023-07-21T19:07:53.834185+0000","last_peered":"2023-07-21T19:07:53.834185+0000","last_clean":"2023-07-21T19:07:53.834185+0000","last_became_active":"2023-07-21T19:07:47.429045+0000","last_became_peered":"2023-07-21T19:07:47.429045+0000","last_unstale":"2023-07-21T19:07:53.834185+0000","last_undegraded":"2023-07-21T19:07:53.834185+0000","last_fullsized":"2023-07-21T19:07:53.834185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:46.738002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836869+0000","last_change":"2023-07-21T19:07:52.519252+0000","last_active":"2023-07-21T19:07:53.836869+0000","last_peered":"2023-07-21T19:07:53.836869+0000","last_clean":"2023-07-21T19:07:53.836869+0000","last_became_active":"2023-07-21T19:07:52.518688+0000","last_became_peered":"2023-07-21T19:07:52.518688+0000","last_unstale":"2023-07-21T19:07:53.836869+0000","last_undegraded":"2023-07-21T19:07:53.836869+0000","last_fullsized":"2023-07-21T19:07:53.836869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:50.938236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525123+0000","last_change":"2023-07-21T19:07:48.447289+0000","last_active":"2023-07-21T19:07:53.525123+0000","last_peered":"2023-07-21T19:07:53.525123+0000","last_clean":"2023-07-21T19:07:53.525123+0000","last_became_active":"2023-07-21T19:07:48.446841+0000","last_became_peered":"2023-07-21T19:07:48.446841+0000","last_unstale":"2023-07-21T19:07:53.525123+0000","last_undegraded":"2023-07-21T19:07:53.525123+0000","last_fullsized":"2023-07-21T19:07:53.525123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:35:02.284757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834212+0000","last_change":"2023-07-21T19:07:47.428249+0000","last_active":"2023-07-21T19:07:53.834212+0000","last_peered":"2023-07-21T19:07:53.834212+0000","last_clean":"2023-07-21T19:07:53.834212+0000","last_became_active":"2023-07-21T19:07:47.425547+0000","last_became_peered":"2023-07-21T19:07:47.425547+0000","last_unstale":"2023-07-21T19:07:53.834212+0000","last_undegraded":"2023-07-21T19:07:53.834212+0000","last_fullsized":"2023-07-21T19:07:53.834212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:08.336001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836450+0000","last_change":"2023-07-21T19:07:52.527359+0000","last_active":"2023-07-21T19:07:53.836450+0000","last_peered":"2023-07-21T19:07:53.836450+0000","last_clean":"2023-07-21T19:07:53.836450+0000","last_became_active":"2023-07-21T19:07:52.526874+0000","last_became_peered":"2023-07-21T19:07:52.526874+0000","last_unstale":"2023-07-21T19:07:53.836450+0000","last_undegraded":"2023-07-21T19:07:53.836450+0000","last_fullsized":"2023-07-21T19:07:53.836450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:31:40.974408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523734+0000","last_change":"2023-07-21T19:07:48.455173+0000","last_active":"2023-07-21T19:07:53.523734+0000","last_peered":"2023-07-21T19:07:53.523734+0000","last_clean":"2023-07-21T19:07:53.523734+0000","last_became_active":"2023-07-21T19:07:48.454831+0000","last_became_peered":"2023-07-21T19:07:48.454831+0000","last_unstale":"2023-07-21T19:07:53.523734+0000","last_undegraded":"2023-07-21T19:07:53.523734+0000","last_fullsized":"2023-07-21T19:07:53.523734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:36.861607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524469+0000","last_change":"2023-07-21T19:07:47.423659+0000","last_active":"2023-07-21T19:07:53.524469+0000","last_peered":"2023-07-21T19:07:53.524469+0000","last_clean":"2023-07-21T19:07:53.524469+0000","last_became_active":"2023-07-21T19:07:47.423361+0000","last_became_peered":"2023-07-21T19:07:47.423361+0000","last_unstale":"2023-07-21T19:07:53.524469+0000","last_undegraded":"2023-07-21T19:07:53.524469+0000","last_fullsized":"2023-07-21T19:07:53.524469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:39.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837028+0000","last_change":"2023-07-21T19:07:52.521996+0000","last_active":"2023-07-21T19:07:53.837028+0000","last_peered":"2023-07-21T19:07:53.837028+0000","last_clean":"2023-07-21T19:07:53.837028+0000","last_became_active":"2023-07-21T19:07:52.521602+0000","last_became_peered":"2023-07-21T19:07:52.521602+0000","last_unstale":"2023-07-21T19:07:53.837028+0000","last_undegraded":"2023-07-21T19:07:53.837028+0000","last_fullsized":"2023-07-21T19:07:53.837028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:10.532572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833328+0000","last_change":"2023-07-21T19:07:48.467352+0000","last_active":"2023-07-21T19:07:53.833328+0000","last_peered":"2023-07-21T19:07:53.833328+0000","last_clean":"2023-07-21T19:07:53.833328+0000","last_became_active":"2023-07-21T19:07:48.467124+0000","last_became_peered":"2023-07-21T19:07:48.467124+0000","last_unstale":"2023-07-21T19:07:53.833328+0000","last_undegraded":"2023-07-21T19:07:53.833328+0000","last_fullsized":"2023-07-21T19:07:53.833328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:00:50.853377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833618+0000","last_change":"2023-07-21T19:07:47.419617+0000","last_active":"2023-07-21T19:07:53.833618+0000","last_peered":"2023-07-21T19:07:53.833618+0000","last_clean":"2023-07-21T19:07:53.833618+0000","last_became_active":"2023-07-21T19:07:47.419364+0000","last_became_peered":"2023-07-21T19:07:47.419364+0000","last_unstale":"2023-07-21T19:07:53.833618+0000","last_undegraded":"2023-07-21T19:07:53.833618+0000","last_fullsized":"2023-07-21T19:07:53.833618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:09.580592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837324+0000","last_change":"2023-07-21T19:07:52.529056+0000","last_active":"2023-07-21T19:07:53.837324+0000","last_peered":"2023-07-21T19:07:53.837324+0000","last_clean":"2023-07-21T19:07:53.837324+0000","last_became_active":"2023-07-21T19:07:52.528625+0000","last_became_peered":"2023-07-21T19:07:52.528625+0000","last_unstale":"2023-07-21T19:07:53.837324+0000","last_undegraded":"2023-07-21T19:07:53.837324+0000","last_fullsized":"2023-07-21T19:07:53.837324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:18:02.894869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522766+0000","last_change":"2023-07-21T19:07:48.448246+0000","last_active":"2023-07-21T19:07:53.522766+0000","last_peered":"2023-07-21T19:07:53.522766+0000","last_clean":"2023-07-21T19:07:53.522766+0000","last_became_active":"2023-07-21T19:07:48.447965+0000","last_became_peered":"2023-07-21T19:07:48.447965+0000","last_unstale":"2023-07-21T19:07:53.522766+0000","last_undegraded":"2023-07-21T19:07:53.522766+0000","last_fullsized":"2023-07-21T19:07:53.522766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:21.169814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833962+0000","last_change":"2023-07-21T19:07:47.431735+0000","last_active":"2023-07-21T19:07:53.833962+0000","last_peered":"2023-07-21T19:07:53.833962+0000","last_clean":"2023-07-21T19:07:53.833962+0000","last_became_active":"2023-07-21T19:07:47.431420+0000","last_became_peered":"2023-07-21T19:07:47.431420+0000","last_unstale":"2023-07-21T19:07:53.833962+0000","last_undegraded":"2023-07-21T19:07:53.833962+0000","last_fullsized":"2023-07-21T19:07:53.833962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:00.446483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836462+0000","last_change":"2023-07-21T19:07:52.516923+0000","last_active":"2023-07-21T19:07:53.836462+0000","last_peered":"2023-07-21T19:07:53.836462+0000","last_clean":"2023-07-21T19:07:53.836462+0000","last_became_active":"2023-07-21T19:07:52.516533+0000","last_became_peered":"2023-07-21T19:07:52.516533+0000","last_unstale":"2023-07-21T19:07:53.836462+0000","last_undegraded":"2023-07-21T19:07:53.836462+0000","last_fullsized":"2023-07-21T19:07:53.836462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:22.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523297+0000","last_change":"2023-07-21T19:07:48.459424+0000","last_active":"2023-07-21T19:07:53.523297+0000","last_peered":"2023-07-21T19:07:53.523297+0000","last_clean":"2023-07-21T19:07:53.523297+0000","last_became_active":"2023-07-21T19:07:48.459144+0000","last_became_peered":"2023-07-21T19:07:48.459144+0000","last_unstale":"2023-07-21T19:07:53.523297+0000","last_undegraded":"2023-07-21T19:07:53.523297+0000","last_fullsized":"2023-07-21T19:07:53.523297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:35.412688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834289+0000","last_change":"2023-07-21T19:07:47.429355+0000","last_active":"2023-07-21T19:07:53.834289+0000","last_peered":"2023-07-21T19:07:53.834289+0000","last_clean":"2023-07-21T19:07:53.834289+0000","last_became_active":"2023-07-21T19:07:47.429099+0000","last_became_peered":"2023-07-21T19:07:47.429099+0000","last_unstale":"2023-07-21T19:07:53.834289+0000","last_undegraded":"2023-07-21T19:07:53.834289+0000","last_fullsized":"2023-07-21T19:07:53.834289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:29.242479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833072+0000","last_change":"2023-07-21T19:07:52.535684+0000","last_active":"2023-07-21T19:07:53.833072+0000","last_peered":"2023-07-21T19:07:53.833072+0000","last_clean":"2023-07-21T19:07:53.833072+0000","last_became_active":"2023-07-21T19:07:52.534977+0000","last_became_peered":"2023-07-21T19:07:52.534977+0000","last_unstale":"2023-07-21T19:07:53.833072+0000","last_undegraded":"2023-07-21T19:07:53.833072+0000","last_fullsized":"2023-07-21T19:07:53.833072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:55.503014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524655+0000","last_change":"2023-07-21T19:07:52.524161+0000","last_active":"2023-07-21T19:07:53.524655+0000","last_peered":"2023-07-21T19:07:53.524655+0000","last_clean":"2023-07-21T19:07:53.524655+0000","last_became_active":"2023-07-21T19:07:52.521210+0000","last_became_peered":"2023-07-21T19:07:52.521210+0000","last_unstale":"2023-07-21T19:07:53.524655+0000","last_undegraded":"2023-07-21T19:07:53.524655+0000","last_fullsized":"2023-07-21T19:07:53.524655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:46.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833020+0000","last_change":"2023-07-21T19:07:47.415004+0000","last_active":"2023-07-21T19:07:53.833020+0000","last_peered":"2023-07-21T19:07:53.833020+0000","last_clean":"2023-07-21T19:07:53.833020+0000","last_became_active":"2023-07-21T19:07:47.414722+0000","last_became_peered":"2023-07-21T19:07:47.414722+0000","last_unstale":"2023-07-21T19:07:53.833020+0000","last_undegraded":"2023-07-21T19:07:53.833020+0000","last_fullsized":"2023-07-21T19:07:53.833020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:24.856635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835510+0000","last_change":"2023-07-21T19:07:48.455578+0000","last_active":"2023-07-21T19:07:53.835510+0000","last_peered":"2023-07-21T19:07:53.835510+0000","last_clean":"2023-07-21T19:07:53.835510+0000","last_became_active":"2023-07-21T19:07:48.455308+0000","last_became_peered":"2023-07-21T19:07:48.455308+0000","last_unstale":"2023-07-21T19:07:53.835510+0000","last_undegraded":"2023-07-21T19:07:53.835510+0000","last_fullsized":"2023-07-21T19:07:53.835510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.835286+0000","last_change":"2023-07-21T19:07:52.523627+0000","last_active":"2023-07-21T19:07:53.835286+0000","last_peered":"2023-07-21T19:07:53.835286+0000","last_clean":"2023-07-21T19:07:53.835286+0000","last_became_active":"2023-07-21T19:07:52.523029+0000","last_became_peered":"2023-07-21T19:07:52.523029+0000","last_unstale":"2023-07-21T19:07:53.835286+0000","last_undegraded":"2023-07-21T19:07:53.835286+0000","last_fullsized":"2023-07-21T19:07:53.835286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:46.065489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833239+0000","last_change":"2023-07-21T19:07:47.431726+0000","last_active":"2023-07-21T19:07:53.833239+0000","last_peered":"2023-07-21T19:07:53.833239+0000","last_clean":"2023-07-21T19:07:53.833239+0000","last_became_active":"2023-07-21T19:07:47.431482+0000","last_became_peered":"2023-07-21T19:07:47.431482+0000","last_unstale":"2023-07-21T19:07:53.833239+0000","last_undegraded":"2023-07-21T19:07:53.833239+0000","last_fullsized":"2023-07-21T19:07:53.833239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:43.739221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524914+0000","last_change":"2023-07-21T19:07:48.451700+0000","last_active":"2023-07-21T19:07:53.524914+0000","last_peered":"2023-07-21T19:07:53.524914+0000","last_clean":"2023-07-21T19:07:53.524914+0000","last_became_active":"2023-07-21T19:07:48.451403+0000","last_became_peered":"2023-07-21T19:07:48.451403+0000","last_unstale":"2023-07-21T19:07:53.524914+0000","last_undegraded":"2023-07-21T19:07:53.524914+0000","last_fullsized":"2023-07-21T19:07:53.524914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:44.214378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523591+0000","last_change":"2023-07-21T19:07:47.423135+0000","last_active":"2023-07-21T19:07:53.523591+0000","last_peered":"2023-07-21T19:07:53.523591+0000","last_clean":"2023-07-21T19:07:53.523591+0000","last_became_active":"2023-07-21T19:07:47.422803+0000","last_became_peered":"2023-07-21T19:07:47.422803+0000","last_unstale":"2023-07-21T19:07:53.523591+0000","last_undegraded":"2023-07-21T19:07:53.523591+0000","last_fullsized":"2023-07-21T19:07:53.523591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:17:28.397260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525042+0000","last_change":"2023-07-21T19:07:48.457131+0000","last_active":"2023-07-21T19:07:53.525042+0000","last_peered":"2023-07-21T19:07:53.525042+0000","last_clean":"2023-07-21T19:07:53.525042+0000","last_became_active":"2023-07-21T19:07:48.456793+0000","last_became_peered":"2023-07-21T19:07:48.456793+0000","last_unstale":"2023-07-21T19:07:53.525042+0000","last_undegraded":"2023-07-21T19:07:53.525042+0000","last_fullsized":"2023-07-21T19:07:53.525042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:01.458935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834400+0000","last_change":"2023-07-21T19:07:52.518169+0000","last_active":"2023-07-21T19:07:53.834400+0000","last_peered":"2023-07-21T19:07:53.834400+0000","last_clean":"2023-07-21T19:07:53.834400+0000","last_became_active":"2023-07-21T19:07:52.517772+0000","last_became_peered":"2023-07-21T19:07:52.517772+0000","last_unstale":"2023-07-21T19:07:53.834400+0000","last_undegraded":"2023-07-21T19:07:53.834400+0000","last_fullsized":"2023-07-21T19:07:53.834400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:51.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834407+0000","last_change":"2023-07-21T19:07:47.432451+0000","last_active":"2023-07-21T19:07:53.834407+0000","last_peered":"2023-07-21T19:07:53.834407+0000","last_clean":"2023-07-21T19:07:53.834407+0000","last_became_active":"2023-07-21T19:07:47.432158+0000","last_became_peered":"2023-07-21T19:07:47.432158+0000","last_unstale":"2023-07-21T19:07:53.834407+0000","last_undegraded":"2023-07-21T19:07:53.834407+0000","last_fullsized":"2023-07-21T19:07:53.834407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:46.373958+0000","last_clean_scrub_stamp":"2023-07-21T19:07:46.373958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:54.551812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834759+0000","last_change":"2023-07-21T19:07:48.468705+0000","last_active":"2023-07-21T19:07:53.834759+0000","last_peered":"2023-07-21T19:07:53.834759+0000","last_clean":"2023-07-21T19:07:53.834759+0000","last_became_active":"2023-07-21T19:07:48.467669+0000","last_became_peered":"2023-07-21T19:07:48.467669+0000","last_unstale":"2023-07-21T19:07:53.834759+0000","last_undegraded":"2023-07-21T19:07:53.834759+0000","last_fullsized":"2023-07-21T19:07:53.834759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524694+0000","last_change":"2023-07-21T19:07:52.520703+0000","last_active":"2023-07-21T19:07:53.524694+0000","last_peered":"2023-07-21T19:07:53.524694+0000","last_clean":"2023-07-21T19:07:53.524694+0000","last_became_active":"2023-07-21T19:07:52.520253+0000","last_became_peered":"2023-07-21T19:07:52.520253+0000","last_unstale":"2023-07-21T19:07:53.524694+0000","last_undegraded":"2023-07-21T19:07:53.524694+0000","last_fullsized":"2023-07-21T19:07:53.524694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:51.475574+0000","last_clean_scrub_stamp":"2023-07-21T19:07:51.475574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:48.840837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832788+0000","last_change":"2023-07-21T19:07:48.450536+0000","last_active":"2023-07-21T19:07:53.832788+0000","last_peered":"2023-07-21T19:07:53.832788+0000","last_clean":"2023-07-21T19:07:53.832788+0000","last_became_active":"2023-07-21T19:07:48.450167+0000","last_became_peered":"2023-07-21T19:07:48.450167+0000","last_unstale":"2023-07-21T19:07:53.832788+0000","last_undegraded":"2023-07-21T19:07:53.832788+0000","last_fullsized":"2023-07-21T19:07:53.832788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:38.287958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834518+0000","last_change":"2023-07-21T19:07:48.468556+0000","last_active":"2023-07-21T19:07:53.834518+0000","last_peered":"2023-07-21T19:07:53.834518+0000","last_clean":"2023-07-21T19:07:53.834518+0000","last_became_active":"2023-07-21T19:07:48.468254+0000","last_became_peered":"2023-07-21T19:07:48.468254+0000","last_unstale":"2023-07-21T19:07:53.834518+0000","last_undegraded":"2023-07-21T19:07:53.834518+0000","last_fullsized":"2023-07-21T19:07:53.834518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:08:44.578401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523567+0000","last_change":"2023-07-21T19:07:48.458141+0000","last_active":"2023-07-21T19:07:53.523567+0000","last_peered":"2023-07-21T19:07:53.523567+0000","last_clean":"2023-07-21T19:07:53.523567+0000","last_became_active":"2023-07-21T19:07:48.457777+0000","last_became_peered":"2023-07-21T19:07:48.457777+0000","last_unstale":"2023-07-21T19:07:53.523567+0000","last_undegraded":"2023-07-21T19:07:53.523567+0000","last_fullsized":"2023-07-21T19:07:53.523567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:26.864071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834004+0000","last_change":"2023-07-21T19:07:48.461028+0000","last_active":"2023-07-21T19:07:53.834004+0000","last_peered":"2023-07-21T19:07:53.834004+0000","last_clean":"2023-07-21T19:07:53.834004+0000","last_became_active":"2023-07-21T19:07:48.460706+0000","last_became_peered":"2023-07-21T19:07:48.460706+0000","last_unstale":"2023-07-21T19:07:53.834004+0000","last_undegraded":"2023-07-21T19:07:53.834004+0000","last_fullsized":"2023-07-21T19:07:53.834004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837596+0000","last_change":"2023-07-21T19:07:48.465807+0000","last_active":"2023-07-21T19:07:53.837596+0000","last_peered":"2023-07-21T19:07:53.837596+0000","last_clean":"2023-07-21T19:07:53.837596+0000","last_became_active":"2023-07-21T19:07:48.465438+0000","last_became_peered":"2023-07-21T19:07:48.465438+0000","last_unstale":"2023-07-21T19:07:53.837596+0000","last_undegraded":"2023-07-21T19:07:53.837596+0000","last_fullsized":"2023-07-21T19:07:53.837596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:27:40.829008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524894+0000","last_change":"2023-07-21T19:07:48.457206+0000","last_active":"2023-07-21T19:07:53.524894+0000","last_peered":"2023-07-21T19:07:53.524894+0000","last_clean":"2023-07-21T19:07:53.524894+0000","last_became_active":"2023-07-21T19:07:48.456904+0000","last_became_peered":"2023-07-21T19:07:48.456904+0000","last_unstale":"2023-07-21T19:07:53.524894+0000","last_undegraded":"2023-07-21T19:07:53.524894+0000","last_fullsized":"2023-07-21T19:07:53.524894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:27.588370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838192+0000","last_change":"2023-07-21T19:07:48.466649+0000","last_active":"2023-07-21T19:07:53.838192+0000","last_peered":"2023-07-21T19:07:53.838192+0000","last_clean":"2023-07-21T19:07:53.838192+0000","last_became_active":"2023-07-21T19:07:48.466399+0000","last_became_peered":"2023-07-21T19:07:48.466399+0000","last_unstale":"2023-07-21T19:07:53.838192+0000","last_undegraded":"2023-07-21T19:07:53.838192+0000","last_fullsized":"2023-07-21T19:07:53.838192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:47:29.239472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836840+0000","last_change":"2023-07-21T19:07:48.457556+0000","last_active":"2023-07-21T19:07:53.836840+0000","last_peered":"2023-07-21T19:07:53.836840+0000","last_clean":"2023-07-21T19:07:53.836840+0000","last_became_active":"2023-07-21T19:07:48.457008+0000","last_became_peered":"2023-07-21T19:07:48.457008+0000","last_unstale":"2023-07-21T19:07:53.836840+0000","last_undegraded":"2023-07-21T19:07:53.836840+0000","last_fullsized":"2023-07-21T19:07:53.836840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832601+0000","last_change":"2023-07-21T19:07:48.459157+0000","last_active":"2023-07-21T19:07:53.832601+0000","last_peered":"2023-07-21T19:07:53.832601+0000","last_clean":"2023-07-21T19:07:53.832601+0000","last_became_active":"2023-07-21T19:07:48.458742+0000","last_became_peered":"2023-07-21T19:07:48.458742+0000","last_unstale":"2023-07-21T19:07:53.832601+0000","last_undegraded":"2023-07-21T19:07:53.832601+0000","last_fullsized":"2023-07-21T19:07:53.832601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834329+0000","last_change":"2023-07-21T19:07:48.460206+0000","last_active":"2023-07-21T19:07:53.834329+0000","last_peered":"2023-07-21T19:07:53.834329+0000","last_clean":"2023-07-21T19:07:53.834329+0000","last_became_active":"2023-07-21T19:07:48.459889+0000","last_became_peered":"2023-07-21T19:07:48.459889+0000","last_unstale":"2023-07-21T19:07:53.834329+0000","last_undegraded":"2023-07-21T19:07:53.834329+0000","last_fullsized":"2023-07-21T19:07:53.834329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523456+0000","last_change":"2023-07-21T19:07:48.467621+0000","last_active":"2023-07-21T19:07:53.523456+0000","last_peered":"2023-07-21T19:07:53.523456+0000","last_clean":"2023-07-21T19:07:53.523456+0000","last_became_active":"2023-07-21T19:07:48.467359+0000","last_became_peered":"2023-07-21T19:07:48.467359+0000","last_unstale":"2023-07-21T19:07:53.523456+0000","last_undegraded":"2023-07-21T19:07:53.523456+0000","last_fullsized":"2023-07-21T19:07:53.523456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:00:17.804609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834253+0000","last_change":"2023-07-21T19:07:48.460711+0000","last_active":"2023-07-21T19:07:53.834253+0000","last_peered":"2023-07-21T19:07:53.834253+0000","last_clean":"2023-07-21T19:07:53.834253+0000","last_became_active":"2023-07-21T19:07:48.459973+0000","last_became_peered":"2023-07-21T19:07:48.459973+0000","last_unstale":"2023-07-21T19:07:53.834253+0000","last_undegraded":"2023-07-21T19:07:53.834253+0000","last_fullsized":"2023-07-21T19:07:53.834253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:00.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524979+0000","last_change":"2023-07-21T19:07:48.458886+0000","last_active":"2023-07-21T19:07:53.524979+0000","last_peered":"2023-07-21T19:07:53.524979+0000","last_clean":"2023-07-21T19:07:53.524979+0000","last_became_active":"2023-07-21T19:07:48.458061+0000","last_became_peered":"2023-07-21T19:07:48.458061+0000","last_unstale":"2023-07-21T19:07:53.524979+0000","last_undegraded":"2023-07-21T19:07:53.524979+0000","last_fullsized":"2023-07-21T19:07:53.524979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:33.659391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.836557+0000","last_change":"2023-07-21T19:07:48.462686+0000","last_active":"2023-07-21T19:07:53.836557+0000","last_peered":"2023-07-21T19:07:53.836557+0000","last_clean":"2023-07-21T19:07:53.836557+0000","last_became_active":"2023-07-21T19:07:48.462297+0000","last_became_peered":"2023-07-21T19:07:48.462297+0000","last_unstale":"2023-07-21T19:07:53.836557+0000","last_undegraded":"2023-07-21T19:07:53.836557+0000","last_fullsized":"2023-07-21T19:07:53.836557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:34:16.617396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523127+0000","last_change":"2023-07-21T19:07:48.447297+0000","last_active":"2023-07-21T19:07:53.523127+0000","last_peered":"2023-07-21T19:07:53.523127+0000","last_clean":"2023-07-21T19:07:53.523127+0000","last_became_active":"2023-07-21T19:07:48.446963+0000","last_became_peered":"2023-07-21T19:07:48.446963+0000","last_unstale":"2023-07-21T19:07:53.523127+0000","last_undegraded":"2023-07-21T19:07:53.523127+0000","last_fullsized":"2023-07-21T19:07:53.523127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:33.698602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.525034+0000","last_change":"2023-07-21T19:07:48.459709+0000","last_active":"2023-07-21T19:07:53.525034+0000","last_peered":"2023-07-21T19:07:53.525034+0000","last_clean":"2023-07-21T19:07:53.525034+0000","last_became_active":"2023-07-21T19:07:48.459450+0000","last_became_peered":"2023-07-21T19:07:48.459450+0000","last_unstale":"2023-07-21T19:07:53.525034+0000","last_undegraded":"2023-07-21T19:07:53.525034+0000","last_fullsized":"2023-07-21T19:07:53.525034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:32:59.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.522497+0000","last_change":"2023-07-21T19:07:48.451039+0000","last_active":"2023-07-21T19:07:53.522497+0000","last_peered":"2023-07-21T19:07:53.522497+0000","last_clean":"2023-07-21T19:07:53.522497+0000","last_became_active":"2023-07-21T19:07:48.450731+0000","last_became_peered":"2023-07-21T19:07:48.450731+0000","last_unstale":"2023-07-21T19:07:53.522497+0000","last_undegraded":"2023-07-21T19:07:53.522497+0000","last_fullsized":"2023-07-21T19:07:53.522497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:26:01.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.833016+0000","last_change":"2023-07-21T19:07:48.472483+0000","last_active":"2023-07-21T19:07:53.833016+0000","last_peered":"2023-07-21T19:07:53.833016+0000","last_clean":"2023-07-21T19:07:53.833016+0000","last_became_active":"2023-07-21T19:07:48.472205+0000","last_became_peered":"2023-07-21T19:07:48.472205+0000","last_unstale":"2023-07-21T19:07:53.833016+0000","last_undegraded":"2023-07-21T19:07:53.833016+0000","last_fullsized":"2023-07-21T19:07:53.833016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:40.712184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523605+0000","last_change":"2023-07-21T19:07:48.450016+0000","last_active":"2023-07-21T19:07:53.523605+0000","last_peered":"2023-07-21T19:07:53.523605+0000","last_clean":"2023-07-21T19:07:53.523605+0000","last_became_active":"2023-07-21T19:07:48.449429+0000","last_became_peered":"2023-07-21T19:07:48.449429+0000","last_unstale":"2023-07-21T19:07:53.523605+0000","last_undegraded":"2023-07-21T19:07:53.523605+0000","last_fullsized":"2023-07-21T19:07:53.523605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:13.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.837435+0000","last_change":"2023-07-21T19:07:48.458714+0000","last_active":"2023-07-21T19:07:53.837435+0000","last_peered":"2023-07-21T19:07:53.837435+0000","last_clean":"2023-07-21T19:07:53.837435+0000","last_became_active":"2023-07-21T19:07:48.458388+0000","last_became_peered":"2023-07-21T19:07:48.458388+0000","last_unstale":"2023-07-21T19:07:53.837435+0000","last_undegraded":"2023-07-21T19:07:53.837435+0000","last_fullsized":"2023-07-21T19:07:53.837435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:07.621195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838125+0000","last_change":"2023-07-21T19:07:48.449982+0000","last_active":"2023-07-21T19:07:53.838125+0000","last_peered":"2023-07-21T19:07:53.838125+0000","last_clean":"2023-07-21T19:07:53.838125+0000","last_became_active":"2023-07-21T19:07:48.449092+0000","last_became_peered":"2023-07-21T19:07:48.449092+0000","last_unstale":"2023-07-21T19:07:53.838125+0000","last_undegraded":"2023-07-21T19:07:53.838125+0000","last_fullsized":"2023-07-21T19:07:53.838125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:10.674404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524046+0000","last_change":"2023-07-21T19:07:48.460970+0000","last_active":"2023-07-21T19:07:53.524046+0000","last_peered":"2023-07-21T19:07:53.524046+0000","last_clean":"2023-07-21T19:07:53.524046+0000","last_became_active":"2023-07-21T19:07:48.460263+0000","last_became_peered":"2023-07-21T19:07:48.460263+0000","last_unstale":"2023-07-21T19:07:53.524046+0000","last_undegraded":"2023-07-21T19:07:53.524046+0000","last_fullsized":"2023-07-21T19:07:53.524046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:09.964570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524908+0000","last_change":"2023-07-21T19:07:48.460703+0000","last_active":"2023-07-21T19:07:53.524908+0000","last_peered":"2023-07-21T19:07:53.524908+0000","last_clean":"2023-07-21T19:07:53.524908+0000","last_became_active":"2023-07-21T19:07:48.460406+0000","last_became_peered":"2023-07-21T19:07:48.460406+0000","last_unstale":"2023-07-21T19:07:53.524908+0000","last_undegraded":"2023-07-21T19:07:53.524908+0000","last_fullsized":"2023-07-21T19:07:53.524908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:10.593044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524839+0000","last_change":"2023-07-21T19:07:48.452496+0000","last_active":"2023-07-21T19:07:53.524839+0000","last_peered":"2023-07-21T19:07:53.524839+0000","last_clean":"2023-07-21T19:07:53.524839+0000","last_became_active":"2023-07-21T19:07:48.452235+0000","last_became_peered":"2023-07-21T19:07:48.452235+0000","last_unstale":"2023-07-21T19:07:53.524839+0000","last_undegraded":"2023-07-21T19:07:53.524839+0000","last_fullsized":"2023-07-21T19:07:53.524839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:56.448253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523126+0000","last_change":"2023-07-21T19:07:48.445166+0000","last_active":"2023-07-21T19:07:53.523126+0000","last_peered":"2023-07-21T19:07:53.523126+0000","last_clean":"2023-07-21T19:07:53.523126+0000","last_became_active":"2023-07-21T19:07:48.444852+0000","last_became_peered":"2023-07-21T19:07:48.444852+0000","last_unstale":"2023-07-21T19:07:53.523126+0000","last_undegraded":"2023-07-21T19:07:53.523126+0000","last_fullsized":"2023-07-21T19:07:53.523126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:04.444935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.832791+0000","last_change":"2023-07-21T19:07:48.468451+0000","last_active":"2023-07-21T19:07:53.832791+0000","last_peered":"2023-07-21T19:07:53.832791+0000","last_clean":"2023-07-21T19:07:53.832791+0000","last_became_active":"2023-07-21T19:07:48.468185+0000","last_became_peered":"2023-07-21T19:07:48.468185+0000","last_unstale":"2023-07-21T19:07:53.832791+0000","last_undegraded":"2023-07-21T19:07:53.832791+0000","last_fullsized":"2023-07-21T19:07:53.832791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:12.829699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523196+0000","last_change":"2023-07-21T19:07:48.449895+0000","last_active":"2023-07-21T19:07:53.523196+0000","last_peered":"2023-07-21T19:07:53.523196+0000","last_clean":"2023-07-21T19:07:53.523196+0000","last_became_active":"2023-07-21T19:07:48.449511+0000","last_became_peered":"2023-07-21T19:07:48.449511+0000","last_unstale":"2023-07-21T19:07:53.523196+0000","last_undegraded":"2023-07-21T19:07:53.523196+0000","last_fullsized":"2023-07-21T19:07:53.523196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:55.510661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524314+0000","last_change":"2023-07-21T19:07:48.458380+0000","last_active":"2023-07-21T19:07:53.524314+0000","last_peered":"2023-07-21T19:07:53.524314+0000","last_clean":"2023-07-21T19:07:53.524314+0000","last_became_active":"2023-07-21T19:07:48.458092+0000","last_became_peered":"2023-07-21T19:07:48.458092+0000","last_unstale":"2023-07-21T19:07:53.524314+0000","last_undegraded":"2023-07-21T19:07:53.524314+0000","last_fullsized":"2023-07-21T19:07:53.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:00.149580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.834522+0000","last_change":"2023-07-21T19:07:48.458478+0000","last_active":"2023-07-21T19:07:53.834522+0000","last_peered":"2023-07-21T19:07:53.834522+0000","last_clean":"2023-07-21T19:07:53.834522+0000","last_became_active":"2023-07-21T19:07:48.458191+0000","last_became_peered":"2023-07-21T19:07:48.458191+0000","last_unstale":"2023-07-21T19:07:53.834522+0000","last_undegraded":"2023-07-21T19:07:53.834522+0000","last_fullsized":"2023-07-21T19:07:53.834522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:04.609626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.523852+0000","last_change":"2023-07-21T19:07:48.456833+0000","last_active":"2023-07-21T19:07:53.523852+0000","last_peered":"2023-07-21T19:07:53.523852+0000","last_clean":"2023-07-21T19:07:53.523852+0000","last_became_active":"2023-07-21T19:07:48.456319+0000","last_became_peered":"2023-07-21T19:07:48.456319+0000","last_unstale":"2023-07-21T19:07:53.523852+0000","last_undegraded":"2023-07-21T19:07:53.523852+0000","last_fullsized":"2023-07-21T19:07:53.523852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:40.333638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.524737+0000","last_change":"2023-07-21T19:07:48.453854+0000","last_active":"2023-07-21T19:07:53.524737+0000","last_peered":"2023-07-21T19:07:53.524737+0000","last_clean":"2023-07-21T19:07:53.524737+0000","last_became_active":"2023-07-21T19:07:48.453560+0000","last_became_peered":"2023-07-21T19:07:48.453560+0000","last_unstale":"2023-07-21T19:07:53.524737+0000","last_undegraded":"2023-07-21T19:07:53.524737+0000","last_fullsized":"2023-07-21T19:07:53.524737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:54.789012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-21T19:07:53.838394+0000","last_change":"2023-07-21T19:07:48.451024+0000","last_active":"2023-07-21T19:07:53.838394+0000","last_peered":"2023-07-21T19:07:53.838394+0000","last_clean":"2023-07-21T19:07:53.838394+0000","last_became_active":"2023-07-21T19:07:48.450678+0000","last_became_peered":"2023-07-21T19:07:48.450678+0000","last_unstale":"2023-07-21T19:07:53.838394+0000","last_undegraded":"2023-07-21T19:07:53.838394+0000","last_fullsized":"2023-07-21T19:07:53.838394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:47.386411+0000","last_clean_scrub_stamp":"2023-07-21T19:07:47.386411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:56:56.585283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T19:08:17.057 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-21T19:08:17.058 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-21T19:08:17.058 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-21T19:08:17.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-21T19:08:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.207+0000 7f08bd7f7700 1 Processor -- start 2023-07-21T19:08:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08bd7f7700 1 -- start start 2023-07-21T19:08:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08bd7f7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b80b0630 0x7f08b815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08bd7f7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80b0a00 con 0x7f08b80cb220 2023-07-21T19:08:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08bd7f7700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80cd910 con 0x7f08b806bf70 2023-07-21T19:08:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08bd7f7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815d8f0 con 0x7f08b80b0630 2023-07-21T19:08:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b77fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f08b80cb220 0x7f08b806d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43516/0 (socket says 172.21.15.123:43516) 2023-07-21T19:08:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b77fe700 1 -- 172.21.15.123:0/108834047 learned_addr learned my addr 172.21.15.123:0/108834047 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b6ffd700 1 --2- 172.21.15.123:0/108834047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b80b0630 0x7f08b815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b67fc700 1 -- 172.21.15.123:0/108834047 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580091293 0 0) 0x7f08b80b0a00 con 0x7f08b80cb220 2023-07-21T19:08:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b67fc700 1 -- 172.21.15.123:0/108834047 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08980035d0 con 0x7f08b80cb220 2023-07-21T19:08:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b6ffd700 1 -- 172.21.15.123:0/108834047 >> v1:172.21.15.145:6789/0 conn(0x7f08b806bf70 legacy=0x7f08b80cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b6ffd700 1 -- 172.21.15.123:0/108834047 >> v1:172.21.15.123:6789/0 conn(0x7f08b80cb220 legacy=0x7f08b806d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.211+0000 7f08b6ffd700 1 -- 172.21.15.123:0/108834047 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80cdbf0 con 0x7f08b80b0630 2023-07-21T19:08:17.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08b6ffd700 1 --2- 172.21.15.123:0/108834047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b80b0630 0x7f08b815e020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6236e9aa8122a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:17.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08b67fc700 1 -- 172.21.15.123:0/108834047 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8005e50 con 0x7f08b80b0630 2023-07-21T19:08:17.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08b67fc700 1 -- 172.21.15.123:0/108834047 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8006030 con 0x7f08b80b0630 2023-07-21T19:08:17.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08b67fc700 1 -- 172.21.15.123:0/108834047 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80063a0 con 0x7f08b80b0630 2023-07-21T19:08:17.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 -- 172.21.15.123:0/108834047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b80b0630 msgr2=0x7f08b815e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/108834047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b80b0630 0x7f08b815e020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a8009b80 comp rx=0 tx=0).stop 2023-07-21T19:08:17.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 -- 172.21.15.123:0/108834047 shutdown_connections 2023-07-21T19:08:17.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/108834047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b80b0630 0x7f08b815e020 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 -- 172.21.15.123:0/108834047 >> 172.21.15.123:0/108834047 conn(0x7f08b806e960 msgr2=0x7f08b806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:17.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 -- 172.21.15.123:0/108834047 shutdown_connections 2023-07-21T19:08:17.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.215+0000 7f08bd7f7700 1 -- 172.21.15.123:0/108834047 wait complete. 2023-07-21T19:08:17.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 Processor -- start 2023-07-21T19:08:17.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 -- start start 2023-07-21T19:08:17.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b806bf70 0x7f08b81f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 0x7f08b815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08b80cb220 0x7f08b81f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815a2f0 con 0x7f08b80b0630 2023-07-21T19:08:17.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815bd10 con 0x7f08b80cb220 2023-07-21T19:08:17.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08bd7f7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815bfd0 con 0x7f08b806bf70 2023-07-21T19:08:17.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 0x7f08b815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 0x7f08b815b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51586/0 (socket says 172.21.15.123:51586) 2023-07-21T19:08:17.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 -- 172.21.15.123:0/1321974739 learned_addr learned my addr 172.21.15.123:0/1321974739 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:17.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08b77fe700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08b80cb220 0x7f08b81f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08b6ffd700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b806bf70 0x7f08b81f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 -- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b806bf70 msgr2=0x7f08b81f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b806bf70 0x7f08b81f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 -- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08b80cb220 msgr2=0x7f08b81f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08b80cb220 0x7f08b81f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 -- 172.21.15.123:0/1321974739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8009450 con 0x7f08b80b0630 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08ae7fc700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 0x7f08b815b7d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c480 tx=0x7f08a000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.219+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a00052d0 con 0x7f08b80b0630 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.223+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b815c2b0 con 0x7f08b80b0630 2023-07-21T19:08:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.223+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a000ce90 con 0x7f08b80b0630 2023-07-21T19:08:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.223+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0006880 con 0x7f08b80b0630 2023-07-21T19:08:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.223+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b815c870 con 0x7f08b80b0630 2023-07-21T19:08:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.223+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b804dcb0 con 0x7f08b80b0630 2023-07-21T19:08:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.223+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08a00036a0 con 0x7f08b80b0630 2023-07-21T19:08:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.227+0000 7f08affff700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f089c0662f0 0x7f089c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.227+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08a0083220 con 0x7f08b80b0630 2023-07-21T19:08:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.227+0000 7f08b6ffd700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f089c0662f0 0x7f089c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.227+0000 7f08b6ffd700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f089c0662f0 0x7f089c0687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08a80097c0 tx=0x7f08a8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.231+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f08a0050310 con 0x7f08b80b0630 2023-07-21T19:08:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.419+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f08b80c1910 con 0x7f08b80b0630 2023-07-21T19:08:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.419+0000 7f08affff700 1 -- 172.21.15.123:0/1321974739 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f08a0053930 con 0x7f08b80b0630 2023-07-21T19:08:17.435 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:17.435 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-21T19:08:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f089c0662f0 msgr2=0x7f089c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f089c0662f0 0x7f089c0687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08a80097c0 tx=0x7f08a8008070 comp rx=0 tx=0).stop 2023-07-21T19:08:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 msgr2=0x7f08b815b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 0x7f08b815b7d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c480 tx=0x7f08a000c790 comp rx=0 tx=0).stop 2023-07-21T19:08:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 shutdown_connections 2023-07-21T19:08:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f089c0662f0 0x7f089c0687a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08b80cb220 0x7f08b81f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b80b0630 0x7f08b815b7d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 --2- 172.21.15.123:0/1321974739 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08b806bf70 0x7f08b81f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 >> 172.21.15.123:0/1321974739 conn(0x7f08b806e960 msgr2=0x7f08b80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:17.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 shutdown_connections 2023-07-21T19:08:17.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.423+0000 7f08bd7f7700 1 -- 172.21.15.123:0/1321974739 wait complete. 2023-07-21T19:08:17.458 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-21T19:08:17.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:17.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3f5e6700 1 Processor -- start 2023-07-21T19:08:17.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3f5e6700 1 -- start start 2023-07-21T19:08:17.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3f5e6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa38164000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3f5e6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380c8900 con 0x7ffa38164540 2023-07-21T19:08:17.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3f5e6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380caae0 con 0x7ffa380cddb0 2023-07-21T19:08:17.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3f5e6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380c8fc0 con 0x7ffa38160640 2023-07-21T19:08:17.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3cb81700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffa38164540 0x7ffa38070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43518/0 (socket says 172.21.15.123:43518) 2023-07-21T19:08:17.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3cb81700 1 -- 172.21.15.123:0/1596356917 learned_addr learned my addr 172.21.15.123:0/1596356917 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:17.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3d382700 1 --2- 172.21.15.123:0/1596356917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa38164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa2ffff700 1 -- 172.21.15.123:0/1596356917 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805472136 0 0) 0x7ffa380c8900 con 0x7ffa38164540 2023-07-21T19:08:17.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa2ffff700 1 -- 172.21.15.123:0/1596356917 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa240035d0 con 0x7ffa38164540 2023-07-21T19:08:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3d382700 1 -- 172.21.15.123:0/1596356917 >> v1:172.21.15.145:6789/0 conn(0x7ffa380cddb0 legacy=0x7ffa380afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa2ffff700 1 -- 172.21.15.123:0/1596356917 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279658350 0 0) 0x7ffa380caae0 con 0x7ffa380cddb0 2023-07-21T19:08:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3d382700 1 -- 172.21.15.123:0/1596356917 >> v1:172.21.15.123:6789/0 conn(0x7ffa38164540 legacy=0x7ffa38070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.611+0000 7ffa3d382700 1 -- 172.21.15.123:0/1596356917 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380ca520 con 0x7ffa38160640 2023-07-21T19:08:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3d382700 1 --2- 172.21.15.123:0/1596356917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa38164000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009880 tx=0x7ffa34009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e279245674a03d4c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa2ffff700 1 -- 172.21.15.123:0/1596356917 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34011830 con 0x7ffa38160640 2023-07-21T19:08:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa2ffff700 1 -- 172.21.15.123:0/1596356917 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34011990 con 0x7ffa38160640 2023-07-21T19:08:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa2ffff700 1 -- 172.21.15.123:0/1596356917 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34011d20 con 0x7ffa38160640 2023-07-21T19:08:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/1596356917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 msgr2=0x7ffa38164000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/1596356917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa38164000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009880 tx=0x7ffa34009b90 comp rx=0 tx=0).stop 2023-07-21T19:08:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/1596356917 shutdown_connections 2023-07-21T19:08:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/1596356917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa38164000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/1596356917 >> 172.21.15.123:0/1596356917 conn(0x7ffa380cad30 msgr2=0x7ffa380cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/1596356917 shutdown_connections 2023-07-21T19:08:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.615+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/1596356917 wait complete. 2023-07-21T19:08:17.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 Processor -- start 2023-07-21T19:08:17.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 -- start start 2023-07-21T19:08:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 0x7ffa3814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa380c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa38164540 0x7ffa38157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38070540 con 0x7ffa380cddb0 2023-07-21T19:08:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3814a800 con 0x7ffa38164540 2023-07-21T19:08:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3f5e6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa381558e0 con 0x7ffa38160640 2023-07-21T19:08:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3d382700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 0x7ffa3814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3d382700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 0x7ffa3814a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51590/0 (socket says 172.21.15.123:51590) 2023-07-21T19:08:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3d382700 1 -- 172.21.15.123:0/3978105223 learned_addr learned my addr 172.21.15.123:0/3978105223 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3db83700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa38164540 0x7ffa38157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.619+0000 7ffa3cb81700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa380c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3d382700 1 -- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 msgr2=0x7ffa380c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3d382700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa380c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3d382700 1 -- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa38164540 msgr2=0x7ffa38157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3d382700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa38164540 0x7ffa38157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3d382700 1 -- 172.21.15.123:0/3978105223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340094b0 con 0x7ffa380cddb0 2023-07-21T19:08:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3d382700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 0x7ffa3814a2c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa34013040 tx=0x7ffa34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34019a80 con 0x7ffa380cddb0 2023-07-21T19:08:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3401e070 con 0x7ffa380cddb0 2023-07-21T19:08:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa380c65e0 con 0x7ffa380cddb0 2023-07-21T19:08:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34019e00 con 0x7ffa380cddb0 2023-07-21T19:08:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa380c6ba0 con 0x7ffa380cddb0 2023-07-21T19:08:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.623+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3804dcb0 con 0x7ffa380cddb0 2023-07-21T19:08:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.627+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa3402d450 con 0x7ffa380cddb0 2023-07-21T19:08:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.627+0000 7ffa2dffb700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffa1c0662f0 0x7ffa1c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.627+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa34085060 con 0x7ffa380cddb0 2023-07-21T19:08:17.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.627+0000 7ffa3cb81700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffa1c0662f0 0x7ffa1c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:17.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.631+0000 7ffa3cb81700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffa1c0662f0 0x7ffa1c0687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa380c8800 tx=0x7ffa28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:17.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.635+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffa340b5720 con 0x7ffa380cddb0 2023-07-21T19:08:17.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.807+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa38070e20 con 0x7ffa380cddb0 2023-07-21T19:08:17.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.811+0000 7ffa2dffb700 1 -- 172.21.15.123:0/3978105223 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7ffa34020070 con 0x7ffa380cddb0 2023-07-21T19:08:17.826 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:17.827 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:17.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffa1c0662f0 msgr2=0x7ffa1c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffa1c0662f0 0x7ffa1c0687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa380c8800 tx=0x7ffa28009040 comp rx=0 tx=0).stop 2023-07-21T19:08:17.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 msgr2=0x7ffa3814a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:17.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 0x7ffa3814a2c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa34013040 tx=0x7ffa34004770 comp rx=0 tx=0).stop 2023-07-21T19:08:17.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 shutdown_connections 2023-07-21T19:08:17.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffa1c0662f0 0x7ffa1c0687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa38164540 0x7ffa38157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa38160640 0x7ffa380c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 --2- 172.21.15.123:0/3978105223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa380cddb0 0x7ffa3814a2c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:17.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 >> 172.21.15.123:0/3978105223 conn(0x7ffa380cad30 msgr2=0x7ffa380b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:17.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 shutdown_connections 2023-07-21T19:08:17.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:17.815+0000 7ffa3f5e6700 1 -- 172.21.15.123:0/3978105223 wait complete. 2023-07-21T19:08:17.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:17.854 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:18.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b759e700 1 Processor -- start 2023-07-21T19:08:18.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b759e700 1 -- start start 2023-07-21T19:08:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b8158a20 0x7f34b80cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b806d310 con 0x7f34b806c220 2023-07-21T19:08:18.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b759e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b806c700 con 0x7f34b80cb820 2023-07-21T19:08:18.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b759e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b806c9e0 con 0x7f34b8158a20 2023-07-21T19:08:18.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34add9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f34b806c220 0x7f34b80cbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43532/0 (socket says 172.21.15.123:43532) 2023-07-21T19:08:18.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34add9b700 1 -- 172.21.15.123:0/4041167683 learned_addr learned my addr 172.21.15.123:0/4041167683 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:18.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.015+0000 7f34b659c700 1 --2- 172.21.15.123:0/4041167683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b8158a20 0x7f34b80cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b5d9b700 1 -- 172.21.15.123:0/4041167683 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629952316 0 0) 0x7f34b806d310 con 0x7f34b806c220 2023-07-21T19:08:18.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b5d9b700 1 -- 172.21.15.123:0/4041167683 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a40035d0 con 0x7f34b806c220 2023-07-21T19:08:18.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b659c700 1 -- 172.21.15.123:0/4041167683 >> v1:172.21.15.145:6789/0 conn(0x7f34b80cb820 legacy=0x7f34b806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b659c700 1 -- 172.21.15.123:0/4041167683 >> v1:172.21.15.123:6789/0 conn(0x7f34b806c220 legacy=0x7f34b80cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b659c700 1 -- 172.21.15.123:0/4041167683 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b806ccc0 con 0x7f34b8158a20 2023-07-21T19:08:18.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b659c700 1 --2- 172.21.15.123:0/4041167683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b8158a20 0x7f34b80cb2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009880 tx=0x7f34a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7deb639059ff82ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b5d9b700 1 -- 172.21.15.123:0/4041167683 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8011830 con 0x7f34b8158a20 2023-07-21T19:08:18.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b5d9b700 1 -- 172.21.15.123:0/4041167683 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a8011990 con 0x7f34b8158a20 2023-07-21T19:08:18.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b5d9b700 1 -- 172.21.15.123:0/4041167683 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8011d20 con 0x7f34b8158a20 2023-07-21T19:08:18.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 -- 172.21.15.123:0/4041167683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b8158a20 msgr2=0x7f34b80cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 --2- 172.21.15.123:0/4041167683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b8158a20 0x7f34b80cb2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009880 tx=0x7f34a8009b90 comp rx=0 tx=0).stop 2023-07-21T19:08:18.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 -- 172.21.15.123:0/4041167683 shutdown_connections 2023-07-21T19:08:18.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 --2- 172.21.15.123:0/4041167683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b8158a20 0x7f34b80cb2e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 -- 172.21.15.123:0/4041167683 >> 172.21.15.123:0/4041167683 conn(0x7f34b80afc60 msgr2=0x7f34b80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:18.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 -- 172.21.15.123:0/4041167683 shutdown_connections 2023-07-21T19:08:18.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.019+0000 7f34b759e700 1 -- 172.21.15.123:0/4041167683 wait complete. 2023-07-21T19:08:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 Processor -- start 2023-07-21T19:08:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 -- start start 2023-07-21T19:08:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b806c220 0x7f34b80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34b80cb820 0x7f34b81530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 0x7f34b815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b815a3e0 con 0x7f34b8158a20 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8159ad0 con 0x7f34b80cb820 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.023+0000 7f34b759e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80c7270 con 0x7f34b806c220 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 0x7f34b815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 0x7f34b815a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51602/0 (socket says 172.21.15.123:51602) 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 -- 172.21.15.123:0/2340987045 learned_addr learned my addr 172.21.15.123:0/2340987045 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b659c700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b806c220 0x7f34b80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34add9b700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34b80cb820 0x7f34b81530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 -- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b806c220 msgr2=0x7f34b80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b806c220 0x7f34b80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 -- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34b80cb820 msgr2=0x7f34b81530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34b80cb820 0x7f34b81530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 -- 172.21.15.123:0/2340987045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80094b0 con 0x7f34b8158a20 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b6d9d700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 0x7f34b815a800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f34b000cc50 tx=0x7f34b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0003c20 con 0x7f34b8158a20 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0003d80 con 0x7f34b8158a20 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b8159d20 con 0x7f34b8158a20 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000aab0 con 0x7f34b8158a20 2023-07-21T19:08:18.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.027+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b80c7ba0 con 0x7f34b8158a20 2023-07-21T19:08:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.031+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b815a520 con 0x7f34b8158a20 2023-07-21T19:08:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.031+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34b000ac10 con 0x7f34b8158a20 2023-07-21T19:08:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.031+0000 7f34af7fe700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f34980662f0 0x7f34980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.031+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f34b0083f50 con 0x7f34b8158a20 2023-07-21T19:08:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.031+0000 7f34b659c700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f34980662f0 0x7f34980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.031+0000 7f34b659c700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f34980662f0 0x7f34980687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f34a80090b0 tx=0x7f34a8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.039+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f34b815a520 con 0x7f34b8158a20 2023-07-21T19:08:18.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.195+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34b815a520 con 0x7f34b8158a20 2023-07-21T19:08:18.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.195+0000 7f34af7fe700 1 -- 172.21.15.123:0/2340987045 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34b815a520 con 0x7f34b8158a20 2023-07-21T19:08:18.209 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:18.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f34980662f0 msgr2=0x7f34980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f34980662f0 0x7f34980687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f34a80090b0 tx=0x7f34a8010000 comp rx=0 tx=0).stop 2023-07-21T19:08:18.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 msgr2=0x7f34b815a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 0x7f34b815a800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f34b000cc50 tx=0x7f34b000cf60 comp rx=0 tx=0).stop 2023-07-21T19:08:18.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 shutdown_connections 2023-07-21T19:08:18.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f34980662f0 0x7f34980687a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34b80cb820 0x7f34b81530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34b8158a20 0x7f34b815a800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 --2- 172.21.15.123:0/2340987045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34b806c220 0x7f34b80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 >> 172.21.15.123:0/2340987045 conn(0x7f34b80afc60 msgr2=0x7f34b806d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:18.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 shutdown_connections 2023-07-21T19:08:18.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.199+0000 7f34b759e700 1 -- 172.21.15.123:0/2340987045 wait complete. 2023-07-21T19:08:18.229 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:18.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 Processor -- start 2023-07-21T19:08:18.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 -- start start 2023-07-21T19:08:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3df00b0770 0x7f3df006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00cab00 0x7f3df00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00cb4c0 con 0x7f3df0159c60 2023-07-21T19:08:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00714f0 con 0x7f3df00b0770 2023-07-21T19:08:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df539e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df006da00 con 0x7f3df00cab00 2023-07-21T19:08:18.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3de77fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3df00b0770 0x7f3df006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3de77fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3df00b0770 0x7f3df006d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:46116/0 (socket says 172.21.15.123:46116) 2023-07-21T19:08:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3de77fe700 1 -- 172.21.15.123:0/1479904750 learned_addr learned my addr 172.21.15.123:0/1479904750 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3deffff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f3df0159c60 0x7f3df0070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:36222/0 (socket says 172.21.15.123:36222) 2023-07-21T19:08:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.391+0000 7f3df4b9d700 1 --2- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00cab00 0x7f3df00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3de77fe700 1 -- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00cab00 msgr2=0x7f3df00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3de77fe700 1 --2- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00cab00 0x7f3df00caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3de77fe700 1 -- 172.21.15.123:0/1479904750 >> v1:172.21.15.145:6789/0 conn(0x7f3df0159c60 legacy=0x7f3df0070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3de77fe700 1 -- 172.21.15.123:0/1479904750 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df006dce0 con 0x7f3df00b0770 2023-07-21T19:08:18.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3def7fe700 1 -- 172.21.15.123:0/1479904750 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060915762 0 0) 0x7f3df00cb4c0 con 0x7f3df0159c60 2023-07-21T19:08:18.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3de77fe700 1 --2- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00b0770 0x7f3df006d3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009910 tx=0x7f3de0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a807381c43f018b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3def7fe700 1 -- 172.21.15.123:0/1479904750 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011830 con 0x7f3df00b0770 2023-07-21T19:08:18.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3def7fe700 1 -- 172.21.15.123:0/1479904750 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0011990 con 0x7f3df00b0770 2023-07-21T19:08:18.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3def7fe700 1 -- 172.21.15.123:0/1479904750 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011d40 con 0x7f3df00b0770 2023-07-21T19:08:18.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 -- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00b0770 msgr2=0x7f3df006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 --2- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00b0770 0x7f3df006d3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009910 tx=0x7f3de0009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 -- 172.21.15.123:0/1479904750 shutdown_connections 2023-07-21T19:08:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 --2- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00cab00 0x7f3df00caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 --2- 172.21.15.123:0/1479904750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00b0770 0x7f3df006d3b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 -- 172.21.15.123:0/1479904750 >> 172.21.15.123:0/1479904750 conn(0x7f3df00afc60 msgr2=0x7f3df00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 -- 172.21.15.123:0/1479904750 shutdown_connections 2023-07-21T19:08:18.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.395+0000 7f3df539e700 1 -- 172.21.15.123:0/1479904750 wait complete. 2023-07-21T19:08:18.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.399+0000 7f3df539e700 1 Processor -- start 2023-07-21T19:08:18.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.399+0000 7f3df539e700 1 -- start start 2023-07-21T19:08:18.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00b0770 0x7f3df0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00cab00 0x7f3df00c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 0x7f3df00acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c3660 con 0x7f3df0159c60 2023-07-21T19:08:18.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00b21e0 con 0x7f3df00cab00 2023-07-21T19:08:18.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00b24c0 con 0x7f3df00b0770 2023-07-21T19:08:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 0x7f3df00acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 0x7f3df00acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51616/0 (socket says 172.21.15.123:51616) 2023-07-21T19:08:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 -- 172.21.15.123:0/1328950737 learned_addr learned my addr 172.21.15.123:0/1328950737 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3de77fe700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00cab00 0x7f3df00c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 -- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00b0770 msgr2=0x7f3df0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00b0770 0x7f3df0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 -- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00cab00 msgr2=0x7f3df00c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00cab00 0x7f3df00c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 -- 172.21.15.123:0/1328950737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0009570 con 0x7f3df0159c60 2023-07-21T19:08:18.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df4b9d700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 0x7f3df00acb70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3de800efc0 tx=0x7f3de800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800cb80 con 0x7f3df0159c60 2023-07-21T19:08:18.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800f040 con 0x7f3df0159c60 2023-07-21T19:08:18.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00c32f0 con 0x7f3df0159c60 2023-07-21T19:08:18.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8014480 con 0x7f3df0159c60 2023-07-21T19:08:18.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.403+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df0154c50 con 0x7f3df0159c60 2023-07-21T19:08:18.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.407+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df00b4140 con 0x7f3df0159c60 2023-07-21T19:08:18.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.407+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3de80145e0 con 0x7f3df0159c60 2023-07-21T19:08:18.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.411+0000 7f3ded7fa700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3dd00662f0 0x7f3dd00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.411+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3de8084700 con 0x7f3df0159c60 2023-07-21T19:08:18.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.411+0000 7f3deffff700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3dd00662f0 0x7f3dd00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.411+0000 7f3deffff700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3dd00662f0 0x7f3dd00687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80011e0 tx=0x7f3dd80079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.415+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3de8051920 con 0x7f3df0159c60 2023-07-21T19:08:18.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.591+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3df004e500 con 0x7f3df0159c60 2023-07-21T19:08:18.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.591+0000 7f3ded7fa700 1 -- 172.21.15.123:0/1328950737 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3de8054f40 con 0x7f3df0159c60 2023-07-21T19:08:18.604 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:18.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3dd00662f0 msgr2=0x7f3dd00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3dd00662f0 0x7f3dd00687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80011e0 tx=0x7f3dd80079d0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 msgr2=0x7f3df00acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 0x7f3df00acb70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3de800efc0 tx=0x7f3de800c0c0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 shutdown_connections 2023-07-21T19:08:18.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3dd00662f0 0x7f3dd00687a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df00cab00 0x7f3df00c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df0159c60 0x7f3df00acb70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 --2- 172.21.15.123:0/1328950737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3df00b0770 0x7f3df0154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 >> 172.21.15.123:0/1328950737 conn(0x7f3df00afc60 msgr2=0x7f3df00caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 shutdown_connections 2023-07-21T19:08:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.595+0000 7f3df539e700 1 -- 172.21.15.123:0/1328950737 wait complete. 2023-07-21T19:08:18.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:18.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.795+0000 7efde35dc700 1 Processor -- start 2023-07-21T19:08:18.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.795+0000 7efde35dc700 1 -- start start 2023-07-21T19:08:18.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde35dc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efddc0cd080 0x7efddc069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde35dc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0b0f30 0x7efddc0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde35dc700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc06a8f0 con 0x7efddc0ce170 2023-07-21T19:08:18.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde35dc700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc0b18f0 con 0x7efddc0cd080 2023-07-21T19:08:18.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde35dc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc06a050 con 0x7efddc0b0f30 2023-07-21T19:08:18.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efddc0cd080 0x7efddc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efddc0cd080 0x7efddc069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:46122/0 (socket says 172.21.15.123:46122) 2023-07-21T19:08:18.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 -- 172.21.15.123:0/1971069741 learned_addr learned my addr 172.21.15.123:0/1971069741 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:18.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde1b79700 1 --2- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0b0f30 0x7efddc0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 -- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0b0f30 msgr2=0x7efddc0b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:18.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 --2- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0b0f30 0x7efddc0b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 -- 172.21.15.123:0/1971069741 >> v1:172.21.15.145:6789/0 conn(0x7efddc0ce170 legacy=0x7efddc0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 -- 172.21.15.123:0/1971069741 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc06a330 con 0x7efddc0cd080 2023-07-21T19:08:18.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efde0b77700 1 --2- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc069800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009910 tx=0x7efdcc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dec1a2507a0b91c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efdd3fff700 1 -- 172.21.15.123:0/1971069741 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00f8a0 con 0x7efddc0cd080 2023-07-21T19:08:18.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efdd3fff700 1 -- 172.21.15.123:0/1971069741 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00fa00 con 0x7efddc0cd080 2023-07-21T19:08:18.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.799+0000 7efdd3fff700 1 -- 172.21.15.123:0/1971069741 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00fdb0 con 0x7efddc0cd080 2023-07-21T19:08:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 -- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 msgr2=0x7efddc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 --2- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc069800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009910 tx=0x7efdcc009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 -- 172.21.15.123:0/1971069741 shutdown_connections 2023-07-21T19:08:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 --2- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0b0f30 0x7efddc0b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 --2- 172.21.15.123:0/1971069741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc069800 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 -- 172.21.15.123:0/1971069741 >> 172.21.15.123:0/1971069741 conn(0x7efddc0706b0 msgr2=0x7efddc0cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:18.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 -- 172.21.15.123:0/1971069741 shutdown_connections 2023-07-21T19:08:18.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 -- 172.21.15.123:0/1971069741 wait complete. 2023-07-21T19:08:18.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 Processor -- start 2023-07-21T19:08:18.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.803+0000 7efde35dc700 1 -- start start 2023-07-21T19:08:18.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 0x7efddc0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0ce170 0x7efddc0c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0c3900 con 0x7efddc0b0f30 2023-07-21T19:08:18.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0c80d0 con 0x7efddc0cd080 2023-07-21T19:08:18.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0c2fd0 con 0x7efddc0ce170 2023-07-21T19:08:18.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 0x7efddc0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 0x7efddc0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51620/0 (socket says 172.21.15.123:51620) 2023-07-21T19:08:18.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 -- 172.21.15.123:0/2016828781 learned_addr learned my addr 172.21.15.123:0/2016828781 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1b79700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0ce170 0x7efddc0c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde0b77700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 -- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0ce170 msgr2=0x7efddc0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0ce170 0x7efddc0c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 -- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 msgr2=0x7efddc14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 -- 172.21.15.123:0/2016828781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009570 con 0x7efddc0b0f30 2023-07-21T19:08:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde1378700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 0x7efddc0c7b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c500 tx=0x7efdd800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80052d0 con 0x7efddc0b0f30 2023-07-21T19:08:18.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8005430 con 0x7efddc0b0f30 2023-07-21T19:08:18.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc0c32b0 con 0x7efddc0b0f30 2023-07-21T19:08:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80055a0 con 0x7efddc0b0f30 2023-07-21T19:08:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.807+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc14cdf0 con 0x7efddc0b0f30 2023-07-21T19:08:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.811+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc0ceb50 con 0x7efddc0b0f30 2023-07-21T19:08:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.811+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdd80038e0 con 0x7efddc0b0f30 2023-07-21T19:08:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.815+0000 7efdd1ffb700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7efdc00662f0 0x7efdc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.815+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efdd80833c0 con 0x7efddc0b0f30 2023-07-21T19:08:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.815+0000 7efde0b77700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7efdc00662f0 0x7efdc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.815+0000 7efde0b77700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7efdc00662f0 0x7efdc00687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efdcc000c00 tx=0x7efdcc01b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.819+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7efdd8050540 con 0x7efddc0b0f30 2023-07-21T19:08:19.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.995+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efddc04dcb0 con 0x7efddc0b0f30 2023-07-21T19:08:19.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efdd1ffb700 1 -- 172.21.15.123:0/2016828781 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7efdd8053b60 con 0x7efddc0b0f30 2023-07-21T19:08:19.011 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7efdc00662f0 msgr2=0x7efdc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7efdc00662f0 0x7efdc00687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efdcc000c00 tx=0x7efdcc01b040 comp rx=0 tx=0).stop 2023-07-21T19:08:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 msgr2=0x7efddc0c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 0x7efddc0c7b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c500 tx=0x7efdd800c810 comp rx=0 tx=0).stop 2023-07-21T19:08:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 shutdown_connections 2023-07-21T19:08:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7efdc00662f0 0x7efdc00687a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efddc0cd080 0x7efddc14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efddc0ce170 0x7efddc0c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 --2- 172.21.15.123:0/2016828781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efddc0b0f30 0x7efddc0c7b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 >> 172.21.15.123:0/2016828781 conn(0x7efddc0706b0 msgr2=0x7efddc0cbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 shutdown_connections 2023-07-21T19:08:19.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:18.999+0000 7efde35dc700 1 -- 172.21.15.123:0/2016828781 wait complete. 2023-07-21T19:08:19.034 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:19.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.199+0000 7f2a648c4700 1 Processor -- start 2023-07-21T19:08:19.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.199+0000 7f2a648c4700 1 -- start start 2023-07-21T19:08:19.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600b0770 0x7f2a6006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2a600cab00 0x7f2a600caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a600cb4c0 con 0x7f2a60159c60 2023-07-21T19:08:19.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600714f0 con 0x7f2a600cab00 2023-07-21T19:08:19.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6006da00 con 0x7f2a600b0770 2023-07-21T19:08:19.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2a60159c60 0x7f2a60070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43536/0 (socket says 172.21.15.123:43536) 2023-07-21T19:08:19.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5f7fe700 1 -- 172.21.15.123:0/110241582 learned_addr learned my addr 172.21.15.123:0/110241582 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:19.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5ffff700 1 --2- 172.21.15.123:0/110241582 >> v2:172.21.15.123:3300/0 conn(0x7f2a600cab00 0x7f2a600caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5effd700 1 --2- 172.21.15.123:0/110241582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600b0770 0x7f2a6006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5ffff700 1 -- 172.21.15.123:0/110241582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600b0770 msgr2=0x7f2a6006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:19.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5ffff700 1 --2- 172.21.15.123:0/110241582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600b0770 0x7f2a6006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5ffff700 1 -- 172.21.15.123:0/110241582 >> v1:172.21.15.123:6789/0 conn(0x7f2a60159c60 legacy=0x7f2a60070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5ffff700 1 -- 172.21.15.123:0/110241582 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6006dce0 con 0x7f2a600cab00 2023-07-21T19:08:19.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5ffff700 1 --2- 172.21.15.123:0/110241582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600cab00 0x7f2a600caf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009d90 tx=0x7f2a5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5083f590ccfa19c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5e7fc700 1 -- 172.21.15.123:0/110241582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800e070 con 0x7f2a600cab00 2023-07-21T19:08:19.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5e7fc700 1 -- 172.21.15.123:0/110241582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5800bb20 con 0x7f2a600cab00 2023-07-21T19:08:19.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a5e7fc700 1 -- 172.21.15.123:0/110241582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58012430 con 0x7f2a600cab00 2023-07-21T19:08:19.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 -- 172.21.15.123:0/110241582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600cab00 msgr2=0x7f2a600caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 --2- 172.21.15.123:0/110241582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600cab00 0x7f2a600caf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009d90 tx=0x7f2a5800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:19.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 -- 172.21.15.123:0/110241582 shutdown_connections 2023-07-21T19:08:19.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 --2- 172.21.15.123:0/110241582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600cab00 0x7f2a600caf80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 --2- 172.21.15.123:0/110241582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600b0770 0x7f2a6006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.203+0000 7f2a648c4700 1 -- 172.21.15.123:0/110241582 >> 172.21.15.123:0/110241582 conn(0x7f2a600afc60 msgr2=0x7f2a600b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:19.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.207+0000 7f2a648c4700 1 -- 172.21.15.123:0/110241582 shutdown_connections 2023-07-21T19:08:19.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.207+0000 7f2a648c4700 1 -- 172.21.15.123:0/110241582 wait complete. 2023-07-21T19:08:19.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.207+0000 7f2a648c4700 1 Processor -- start 2023-07-21T19:08:19.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.207+0000 7f2a648c4700 1 -- start start 2023-07-21T19:08:19.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 0x7f2a600c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600cab00 0x7f2a600c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a60159c60 0x7f2a601ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c7ed0 con 0x7f2a600b0770 2023-07-21T19:08:19.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c7040 con 0x7f2a60159c60 2023-07-21T19:08:19.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60146350 con 0x7f2a600cab00 2023-07-21T19:08:19.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 0x7f2a600c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 0x7f2a600c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51624/0 (socket says 172.21.15.123:51624) 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 -- 172.21.15.123:0/565928496 learned_addr learned my addr 172.21.15.123:0/565928496 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5ffff700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a60159c60 0x7f2a601ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5effd700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600cab00 0x7f2a600c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 -- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600cab00 msgr2=0x7f2a600c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600cab00 0x7f2a600c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 -- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a60159c60 msgr2=0x7f2a601ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a60159c60 0x7f2a601ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 -- 172.21.15.123:0/565928496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009a70 con 0x7f2a600b0770 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5ffff700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a60159c60 0x7f2a601ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a5f7fe700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 0x7f2a600c5db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c700 tx=0x7f2a5000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50005d90 con 0x7f2a600b0770 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a500070d0 con 0x7f2a600b0770 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a600c7250 con 0x7f2a600b0770 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50007440 con 0x7f2a600b0770 2023-07-21T19:08:19.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.211+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600c7810 con 0x7f2a600b0770 2023-07-21T19:08:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.215+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6004e500 con 0x7f2a600b0770 2023-07-21T19:08:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.215+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a500075a0 con 0x7f2a600b0770 2023-07-21T19:08:19.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.215+0000 7f2a47fff700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2a4c0662f0 0x7f2a4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.215+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a50083400 con 0x7f2a600b0770 2023-07-21T19:08:19.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.219+0000 7f2a5effd700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2a4c0662f0 0x7f2a4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.219+0000 7f2a5effd700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2a4c0662f0 0x7f2a4c0687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a600c6a30 tx=0x7f2a54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.223+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2a50050650 con 0x7f2a600b0770 2023-07-21T19:08:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.395+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a601eecd0 con 0x7f2a600b0770 2023-07-21T19:08:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.395+0000 7f2a47fff700 1 -- 172.21.15.123:0/565928496 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a50053c70 con 0x7f2a600b0770 2023-07-21T19:08:19.408 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.395+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2a4c0662f0 msgr2=0x7f2a4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.395+0000 7f2a648c4700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2a4c0662f0 0x7f2a4c0687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a600c6a30 tx=0x7f2a54008040 comp rx=0 tx=0).stop 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.395+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 msgr2=0x7f2a600c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.395+0000 7f2a648c4700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 0x7f2a600c5db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c700 tx=0x7f2a5000cac0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 shutdown_connections 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2a4c0662f0 0x7f2a4c0687a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a60159c60 0x7f2a601ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a600cab00 0x7f2a600c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 --2- 172.21.15.123:0/565928496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a600b0770 0x7f2a600c5db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 >> 172.21.15.123:0/565928496 conn(0x7f2a600afc60 msgr2=0x7f2a600b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:19.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 shutdown_connections 2023-07-21T19:08:19.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.399+0000 7f2a648c4700 1 -- 172.21.15.123:0/565928496 wait complete. 2023-07-21T19:08:19.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 Processor -- start 2023-07-21T19:08:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 -- start start 2023-07-21T19:08:19.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5d00b0ee0 0x7fc5d00ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc5d00d07e0 0x7fc5d00af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d00cd4e0 con 0x7fc5d00cd090 2023-07-21T19:08:19.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00d0c60 con 0x7fc5d00b0ee0 2023-07-21T19:08:19.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d69d2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00d1a60 con 0x7fc5d00d07e0 2023-07-21T19:08:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5d00b0ee0 0x7fc5d00ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5d00b0ee0 0x7fc5d00ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51638/0 (socket says 172.21.15.123:51638) 2023-07-21T19:08:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 -- 172.21.15.123:0/993298673 learned_addr learned my addr 172.21.15.123:0/993298673 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d61d1700 1 --2- 172.21.15.123:0/993298673 >> v2:172.21.15.145:3300/0 conn(0x7fc5d00d07e0 0x7fc5d00af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 -- 172.21.15.123:0/993298673 >> v2:172.21.15.145:3300/0 conn(0x7fc5d00d07e0 msgr2=0x7fc5d00af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:19.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 --2- 172.21.15.123:0/993298673 >> v2:172.21.15.145:3300/0 conn(0x7fc5d00d07e0 0x7fc5d00af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 -- 172.21.15.123:0/993298673 >> v1:172.21.15.123:6789/0 conn(0x7fc5d00cd090 legacy=0x7fc5d00d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 -- 172.21.15.123:0/993298673 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00d1ef0 con 0x7fc5d00b0ee0 2023-07-21T19:08:19.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d49ce700 1 -- 172.21.15.123:0/993298673 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096301659 0 0) 0x7fc5c0001110 con 0x7fc5d00cd090 2023-07-21T19:08:19.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.595+0000 7fc5d59d0700 1 --2- 172.21.15.123:0/993298673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d00ccb50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00b4fb0 tx=0x7fc5cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4bd88f9dc2918 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d49ce700 1 -- 172.21.15.123:0/993298673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00e070 con 0x7fc5d00b0ee0 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d49ce700 1 -- 172.21.15.123:0/993298673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc00b9c0 con 0x7fc5d00b0ee0 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d49ce700 1 -- 172.21.15.123:0/993298673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00bd70 con 0x7fc5d00b0ee0 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 -- 172.21.15.123:0/993298673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00b0ee0 msgr2=0x7fc5d00ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/993298673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d00ccb50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00b4fb0 tx=0x7fc5cc00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 -- 172.21.15.123:0/993298673 shutdown_connections 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/993298673 >> v2:172.21.15.145:3300/0 conn(0x7fc5d00d07e0 0x7fc5d00af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/993298673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d00ccb50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 -- 172.21.15.123:0/993298673 >> 172.21.15.123:0/993298673 conn(0x7fc5d0060c40 msgr2=0x7fc5d009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:19.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 -- 172.21.15.123:0/993298673 shutdown_connections 2023-07-21T19:08:19.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.599+0000 7fc5d69d2700 1 -- 172.21.15.123:0/993298673 wait complete. 2023-07-21T19:08:19.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 Processor -- start 2023-07-21T19:08:19.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 -- start start 2023-07-21T19:08:19.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00cd090 0x7fc5d0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 0x7fc5d01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00cbc40 con 0x7fc5d00d07e0 2023-07-21T19:08:19.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00cacb0 con 0x7fc5d00b0ee0 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c9c10 con 0x7fc5d00cd090 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 0x7fc5d01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 0x7fc5d01589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51646/0 (socket says 172.21.15.123:51646) 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 -- 172.21.15.123:0/1248220552 learned_addr learned my addr 172.21.15.123:0/1248220552 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d51cf700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00cd090 0x7fc5d0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d59d0700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 -- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00cd090 msgr2=0x7fc5d0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00cd090 0x7fc5d0158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 -- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00b0ee0 msgr2=0x7fc5d0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 -- 172.21.15.123:0/1248220552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009b30 con 0x7fc5d00d07e0 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d61d1700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 0x7fc5d01589b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e810 tx=0x7fc5c800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8013610 con 0x7fc5d00d07e0 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8013770 con 0x7fc5d00d07e0 2023-07-21T19:08:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.603+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d00c9ef0 con 0x7fc5d00d07e0 2023-07-21T19:08:19.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.607+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8013b20 con 0x7fc5d00d07e0 2023-07-21T19:08:19.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.607+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d00ca4b0 con 0x7fc5d00d07e0 2023-07-21T19:08:19.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.607+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d004e500 con 0x7fc5d00d07e0 2023-07-21T19:08:19.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.607+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5c8013c80 con 0x7fc5d00d07e0 2023-07-21T19:08:19.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.611+0000 7fc5c67fc700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5b40662f0 0x7fc5b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.611+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc5c8083d70 con 0x7fc5d00d07e0 2023-07-21T19:08:19.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.611+0000 7fc5d59d0700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5b40662f0 0x7fc5b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.611+0000 7fc5d59d0700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5b40662f0 0x7fc5b40687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009f90 tx=0x7fc5cc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.615+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc5c8050e70 con 0x7fc5d00d07e0 2023-07-21T19:08:19.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.783+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5d00d16e0 con 0x7fc5d00d07e0 2023-07-21T19:08:19.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.787+0000 7fc5c67fc700 1 -- 172.21.15.123:0/1248220552 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5c8054490 con 0x7fc5d00d07e0 2023-07-21T19:08:19.799 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5b40662f0 msgr2=0x7fc5b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5b40662f0 0x7fc5b40687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009f90 tx=0x7fc5cc009000 comp rx=0 tx=0).stop 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 msgr2=0x7fc5d01589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 0x7fc5d01589b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e810 tx=0x7fc5c800ebd0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 shutdown_connections 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc5b40662f0 0x7fc5b40687a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5d00d07e0 0x7fc5d01589b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00cd090 0x7fc5d0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 --2- 172.21.15.123:0/1248220552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00b0ee0 0x7fc5d0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 >> 172.21.15.123:0/1248220552 conn(0x7fc5d0060c40 msgr2=0x7fc5d015a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:19.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 shutdown_connections 2023-07-21T19:08:19.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.791+0000 7fc5d69d2700 1 -- 172.21.15.123:0/1248220552 wait complete. 2023-07-21T19:08:19.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:08:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.979+0000 7f0709b8b700 1 Processor -- start 2023-07-21T19:08:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0709b8b700 1 -- start start 2023-07-21T19:08:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0709b8b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0704159f20 0x7f07040caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0709b8b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f07040caf70 0x7f070415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0709b8b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040b0ef0 con 0x7f07040c9d90 2023-07-21T19:08:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0709b8b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040ce9c0 con 0x7f0704159f20 2023-07-21T19:08:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0709b8b700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040cee50 con 0x7f07040caf70 2023-07-21T19:08:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0704159f20 0x7f07040caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0704159f20 0x7f07040caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51658/0 (socket says 172.21.15.123:51658) 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 -- 172.21.15.123:0/3876106616 learned_addr learned my addr 172.21.15.123:0/3876106616 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f070938a700 1 --2- 172.21.15.123:0/3876106616 >> v2:172.21.15.145:3300/0 conn(0x7f07040caf70 0x7f070415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 -- 172.21.15.123:0/3876106616 >> v2:172.21.15.145:3300/0 conn(0x7f07040caf70 msgr2=0x7f070415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 --2- 172.21.15.123:0/3876106616 >> v2:172.21.15.145:3300/0 conn(0x7f07040caf70 0x7f070415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 -- 172.21.15.123:0/3876106616 >> v1:172.21.15.145:6789/0 conn(0x7f07040c9d90 legacy=0x7f07040ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 -- 172.21.15.123:0/3876106616 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040cb4f0 con 0x7f0704159f20 2023-07-21T19:08:19.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f0703fff700 1 --2- 172.21.15.123:0/3876106616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704159f20 0x7f07040caa30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07040ca950 tx=0x7f06f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e2d9319cbadccd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:19.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f07037fe700 1 -- 172.21.15.123:0/3876106616 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0011830 con 0x7f0704159f20 2023-07-21T19:08:19.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f07037fe700 1 -- 172.21.15.123:0/3876106616 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0011990 con 0x7f0704159f20 2023-07-21T19:08:20.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.983+0000 7f07037fe700 1 -- 172.21.15.123:0/3876106616 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0011d20 con 0x7f0704159f20 2023-07-21T19:08:20.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 -- 172.21.15.123:0/3876106616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704159f20 msgr2=0x7f07040caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 --2- 172.21.15.123:0/3876106616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704159f20 0x7f07040caa30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07040ca950 tx=0x7f06f0009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 -- 172.21.15.123:0/3876106616 shutdown_connections 2023-07-21T19:08:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 --2- 172.21.15.123:0/3876106616 >> v2:172.21.15.145:3300/0 conn(0x7f07040caf70 0x7f070415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 --2- 172.21.15.123:0/3876106616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704159f20 0x7f07040caa30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 -- 172.21.15.123:0/3876106616 >> 172.21.15.123:0/3876106616 conn(0x7f070406e960 msgr2=0x7f070406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 -- 172.21.15.123:0/3876106616 shutdown_connections 2023-07-21T19:08:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.987+0000 7f0709b8b700 1 -- 172.21.15.123:0/3876106616 wait complete. 2023-07-21T19:08:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 Processor -- start 2023-07-21T19:08:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 -- start start 2023-07-21T19:08:20.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 0x7f0704154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07040caf70 0x7f070414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0704159f20 0x7f07041f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040c2960 con 0x7f07040c9d90 2023-07-21T19:08:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07041efea0 con 0x7f07040caf70 2023-07-21T19:08:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0709b8b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0704154a80 con 0x7f0704159f20 2023-07-21T19:08:20.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 0x7f0704154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 0x7f0704154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51668/0 (socket says 172.21.15.123:51668) 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 -- 172.21.15.123:0/2005254291 learned_addr learned my addr 172.21.15.123:0/2005254291 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0703fff700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07040caf70 0x7f070414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f070938a700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0704159f20 0x7f07041f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 -- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0704159f20 msgr2=0x7f07041f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0704159f20 0x7f07041f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 -- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07040caf70 msgr2=0x7f070414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07040caf70 0x7f070414f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0708b89700 1 -- 172.21.15.123:0/2005254291 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f0009570 con 0x7f07040c9d90 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.991+0000 7f0703fff700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07040caf70 0x7f070414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f0708b89700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 0x7f0704154540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f06f800c500 tx=0x7f06f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80052d0 con 0x7f07040c9d90 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8005430 con 0x7f07040c9d90 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040c2bb0 con 0x7f07040c9d90 2023-07-21T19:08:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80055a0 con 0x7f07040c9d90 2023-07-21T19:08:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040c3170 con 0x7f07040c9d90 2023-07-21T19:08:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.995+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07041f0010 con 0x7f07040c9d90 2023-07-21T19:08:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.999+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06f80038e0 con 0x7f07040c9d90 2023-07-21T19:08:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.999+0000 7f07017fa700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06e80662f0 0x7f06e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.999+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06f8083480 con 0x7f07040c9d90 2023-07-21T19:08:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.999+0000 7f0703fff700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06e80662f0 0x7f06e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:19.999+0000 7f0703fff700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06e80662f0 0x7f06e80687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.021 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.007+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f06f8050600 con 0x7f07040c9d90 2023-07-21T19:08:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.215+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f070404e500 con 0x7f07040c9d90 2023-07-21T19:08:20.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.215+0000 7f07017fa700 1 -- 172.21.15.123:0/2005254291 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f06f8053c20 con 0x7f07040c9d90 2023-07-21T19:08:20.229 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:20.229 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:08:20.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06e80662f0 msgr2=0x7f06e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06e80662f0 0x7f06e80687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f0008030 comp rx=0 tx=0).stop 2023-07-21T19:08:20.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 msgr2=0x7f0704154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 0x7f0704154540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f06f800c500 tx=0x7f06f800c8c0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 shutdown_connections 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06e80662f0 0x7f06e80687a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07040caf70 0x7f070414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0704159f20 0x7f07041f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 --2- 172.21.15.123:0/2005254291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07040c9d90 0x7f0704154540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 >> 172.21.15.123:0/2005254291 conn(0x7f070406e960 msgr2=0x7f07040adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 shutdown_connections 2023-07-21T19:08:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.219+0000 7f0709b8b700 1 -- 172.21.15.123:0/2005254291 wait complete. 2023-07-21T19:08:20.235 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:08:20.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.407+0000 7f42a973e700 1 Processor -- start 2023-07-21T19:08:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.407+0000 7f42a973e700 1 -- start start 2023-07-21T19:08:20.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a973e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159b70 0x7f42a406ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a973e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f42a4159f40 0x7f42a406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a973e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a40cba60 con 0x7f42a406e230 2023-07-21T19:08:20.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a973e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40cbd40 con 0x7f42a4159f40 2023-07-21T19:08:20.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a973e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40cc020 con 0x7f42a4159b70 2023-07-21T19:08:20.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f42a406e230 0x7f42a406f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43546/0 (socket says 172.21.15.123:43546) 2023-07-21T19:08:20.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a3fff700 1 -- 172.21.15.123:0/3797701435 learned_addr learned my addr 172.21.15.123:0/3797701435 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f429a7fc700 1 --2- 172.21.15.123:0/3797701435 >> v2:172.21.15.145:3300/0 conn(0x7f42a4159f40 0x7f42a406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a2ffd700 1 --2- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159b70 0x7f42a406ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a27fc700 1 -- 172.21.15.123:0/3797701435 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807866008 0 0) 0x7f42a40cba60 con 0x7f42a406e230 2023-07-21T19:08:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f42a27fc700 1 -- 172.21.15.123:0/3797701435 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42900035d0 con 0x7f42a406e230 2023-07-21T19:08:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f429a7fc700 1 -- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159b70 msgr2=0x7f42a406ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f429a7fc700 1 --2- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159b70 0x7f42a406ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f429a7fc700 1 -- 172.21.15.123:0/3797701435 >> v1:172.21.15.123:6789/0 conn(0x7f42a406e230 legacy=0x7f42a406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.411+0000 7f429a7fc700 1 -- 172.21.15.123:0/3797701435 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a406d7d0 con 0x7f42a4159f40 2023-07-21T19:08:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f429a7fc700 1 --2- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a4159f40 0x7f42a406dcf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f428c009840 tx=0x7f428c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb92f7b0ed66bfe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a27fc700 1 -- 172.21.15.123:0/3797701435 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c005e50 con 0x7f42a4159f40 2023-07-21T19:08:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a27fc700 1 -- 172.21.15.123:0/3797701435 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c006030 con 0x7f42a4159f40 2023-07-21T19:08:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a27fc700 1 -- 172.21.15.123:0/3797701435 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0063c0 con 0x7f42a4159f40 2023-07-21T19:08:20.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 -- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a4159f40 msgr2=0x7f42a406dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 --2- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a4159f40 0x7f42a406dcf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f428c009840 tx=0x7f428c009b50 comp rx=0 tx=0).stop 2023-07-21T19:08:20.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 -- 172.21.15.123:0/3797701435 shutdown_connections 2023-07-21T19:08:20.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 --2- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a4159f40 0x7f42a406dcf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 --2- 172.21.15.123:0/3797701435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159b70 0x7f42a406ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 -- 172.21.15.123:0/3797701435 >> 172.21.15.123:0/3797701435 conn(0x7f42a40cc500 msgr2=0x7f42a40cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:20.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 -- 172.21.15.123:0/3797701435 shutdown_connections 2023-07-21T19:08:20.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.415+0000 7f42a973e700 1 -- 172.21.15.123:0/3797701435 wait complete. 2023-07-21T19:08:20.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 Processor -- start 2023-07-21T19:08:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 -- start start 2023-07-21T19:08:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a406e230 0x7f42a415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 0x7f42a40c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159f40 0x7f42a40c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a415d410 con 0x7f42a4159b70 2023-07-21T19:08:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a415d6f0 con 0x7f42a406e230 2023-07-21T19:08:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a973e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a415d9d0 con 0x7f42a4159f40 2023-07-21T19:08:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f429a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 0x7f42a40c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f429a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 0x7f42a40c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51676/0 (socket says 172.21.15.123:51676) 2023-07-21T19:08:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f429a7fc700 1 -- 172.21.15.123:0/272513680 learned_addr learned my addr 172.21.15.123:0/272513680 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a3fff700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159f40 0x7f42a40c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.419+0000 7f42a2ffd700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a406e230 0x7f42a415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429a7fc700 1 -- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159f40 msgr2=0x7f42a40c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429a7fc700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159f40 0x7f42a40c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429a7fc700 1 -- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a406e230 msgr2=0x7f42a415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429a7fc700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a406e230 0x7f42a415abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429a7fc700 1 -- 172.21.15.123:0/272513680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009450 con 0x7f42a4159b70 2023-07-21T19:08:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429a7fc700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 0x7f42a40c8d20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f428c009b90 tx=0x7f428c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c006690 con 0x7f42a4159b70 2023-07-21T19:08:20.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c020070 con 0x7f42a4159b70 2023-07-21T19:08:20.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a415dcb0 con 0x7f42a4159b70 2023-07-21T19:08:20.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c025430 con 0x7f42a4159b70 2023-07-21T19:08:20.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a415b100 con 0x7f42a4159b70 2023-07-21T19:08:20.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.423+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a404dcb0 con 0x7f42a4159b70 2023-07-21T19:08:20.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.427+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f428c022030 con 0x7f42a4159b70 2023-07-21T19:08:20.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.427+0000 7f429bfff700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f42840662f0 0x7f42840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.427+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f428c085490 con 0x7f42a4159b70 2023-07-21T19:08:20.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.427+0000 7f42a2ffd700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f42840662f0 0x7f42840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.431+0000 7f42a2ffd700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f42840662f0 0x7f42840687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4294009bf0 tx=0x7f4294009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.431+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f428c052740 con 0x7f42a4159b70 2023-07-21T19:08:20.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.611+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42a40b2420 con 0x7f42a4159b70 2023-07-21T19:08:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.615+0000 7f429bfff700 1 -- 172.21.15.123:0/272513680 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f428c055d60 con 0x7f42a4159b70 2023-07-21T19:08:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:20.629 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:20.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f42840662f0 msgr2=0x7f42840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f42840662f0 0x7f42840687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4294009bf0 tx=0x7f4294009240 comp rx=0 tx=0).stop 2023-07-21T19:08:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 msgr2=0x7f42a40c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 0x7f42a40c8d20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f428c009b90 tx=0x7f428c004770 comp rx=0 tx=0).stop 2023-07-21T19:08:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 shutdown_connections 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f42840662f0 0x7f42840687a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42a4159f40 0x7f42a40c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42a4159b70 0x7f42a40c8d20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 --2- 172.21.15.123:0/272513680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42a406e230 0x7f42a415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 >> 172.21.15.123:0/272513680 conn(0x7f42a40cc500 msgr2=0x7f42a40cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 shutdown_connections 2023-07-21T19:08:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.619+0000 7f42a973e700 1 -- 172.21.15.123:0/272513680 wait complete. 2023-07-21T19:08:20.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:20.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.823+0000 7f5cdabdc700 1 Processor -- start 2023-07-21T19:08:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.823+0000 7f5cdabdc700 1 -- start start 2023-07-21T19:08:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.823+0000 7f5cdabdc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd406d8f0 0x7f5cd40c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cdabdc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5cd40b09f0 0x7f5cd4070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cdabdc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd41587b0 con 0x7f5cd4071010 2023-07-21T19:08:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cdabdc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd4071490 con 0x7f5cd40b09f0 2023-07-21T19:08:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cdabdc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd4158a90 con 0x7f5cd406d8f0 2023-07-21T19:08:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd93d9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5cd40b09f0 0x7f5cd4070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cda3db700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5cd4071010 0x7f5cd41550e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43556/0 (socket says 172.21.15.123:43556) 2023-07-21T19:08:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cda3db700 1 -- 172.21.15.123:0/3741314672 learned_addr learned my addr 172.21.15.123:0/3741314672 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd9bda700 1 --2- 172.21.15.123:0/3741314672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd406d8f0 0x7f5cd40c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd93d9700 1 -- 172.21.15.123:0/3741314672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd406d8f0 msgr2=0x7f5cd40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd93d9700 1 --2- 172.21.15.123:0/3741314672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd406d8f0 0x7f5cd40c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd93d9700 1 -- 172.21.15.123:0/3741314672 >> v1:172.21.15.123:6789/0 conn(0x7f5cd4071010 legacy=0x7f5cd41550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd93d9700 1 -- 172.21.15.123:0/3741314672 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4158d70 con 0x7f5cd40b09f0 2023-07-21T19:08:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd8bd8700 1 -- 172.21.15.123:0/3741314672 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550026391 0 0) 0x7f5cd41587b0 con 0x7f5cd4071010 2023-07-21T19:08:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd93d9700 1 --2- 172.21.15.123:0/3741314672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd4070ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009850 tx=0x7f5cc4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7b0191ed5ceb8a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd8bd8700 1 -- 172.21.15.123:0/3741314672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4011830 con 0x7f5cd40b09f0 2023-07-21T19:08:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd8bd8700 1 -- 172.21.15.123:0/3741314672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4011990 con 0x7f5cd40b09f0 2023-07-21T19:08:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cd8bd8700 1 -- 172.21.15.123:0/3741314672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4011d20 con 0x7f5cd40b09f0 2023-07-21T19:08:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cdabdc700 1 -- 172.21.15.123:0/3741314672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 msgr2=0x7f5cd4070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.827+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/3741314672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd4070ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009850 tx=0x7f5cc4009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 -- 172.21.15.123:0/3741314672 shutdown_connections 2023-07-21T19:08:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/3741314672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd4070ad0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/3741314672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd406d8f0 0x7f5cd40c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 -- 172.21.15.123:0/3741314672 >> 172.21.15.123:0/3741314672 conn(0x7f5cd406e960 msgr2=0x7f5cd406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 -- 172.21.15.123:0/3741314672 shutdown_connections 2023-07-21T19:08:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 -- 172.21.15.123:0/3741314672 wait complete. 2023-07-21T19:08:20.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.831+0000 7f5cdabdc700 1 Processor -- start 2023-07-21T19:08:20.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 -- start start 2023-07-21T19:08:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cd406d8f0 0x7f5cd41f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd4071010 0x7f5cd40c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd40c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40af800 con 0x7f5cd40b09f0 2023-07-21T19:08:20.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40c5d60 con 0x7f5cd406d8f0 2023-07-21T19:08:20.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40af520 con 0x7f5cd4071010 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd40c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd40c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51698/0 (socket says 172.21.15.123:51698) 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 -- 172.21.15.123:0/315988845 learned_addr learned my addr 172.21.15.123:0/315988845 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cd9bda700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cd406d8f0 0x7f5cd41f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cd93d9700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd4071010 0x7f5cd40c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 -- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd4071010 msgr2=0x7f5cd40c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd4071010 0x7f5cd40c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 -- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cd406d8f0 msgr2=0x7f5cd41f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cd406d8f0 0x7f5cd41f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 -- 172.21.15.123:0/315988845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40094b0 con 0x7f5cd40b09f0 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cda3db700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd40c2530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00ccd0 tx=0x7f5ccc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00ada0 con 0x7f5cd40b09f0 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0070d0 con 0x7f5cd40b09f0 2023-07-21T19:08:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd40c5710 con 0x7f5cd40b09f0 2023-07-21T19:08:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc007480 con 0x7f5cd40b09f0 2023-07-21T19:08:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.835+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd40ae830 con 0x7f5cd40b09f0 2023-07-21T19:08:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.839+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd404e500 con 0x7f5cd40b09f0 2023-07-21T19:08:20.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.839+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ccc0075e0 con 0x7f5cd40b09f0 2023-07-21T19:08:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.843+0000 7f5cca7fc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5cb80662f0 0x7f5cb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.843+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ccc083fe0 con 0x7f5cd40b09f0 2023-07-21T19:08:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.843+0000 7f5cd9bda700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5cb80662f0 0x7f5cb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.843+0000 7f5cd9bda700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5cb80662f0 0x7f5cb80687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5cd414f3f0 tx=0x7f5cd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:20.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:20.847+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5ccc0510d0 con 0x7f5cd40b09f0 2023-07-21T19:08:21.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.019+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cd40c5ea0 con 0x7f5cd40b09f0 2023-07-21T19:08:21.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.019+0000 7f5cca7fc700 1 -- 172.21.15.123:0/315988845 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ccc0180a0 con 0x7f5cd40b09f0 2023-07-21T19:08:21.034 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:21.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5cb80662f0 msgr2=0x7f5cb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5cb80662f0 0x7f5cb80687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5cd414f3f0 tx=0x7f5cd0008040 comp rx=0 tx=0).stop 2023-07-21T19:08:21.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 msgr2=0x7f5cd40c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd40c2530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00ccd0 tx=0x7f5ccc00a340 comp rx=0 tx=0).stop 2023-07-21T19:08:21.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 shutdown_connections 2023-07-21T19:08:21.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5cb80662f0 0x7f5cb80687a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd40b09f0 0x7f5cd40c2530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cd4071010 0x7f5cd40c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 --2- 172.21.15.123:0/315988845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cd406d8f0 0x7f5cd41f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 >> 172.21.15.123:0/315988845 conn(0x7f5cd406e960 msgr2=0x7f5cd4150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 shutdown_connections 2023-07-21T19:08:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.027+0000 7f5cdabdc700 1 -- 172.21.15.123:0/315988845 wait complete. 2023-07-21T19:08:21.060 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:21.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1ab59e700 1 Processor -- start 2023-07-21T19:08:21.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1ab59e700 1 -- start start 2023-07-21T19:08:21.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1ab59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1ac0cd260 0x7fe1ac0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1ab59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0d1a60 con 0x7fe1ac0b0ee0 2023-07-21T19:08:21.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1ab59e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0d1ef0 con 0x7fe1ac0d0610 2023-07-21T19:08:21.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1ab59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0d0e50 con 0x7fe1ac0cd260 2023-07-21T19:08:21.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1a9d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1ac0cd260 0x7fe1ac0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1a9d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1ac0cd260 0x7fe1ac0d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51702/0 (socket says 172.21.15.123:51702) 2023-07-21T19:08:21.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.215+0000 7fe1a9d9b700 1 -- 172.21.15.123:0/160486799 learned_addr learned my addr 172.21.15.123:0/160486799 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:21.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a9d9b700 1 -- 172.21.15.123:0/160486799 >> v1:172.21.15.145:6789/0 conn(0x7fe1ac0d0610 legacy=0x7fe1ac0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:21.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a9d9b700 1 -- 172.21.15.123:0/160486799 >> v1:172.21.15.123:6789/0 conn(0x7fe1ac0b0ee0 legacy=0x7fe1ac0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a9d9b700 1 -- 172.21.15.123:0/160486799 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0d1130 con 0x7fe1ac0cd260 2023-07-21T19:08:21.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a9d9b700 1 --2- 172.21.15.123:0/160486799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0d00d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009910 tx=0x7fe1a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eda5dda4927aa9d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:21.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a959a700 1 -- 172.21.15.123:0/160486799 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0004230 con 0x7fe1ac0cd260 2023-07-21T19:08:21.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a959a700 1 -- 172.21.15.123:0/160486799 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0004390 con 0x7fe1ac0cd260 2023-07-21T19:08:21.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1a959a700 1 -- 172.21.15.123:0/160486799 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0009e60 con 0x7fe1ac0cd260 2023-07-21T19:08:21.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 -- 172.21.15.123:0/160486799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0cd260 msgr2=0x7fe1ac0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/160486799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0d00d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009910 tx=0x7fe1a0009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:21.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 -- 172.21.15.123:0/160486799 shutdown_connections 2023-07-21T19:08:21.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/160486799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0d00d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 -- 172.21.15.123:0/160486799 >> 172.21.15.123:0/160486799 conn(0x7fe1ac060c40 msgr2=0x7fe1ac09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:21.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 -- 172.21.15.123:0/160486799 shutdown_connections 2023-07-21T19:08:21.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.219+0000 7fe1ab59e700 1 -- 172.21.15.123:0/160486799 wait complete. 2023-07-21T19:08:21.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 Processor -- start 2023-07-21T19:08:21.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 -- start start 2023-07-21T19:08:21.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1ac0b0ee0 0x7fe1ac0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 0x7fe1ac0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b3080 con 0x7fe1ac0d0610 2023-07-21T19:08:21.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b3320 con 0x7fe1ac0cd260 2023-07-21T19:08:21.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1ab59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b3600 con 0x7fe1ac0b0ee0 2023-07-21T19:08:21.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1aad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 0x7fe1ac0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1aad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 0x7fe1ac0af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51706/0 (socket says 172.21.15.123:51706) 2023-07-21T19:08:21.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1aad9d700 1 -- 172.21.15.123:0/183847717 learned_addr learned my addr 172.21.15.123:0/183847717 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:21.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.223+0000 7fe1a9d9b700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aa59c700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1ac0b0ee0 0x7fe1ac0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aad9d700 1 -- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1ac0b0ee0 msgr2=0x7fe1ac0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aad9d700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1ac0b0ee0 0x7fe1ac0cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aad9d700 1 -- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac0cd260 msgr2=0x7fe1ac0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aad9d700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aad9d700 1 -- 172.21.15.123:0/183847717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0009570 con 0x7fe1ac0d0610 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1a9d9b700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aa59c700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1ac0b0ee0 0x7fe1ac0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1aad9d700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 0x7fe1ac0af0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400cc10 tx=0x7fe1a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:21.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400abb0 con 0x7fe1ac0d0610 2023-07-21T19:08:21.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400ad10 con 0x7fe1ac0d0610 2023-07-21T19:08:21.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac0b38e0 con 0x7fe1ac0d0610 2023-07-21T19:08:21.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4012660 con 0x7fe1ac0d0610 2023-07-21T19:08:21.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac0c95d0 con 0x7fe1ac0d0610 2023-07-21T19:08:21.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.227+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac04e500 con 0x7fe1ac0d0610 2023-07-21T19:08:21.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.231+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1a40127c0 con 0x7fe1ac0d0610 2023-07-21T19:08:21.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.231+0000 7fe19affd700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe18c066320 0x7fe18c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.231+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe1a4084810 con 0x7fe1ac0d0610 2023-07-21T19:08:21.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.231+0000 7fe1aa59c700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe18c066320 0x7fe18c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.231+0000 7fe1aa59c700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe18c066320 0x7fe18c0687d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe19c007fd0 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:21.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.235+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe1a4051a40 con 0x7fe1ac0d0610 2023-07-21T19:08:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.403+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1ac159170 con 0x7fe1ac0d0610 2023-07-21T19:08:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.403+0000 7fe19affd700 1 -- 172.21.15.123:0/183847717 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1a4016020 con 0x7fe1ac0d0610 2023-07-21T19:08:21.419 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe18c066320 msgr2=0x7fe18c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe18c066320 0x7fe18c0687d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe19c007fd0 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 msgr2=0x7fe1ac0af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 0x7fe1ac0af0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400cc10 tx=0x7fe1a400a060 comp rx=0 tx=0).stop 2023-07-21T19:08:21.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 shutdown_connections 2023-07-21T19:08:21.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe18c066320 0x7fe18c0687d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac0cd260 0x7fe1ac0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1ac0d0610 0x7fe1ac0af0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 --2- 172.21.15.123:0/183847717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1ac0b0ee0 0x7fe1ac0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 >> 172.21.15.123:0/183847717 conn(0x7fe1ac060c40 msgr2=0x7fe1ac0b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 shutdown_connections 2023-07-21T19:08:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.407+0000 7fe1ab59e700 1 -- 172.21.15.123:0/183847717 wait complete. 2023-07-21T19:08:21.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.607+0000 7f05a5200700 1 Processor -- start 2023-07-21T19:08:21.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.607+0000 7f05a5200700 1 -- start start 2023-07-21T19:08:21.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f05a5200700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05a00c87a0 0x7f05a00705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f05a5200700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a0071560 con 0x7f05a01597a0 2023-07-21T19:08:21.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f05a5200700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a0070cc0 con 0x7f05a0159b70 2023-07-21T19:08:21.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f05a5200700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00cbbc0 con 0x7f05a00c87a0 2023-07-21T19:08:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059ed9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05a01597a0 0x7f05a00cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43570/0 (socket says 172.21.15.123:43570) 2023-07-21T19:08:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059ed9d700 1 -- 172.21.15.123:0/4095852636 learned_addr learned my addr 172.21.15.123:0/4095852636 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059f59e700 1 --2- 172.21.15.123:0/4095852636 >> v2:172.21.15.123:3300/0 conn(0x7f05a00c87a0 0x7f05a00705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059f59e700 1 -- 172.21.15.123:0/4095852636 >> v1:172.21.15.145:6789/0 conn(0x7f05a0159b70 legacy=0x7f05a00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059f59e700 1 -- 172.21.15.123:0/4095852636 >> v1:172.21.15.123:6789/0 conn(0x7f05a01597a0 legacy=0x7f05a00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059f59e700 1 -- 172.21.15.123:0/4095852636 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0070fa0 con 0x7f05a00c87a0 2023-07-21T19:08:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059f59e700 1 --2- 172.21.15.123:0/4095852636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a00705e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0598009d90 tx=0x7f059800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab4aa712b71b65b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059dd9b700 1 -- 172.21.15.123:0/4095852636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800e070 con 0x7f05a00c87a0 2023-07-21T19:08:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059dd9b700 1 -- 172.21.15.123:0/4095852636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800bbd0 con 0x7f05a00c87a0 2023-07-21T19:08:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f059dd9b700 1 -- 172.21.15.123:0/4095852636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598012430 con 0x7f05a00c87a0 2023-07-21T19:08:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f05a5200700 1 -- 172.21.15.123:0/4095852636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 msgr2=0x7f05a00705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.611+0000 7f05a5200700 1 --2- 172.21.15.123:0/4095852636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a00705e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0598009d90 tx=0x7f059800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 -- 172.21.15.123:0/4095852636 shutdown_connections 2023-07-21T19:08:21.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 --2- 172.21.15.123:0/4095852636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a00705e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 -- 172.21.15.123:0/4095852636 >> 172.21.15.123:0/4095852636 conn(0x7f05a00afc60 msgr2=0x7f05a00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:21.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 -- 172.21.15.123:0/4095852636 shutdown_connections 2023-07-21T19:08:21.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 -- 172.21.15.123:0/4095852636 wait complete. 2023-07-21T19:08:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 Processor -- start 2023-07-21T19:08:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.615+0000 7f05a5200700 1 -- start start 2023-07-21T19:08:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05a01597a0 0x7f05a01505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05a0159b70 0x7f05a014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0153af0 con 0x7f05a00c87a0 2023-07-21T19:08:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0153f10 con 0x7f05a01597a0 2023-07-21T19:08:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a015e460 con 0x7f05a0159b70 2023-07-21T19:08:21.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51732/0 (socket says 172.21.15.123:51732) 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 -- 172.21.15.123:0/1429654737 learned_addr learned my addr 172.21.15.123:0/1429654737 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059f59e700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05a0159b70 0x7f05a014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059e59c700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05a01597a0 0x7f05a01505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 -- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05a0159b70 msgr2=0x7f05a014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05a0159b70 0x7f05a014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 -- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05a01597a0 msgr2=0x7f05a01505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05a01597a0 0x7f05a01505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 -- 172.21.15.123:0/1429654737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598009a70 con 0x7f05a00c87a0 2023-07-21T19:08:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f059ed9d700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a015de60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f059000c700 tx=0x7f059000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590005d90 con 0x7f05a00c87a0 2023-07-21T19:08:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900070d0 con 0x7f05a00c87a0 2023-07-21T19:08:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a0153430 con 0x7f05a00c87a0 2023-07-21T19:08:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590007440 con 0x7f05a00c87a0 2023-07-21T19:08:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.619+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a00ad7c0 con 0x7f05a00c87a0 2023-07-21T19:08:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.623+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a0153c30 con 0x7f05a00c87a0 2023-07-21T19:08:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.623+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05900075a0 con 0x7f05a00c87a0 2023-07-21T19:08:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.627+0000 7f05877fe700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f058c066320 0x7f058c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.627+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05900832b0 con 0x7f05a00c87a0 2023-07-21T19:08:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.627+0000 7f059e59c700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f058c066320 0x7f058c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.627+0000 7f059e59c700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f058c066320 0x7f058c0687d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05a01602c0 tx=0x7f0594009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.631+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f05a0153c30 con 0x7f05a00c87a0 2023-07-21T19:08:21.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.811+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05a0153c30 con 0x7f05a00c87a0 2023-07-21T19:08:21.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.811+0000 7f05877fe700 1 -- 172.21.15.123:0/1429654737 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05900504e0 con 0x7f05a00c87a0 2023-07-21T19:08:21.826 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:21.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f058c066320 msgr2=0x7f058c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f058c066320 0x7f058c0687d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05a01602c0 tx=0x7f0594009040 comp rx=0 tx=0).stop 2023-07-21T19:08:21.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 msgr2=0x7f05a015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a015de60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f059000c700 tx=0x7f059000ca10 comp rx=0 tx=0).stop 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 shutdown_connections 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f058c066320 0x7f058c0687d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05a01597a0 0x7f05a01505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05a0159b70 0x7f05a014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 --2- 172.21.15.123:0/1429654737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a00c87a0 0x7f05a015de60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:21.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 >> 172.21.15.123:0/1429654737 conn(0x7f05a00afc60 msgr2=0x7f05a00c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 shutdown_connections 2023-07-21T19:08:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:21.815+0000 7f05a5200700 1 -- 172.21.15.123:0/1429654737 wait complete. 2023-07-21T19:08:21.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:22.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.011+0000 7fc978bc3700 1 Processor -- start 2023-07-21T19:08:22.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.011+0000 7fc978bc3700 1 -- start start 2023-07-21T19:08:22.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.011+0000 7fc978bc3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974155d90 0x7fc9741590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc978bc3700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc974060770 0x7fc9740caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc978bc3700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740c9630 con 0x7fc974060320 2023-07-21T19:08:22.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc978bc3700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc974156160 con 0x7fc974060770 2023-07-21T19:08:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc978bc3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c9070 con 0x7fc974155d90 2023-07-21T19:08:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9737fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974155d90 0x7fc9741590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc972ffd700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fc974060320 0x7fc97406f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:36250/0 (socket says 172.21.15.123:36250) 2023-07-21T19:08:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc972ffd700 1 -- 172.21.15.123:0/1281224316 learned_addr learned my addr 172.21.15.123:0/1281224316 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc973fff700 1 --2- 172.21.15.123:0/1281224316 >> v2:172.21.15.145:3300/0 conn(0x7fc974060770 0x7fc9740caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9727fc700 1 -- 172.21.15.123:0/1281224316 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164637704 0 0) 0x7fc9740c9630 con 0x7fc974060320 2023-07-21T19:08:22.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9727fc700 1 -- 172.21.15.123:0/1281224316 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc95c0035d0 con 0x7fc974060320 2023-07-21T19:08:22.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9737fe700 1 -- 172.21.15.123:0/1281224316 >> v2:172.21.15.145:3300/0 conn(0x7fc974060770 msgr2=0x7fc9740caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9737fe700 1 --2- 172.21.15.123:0/1281224316 >> v2:172.21.15.145:3300/0 conn(0x7fc974060770 0x7fc9740caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9737fe700 1 -- 172.21.15.123:0/1281224316 >> v1:172.21.15.145:6789/0 conn(0x7fc974060320 legacy=0x7fc97406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9737fe700 1 -- 172.21.15.123:0/1281224316 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740c9350 con 0x7fc974155d90 2023-07-21T19:08:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9737fe700 1 --2- 172.21.15.123:0/1281224316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974155d90 0x7fc9741590e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc964009850 tx=0x7fc964009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d8c3dd38e2e1db7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9727fc700 1 -- 172.21.15.123:0/1281224316 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964011830 con 0x7fc974155d90 2023-07-21T19:08:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9727fc700 1 -- 172.21.15.123:0/1281224316 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964011990 con 0x7fc974155d90 2023-07-21T19:08:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc9727fc700 1 -- 172.21.15.123:0/1281224316 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964011d40 con 0x7fc974155d90 2023-07-21T19:08:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc978bc3700 1 -- 172.21.15.123:0/1281224316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974155d90 msgr2=0x7fc9741590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.015+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1281224316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974155d90 0x7fc9741590e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc964009850 tx=0x7fc964009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- 172.21.15.123:0/1281224316 shutdown_connections 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1281224316 >> v2:172.21.15.145:3300/0 conn(0x7fc974060770 0x7fc9740caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1281224316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974155d90 0x7fc9741590e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- 172.21.15.123:0/1281224316 >> 172.21.15.123:0/1281224316 conn(0x7fc9740b04e0 msgr2=0x7fc9740b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- 172.21.15.123:0/1281224316 shutdown_connections 2023-07-21T19:08:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- 172.21.15.123:0/1281224316 wait complete. 2023-07-21T19:08:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 Processor -- start 2023-07-21T19:08:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- start start 2023-07-21T19:08:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974060320 0x7fc9741419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974060770 0x7fc974157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 0x7fc974146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741442a0 con 0x7fc974155d90 2023-07-21T19:08:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974141f10 con 0x7fc974060320 2023-07-21T19:08:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc978bc3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974143620 con 0x7fc974060770 2023-07-21T19:08:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc973fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 0x7fc974146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc973fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 0x7fc974146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51740/0 (socket says 172.21.15.123:51740) 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.019+0000 7fc973fff700 1 -- 172.21.15.123:0/1779136736 learned_addr learned my addr 172.21.15.123:0/1779136736 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc972ffd700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974060770 0x7fc974157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc9737fe700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974060320 0x7fc9741419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc973fff700 1 -- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974060770 msgr2=0x7fc974157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc973fff700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974060770 0x7fc974157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc973fff700 1 -- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974060320 msgr2=0x7fc9741419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc973fff700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974060320 0x7fc9741419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc973fff700 1 -- 172.21.15.123:0/1779136736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640094b0 con 0x7fc974155d90 2023-07-21T19:08:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc9737fe700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974060320 0x7fc9741419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc973fff700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 0x7fc974146810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009dd0 tx=0x7fc96c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c009c40 con 0x7fc974155d90 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00f040 con 0x7fc974155d90 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc974143900 con 0x7fc974155d90 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00ceb0 con 0x7fc974155d90 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc974143ec0 con 0x7fc974155d90 2023-07-21T19:08:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.023+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9740afe80 con 0x7fc974155d90 2023-07-21T19:08:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.027+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc96c014480 con 0x7fc974155d90 2023-07-21T19:08:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.027+0000 7fc95bfff700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc9600662f0 0x7fc9600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.027+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc96c084b40 con 0x7fc974155d90 2023-07-21T19:08:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.027+0000 7fc9737fe700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc9600662f0 0x7fc9600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.031+0000 7fc9737fe700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc9600662f0 0x7fc9600687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9640090b0 tx=0x7fc96401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.035+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc96c055750 con 0x7fc974155d90 2023-07-21T19:08:22.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.203+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9741443e0 con 0x7fc974155d90 2023-07-21T19:08:22.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.203+0000 7fc95bfff700 1 -- 172.21.15.123:0/1779136736 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9741443e0 con 0x7fc974155d90 2023-07-21T19:08:22.218 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:22.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc9600662f0 msgr2=0x7fc9600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc9600662f0 0x7fc9600687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9640090b0 tx=0x7fc96401c040 comp rx=0 tx=0).stop 2023-07-21T19:08:22.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 msgr2=0x7fc974146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 0x7fc974146810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009dd0 tx=0x7fc96c00c3a0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 shutdown_connections 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc9600662f0 0x7fc9600687a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974155d90 0x7fc974146810 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc974060770 0x7fc974157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 --2- 172.21.15.123:0/1779136736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974060320 0x7fc9741419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 >> 172.21.15.123:0/1779136736 conn(0x7fc9740b04e0 msgr2=0x7fc9740cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:22.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 shutdown_connections 2023-07-21T19:08:22.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.207+0000 7fc978bc3700 1 -- 172.21.15.123:0/1779136736 wait complete. 2023-07-21T19:08:22.241 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.403+0000 7f0822154700 1 Processor -- start 2023-07-21T19:08:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.403+0000 7f0822154700 1 -- start start 2023-07-21T19:08:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f0822154700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c160240 0x7f081c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f0822154700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f081c0b0490 0x7f081c0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f0822154700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c163fe0 con 0x7f081c160610 2023-07-21T19:08:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f0822154700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c0c8c30 con 0x7f081c0b0490 2023-07-21T19:08:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f0822154700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0ca9e0 con 0x7f081c160240 2023-07-21T19:08:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c160240 0x7f081c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f081c0b0490 0x7f081c0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f081c0b0490 0x7f081c0ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:46254/0 (socket says 172.21.15.123:46254) 2023-07-21T19:08:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 -- 172.21.15.123:0/1375698414 learned_addr learned my addr 172.21.15.123:0/1375698414 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 -- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c160240 msgr2=0x7f081c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 --2- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c160240 0x7f081c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 -- 172.21.15.123:0/1375698414 >> v1:172.21.15.145:6789/0 conn(0x7f081c160610 legacy=0x7f081c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 -- 172.21.15.123:0/1375698414 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c164230 con 0x7f081c0b0490 2023-07-21T19:08:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081bfff700 1 --2- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c0b0490 0x7f081c0ca320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0814009e50 tx=0x7f081400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ee1f2986c8ee45 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081a7fc700 1 -- 172.21.15.123:0/1375698414 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400e070 con 0x7f081c0b0490 2023-07-21T19:08:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081a7fc700 1 -- 172.21.15.123:0/1375698414 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081400b910 con 0x7f081c0b0490 2023-07-21T19:08:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.407+0000 7f081a7fc700 1 -- 172.21.15.123:0/1375698414 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400bcc0 con 0x7f081c0b0490 2023-07-21T19:08:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 -- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c0b0490 msgr2=0x7f081c0ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 --2- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c0b0490 0x7f081c0ca320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0814009e50 tx=0x7f081400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 -- 172.21.15.123:0/1375698414 shutdown_connections 2023-07-21T19:08:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 --2- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c0b0490 0x7f081c0ca320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 --2- 172.21.15.123:0/1375698414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c160240 0x7f081c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 -- 172.21.15.123:0/1375698414 >> 172.21.15.123:0/1375698414 conn(0x7f081c0cad80 msgr2=0x7f081c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 -- 172.21.15.123:0/1375698414 shutdown_connections 2023-07-21T19:08:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.411+0000 7f0822154700 1 -- 172.21.15.123:0/1375698414 wait complete. 2023-07-21T19:08:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 Processor -- start 2023-07-21T19:08:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 -- start start 2023-07-21T19:08:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c0b0490 0x7f081c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f081c160240 0x7f081c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c160610 0x7f081c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0b27c0 con 0x7f081c160240 2023-07-21T19:08:22.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0b1bb0 con 0x7f081c160610 2023-07-21T19:08:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.415+0000 7f0822154700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0b1e90 con 0x7f081c0b0490 2023-07-21T19:08:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c0b0490 0x7f081c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081b7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c0b0490 0x7f081c0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:34192/0 (socket says 172.21.15.123:34192) 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081b7fe700 1 -- 172.21.15.123:0/2333993126 learned_addr learned my addr 172.21.15.123:0/2333993126 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081affd700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f081c160240 0x7f081c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c160610 0x7f081c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 -- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c0b0490 msgr2=0x7f081c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c0b0490 0x7f081c0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 -- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f081c160240 msgr2=0x7f081c15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f081c160240 0x7f081c15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 -- 172.21.15.123:0/2333993126 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814009b30 con 0x7f081c160610 2023-07-21T19:08:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081affd700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f081c160240 0x7f081c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f081bfff700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c160610 0x7f081c0b1130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0814015000 tx=0x7f0814004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814004780 con 0x7f081c160610 2023-07-21T19:08:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08140092e0 con 0x7f081c160610 2023-07-21T19:08:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c0b2170 con 0x7f081c160610 2023-07-21T19:08:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140099b0 con 0x7f081c160610 2023-07-21T19:08:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c0c6f20 con 0x7f081c160610 2023-07-21T19:08:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.419+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c0b2930 con 0x7f081c160610 2023-07-21T19:08:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.423+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0814024450 con 0x7f081c160610 2023-07-21T19:08:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.423+0000 7f0803fff700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0808066320 0x7f08080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.427+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0814085d40 con 0x7f081c160610 2023-07-21T19:08:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.427+0000 7f081b7fe700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0808066320 0x7f08080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.427+0000 7f081b7fe700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0808066320 0x7f08080687d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f080c009cf0 tx=0x7f080c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.431+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0814056af0 con 0x7f081c160610 2023-07-21T19:08:22.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.607+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f081c04dcb0 con 0x7f081c160610 2023-07-21T19:08:22.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.607+0000 7f0803fff700 1 -- 172.21.15.123:0/2333993126 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0814056680 con 0x7f081c160610 2023-07-21T19:08:22.622 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:22.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0808066320 msgr2=0x7f08080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0808066320 0x7f08080687d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f080c009cf0 tx=0x7f080c009240 comp rx=0 tx=0).stop 2023-07-21T19:08:22.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c160610 msgr2=0x7f081c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c160610 0x7f081c0b1130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0814015000 tx=0x7f0814004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 shutdown_connections 2023-07-21T19:08:22.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0808066320 0x7f08080687d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f081c160610 0x7f081c0b1130 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f081c160240 0x7f081c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 --2- 172.21.15.123:0/2333993126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f081c0b0490 0x7f081c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 >> 172.21.15.123:0/2333993126 conn(0x7f081c0cad80 msgr2=0x7f081c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:22.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 shutdown_connections 2023-07-21T19:08:22.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.611+0000 7f0822154700 1 -- 172.21.15.123:0/2333993126 wait complete. 2023-07-21T19:08:22.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:08:22.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286efaf700 1 Processor -- start 2023-07-21T19:08:22.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286efaf700 1 -- start start 2023-07-21T19:08:22.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286efaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286815ffa0 0x7f286806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286efaf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28680ca8a0 con 0x7f28680cb180 2023-07-21T19:08:22.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286efaf700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28680cbcd0 con 0x7f286806dc50 2023-07-21T19:08:22.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286efaf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680cbf70 con 0x7f286815ffa0 2023-07-21T19:08:22.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286dfad700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286815ffa0 0x7f286806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286e7ae700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f28680cb180 0x7f28680ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42572/0 (socket says 172.21.15.123:42572) 2023-07-21T19:08:22.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286dfad700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286815ffa0 0x7f286806d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41034/0 (socket says 172.21.15.123:41034) 2023-07-21T19:08:22.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.807+0000 7f286e7ae700 1 -- 172.21.15.123:0/3845686893 learned_addr learned my addr 172.21.15.123:0/3845686893 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:22.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286dfad700 1 -- 172.21.15.123:0/3845686893 >> v1:172.21.15.145:6789/0 conn(0x7f286806dc50 legacy=0x7f28680caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286cfab700 1 -- 172.21.15.123:0/3845686893 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549318911 0 0) 0x7f28680cbcd0 con 0x7f286806dc50 2023-07-21T19:08:22.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286dfad700 1 -- 172.21.15.123:0/3845686893 >> v1:172.21.15.123:6789/0 conn(0x7f28680cb180 legacy=0x7f28680ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286dfad700 1 -- 172.21.15.123:0/3845686893 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680cc250 con 0x7f286815ffa0 2023-07-21T19:08:22.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286dfad700 1 --2- 172.21.15.123:0/3845686893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286815ffa0 0x7f286806d710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2864009850 tx=0x7f2864009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6a2786beeae664 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286cfab700 1 -- 172.21.15.123:0/3845686893 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864004230 con 0x7f286815ffa0 2023-07-21T19:08:22.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286cfab700 1 -- 172.21.15.123:0/3845686893 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864004390 con 0x7f286815ffa0 2023-07-21T19:08:22.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286cfab700 1 -- 172.21.15.123:0/3845686893 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640036c0 con 0x7f286815ffa0 2023-07-21T19:08:22.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 -- 172.21.15.123:0/3845686893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286815ffa0 msgr2=0x7f286806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 --2- 172.21.15.123:0/3845686893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286815ffa0 0x7f286806d710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2864009850 tx=0x7f2864009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:22.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 -- 172.21.15.123:0/3845686893 shutdown_connections 2023-07-21T19:08:22.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 --2- 172.21.15.123:0/3845686893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286815ffa0 0x7f286806d710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 -- 172.21.15.123:0/3845686893 >> 172.21.15.123:0/3845686893 conn(0x7f286806e960 msgr2=0x7f286806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:22.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 -- 172.21.15.123:0/3845686893 shutdown_connections 2023-07-21T19:08:22.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.811+0000 7f286efaf700 1 -- 172.21.15.123:0/3845686893 wait complete. 2023-07-21T19:08:22.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 Processor -- start 2023-07-21T19:08:22.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 -- start start 2023-07-21T19:08:22.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f286806dc50 0x7f28680c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 0x7f286815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f286815ffa0 0x7f2868160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286815cf40 con 0x7f28680cb180 2023-07-21T19:08:22.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868161760 con 0x7f286815ffa0 2023-07-21T19:08:22.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286efaf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28681608b0 con 0x7f286806dc50 2023-07-21T19:08:22.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286d7ac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 0x7f286815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286d7ac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 0x7f286815ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41044/0 (socket says 172.21.15.123:41044) 2023-07-21T19:08:22.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286d7ac700 1 -- 172.21.15.123:0/623689497 learned_addr learned my addr 172.21.15.123:0/623689497 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:22.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286dfad700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f286806dc50 0x7f28680c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.815+0000 7f286e7ae700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f286815ffa0 0x7f2868160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286d7ac700 1 -- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f286806dc50 msgr2=0x7f28680c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286d7ac700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f286806dc50 0x7f28680c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286d7ac700 1 -- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f286815ffa0 msgr2=0x7f2868160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:22.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286d7ac700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f286815ffa0 0x7f2868160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:22.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286d7ac700 1 -- 172.21.15.123:0/623689497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640094b0 con 0x7f28680cb180 2023-07-21T19:08:22.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286d7ac700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 0x7f286815ca00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2858007fd0 tx=0x7f285800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580054e0 con 0x7f28680cb180 2023-07-21T19:08:22.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800ce30 con 0x7f28680cb180 2023-07-21T19:08:22.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868160b50 con 0x7f28680cb180 2023-07-21T19:08:22.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580038e0 con 0x7f28680cb180 2023-07-21T19:08:22.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2868161110 con 0x7f28680cb180 2023-07-21T19:08:22.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.819+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2868071620 con 0x7f28680cb180 2023-07-21T19:08:22.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.823+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2858003a40 con 0x7f28680cb180 2023-07-21T19:08:22.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.823+0000 7f285e7fc700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f284c0662f0 0x7f284c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:22.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.823+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2858083400 con 0x7f28680cb180 2023-07-21T19:08:22.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.823+0000 7f286dfad700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f284c0662f0 0x7f284c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:22.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.827+0000 7f286dfad700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f284c0662f0 0x7f284c0687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2864009850 tx=0x7f2864010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:22.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:22.831+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f28580504f0 con 0x7f28680cb180 2023-07-21T19:08:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.031+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f286804e500 con 0x7f28680cb180 2023-07-21T19:08:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.031+0000 7f285e7fc700 1 -- 172.21.15.123:0/623689497 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f2858053b10 con 0x7f28680cb180 2023-07-21T19:08:23.047 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:23.047 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:08:23.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f284c0662f0 msgr2=0x7f284c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f284c0662f0 0x7f284c0687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2864009850 tx=0x7f2864010000 comp rx=0 tx=0).stop 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 msgr2=0x7f286815ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 0x7f286815ca00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2858007fd0 tx=0x7f285800c730 comp rx=0 tx=0).stop 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 shutdown_connections 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f284c0662f0 0x7f284c0687a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f286815ffa0 0x7f2868160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28680cb180 0x7f286815ca00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 --2- 172.21.15.123:0/623689497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f286806dc50 0x7f28680c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 >> 172.21.15.123:0/623689497 conn(0x7f286806e960 msgr2=0x7f286815f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:23.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 shutdown_connections 2023-07-21T19:08:23.051 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.035+0000 7f286efaf700 1 -- 172.21.15.123:0/623689497 wait complete. 2023-07-21T19:08:23.051 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:08:23.073 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 Processor -- start 2023-07-21T19:08:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 -- start start 2023-07-21T19:08:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fee78159f20 0x7fee780caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee780caf70 0x7fee7815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee780b0ef0 con 0x7fee780c9d90 2023-07-21T19:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780ce9c0 con 0x7fee780caf70 2023-07-21T19:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7f28c700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780cee50 con 0x7fee78159f20 2023-07-21T19:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7e28a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee780c9d90 0x7fee780ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42576/0 (socket says 172.21.15.123:42576) 2023-07-21T19:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7e28a700 1 -- 172.21.15.123:0/3034504359 learned_addr learned my addr 172.21.15.123:0/3034504359 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/3034504359 >> v2:172.21.15.123:3300/0 conn(0x7fee780caf70 0x7fee7815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7da89700 1 --2- 172.21.15.123:0/3034504359 >> v2:172.21.15.145:3300/0 conn(0x7fee78159f20 0x7fee780caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435040426 0 0) 0x7fee780b0ef0 con 0x7fee780c9d90 2023-07-21T19:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee640035d0 con 0x7fee780c9d90 2023-07-21T19:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1465628164 0 0) 0x7fee640035d0 con 0x7fee780c9d90 2023-07-21T19:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 >> v2:172.21.15.145:3300/0 conn(0x7fee78159f20 msgr2=0x7fee780caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 --2- 172.21.15.123:0/3034504359 >> v2:172.21.15.145:3300/0 conn(0x7fee78159f20 0x7fee780caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 >> v2:172.21.15.123:3300/0 conn(0x7fee780caf70 msgr2=0x7fee7815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 --2- 172.21.15.123:0/3034504359 >> v2:172.21.15.123:3300/0 conn(0x7fee780caf70 0x7fee7815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780cb4f0 con 0x7fee780c9d90 2023-07-21T19:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7fee74001670 con 0x7fee780c9d90 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 >> v1:172.21.15.123:6789/0 conn(0x7fee780c9d90 legacy=0x7fee780ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee64003a20 0x7fee64003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee64004870 0x7fee64004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780ce9c0 con 0x7fee64005220 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cee50 con 0x7fee64003a20 2023-07-21T19:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6400bfa0 con 0x7fee64004870 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.239+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/3034504359 >> v2:172.21.15.123:3300/0 conn(0x7fee780caf70 0x7fee7815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7e28a700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee64003a20 0x7fee64003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7da89700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee64004870 0x7fee64004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 -- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee64004870 msgr2=0x7fee64004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee64004870 0x7fee64004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 -- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee64003a20 msgr2=0x7fee64003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee64003a20 0x7fee64003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 -- 172.21.15.123:0/3034504359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640035d0 con 0x7fee64005220 2023-07-21T19:08:23.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 -- 172.21.15.123:0/3034504359 reap_dead start 2023-07-21T19:08:23.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee6400ba30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee7000e350 tx=0x7fee640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8075d4d16df8c6b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:23.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000ee10 con 0x7fee64005220 2023-07-21T19:08:23.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000f040 con 0x7fee64005220 2023-07-21T19:08:23.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7d288700 1 -- 172.21.15.123:0/3034504359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70003c80 con 0x7fee64005220 2023-07-21T19:08:23.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 -- 172.21.15.123:0/3034504359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 msgr2=0x7fee6400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee6400ba30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee7000e350 tx=0x7fee640058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 -- 172.21.15.123:0/3034504359 shutdown_connections 2023-07-21T19:08:23.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 --2- 172.21.15.123:0/3034504359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee6400ba30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 -- 172.21.15.123:0/3034504359 >> 172.21.15.123:0/3034504359 conn(0x7fee7806e960 msgr2=0x7fee7806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:23.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 -- 172.21.15.123:0/3034504359 shutdown_connections 2023-07-21T19:08:23.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.243+0000 7fee7f28c700 1 -- 172.21.15.123:0/3034504359 wait complete. 2023-07-21T19:08:23.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.247+0000 7fee7f28c700 1 Processor -- start 2023-07-21T19:08:23.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.247+0000 7fee7f28c700 1 -- start start 2023-07-21T19:08:23.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee780b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee780c52f0 0x7fee780b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee780b28d0 0x7fee780c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780b1a30 con 0x7fee64005220 2023-07-21T19:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780c45d0 con 0x7fee780c52f0 2023-07-21T19:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780b1090 con 0x7fee780b28d0 2023-07-21T19:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee780b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee780b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41086/0 (socket says 172.21.15.123:41086) 2023-07-21T19:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 -- 172.21.15.123:0/705178986 learned_addr learned my addr 172.21.15.123:0/705178986 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7ea8b700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee780b28d0 0x7fee780c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7da89700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee780c52f0 0x7fee780b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 -- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee780b28d0 msgr2=0x7fee780c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee780b28d0 0x7fee780c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 -- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee780c52f0 msgr2=0x7fee780b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee780c52f0 0x7fee780b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 -- 172.21.15.123:0/705178986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780b1370 con 0x7fee64005220 2023-07-21T19:08:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7e28a700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee780b1e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee74007110 tx=0x7fee74004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74011580 con 0x7fee64005220 2023-07-21T19:08:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74011720 con 0x7fee64005220 2023-07-21T19:08:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74011ad0 con 0x7fee64005220 2023-07-21T19:08:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee780b1650 con 0x7fee64005220 2023-07-21T19:08:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.251+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7814ae50 con 0x7fee64005220 2023-07-21T19:08:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.255+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee780b1b70 con 0x7fee64005220 2023-07-21T19:08:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.255+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee74011c30 con 0x7fee64005220 2023-07-21T19:08:23.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.255+0000 7fee6effd700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fee5c0662f0 0x7fee5c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.255+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee74083fe0 con 0x7fee64005220 2023-07-21T19:08:23.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.259+0000 7fee7da89700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fee5c0662f0 0x7fee5c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.259+0000 7fee7da89700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fee5c0662f0 0x7fee5c0687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee780af0c0 tx=0x7fee68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:23.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.263+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fee780b1b70 con 0x7fee64005220 2023-07-21T19:08:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.431+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee780b1b70 con 0x7fee64005220 2023-07-21T19:08:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.435+0000 7fee6effd700 1 -- 172.21.15.123:0/705178986 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fee780b1b70 con 0x7fee64005220 2023-07-21T19:08:23.449 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:23.449 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:07:52.941928+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:23.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fee5c0662f0 msgr2=0x7fee5c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fee5c0662f0 0x7fee5c0687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee780af0c0 tx=0x7fee68008040 comp rx=0 tx=0).stop 2023-07-21T19:08:23.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 msgr2=0x7fee780b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee780b1e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee74007110 tx=0x7fee74004f90 comp rx=0 tx=0).stop 2023-07-21T19:08:23.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 shutdown_connections 2023-07-21T19:08:23.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fee5c0662f0 0x7fee5c0687a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee780c52f0 0x7fee780b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee780b28d0 0x7fee780c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 --2- 172.21.15.123:0/705178986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee64005220 0x7fee780b1e50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 >> 172.21.15.123:0/705178986 conn(0x7fee7806e960 msgr2=0x7fee780af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:23.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 shutdown_connections 2023-07-21T19:08:23.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.439+0000 7fee7f28c700 1 -- 172.21.15.123:0/705178986 wait complete. 2023-07-21T19:08:23.472 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:08:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.631+0000 7faa0e051700 1 Processor -- start 2023-07-21T19:08:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa0e051700 1 -- start start 2023-07-21T19:08:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa0e051700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa0815c070 0x7faa080ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa0e051700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080cd530 con 0x7faa080ad8b0 2023-07-21T19:08:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa0e051700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0815c440 con 0x7faa080b0440 2023-07-21T19:08:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa0e051700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa080cc1b0 con 0x7faa0815c070 2023-07-21T19:08:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa0815c070 0x7faa080ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa0815c070 0x7faa080ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41100/0 (socket says 172.21.15.123:41100) 2023-07-21T19:08:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 -- 172.21.15.123:0/821707317 learned_addr learned my addr 172.21.15.123:0/821707317 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 -- 172.21.15.123:0/821707317 >> v1:172.21.15.145:6789/0 conn(0x7faa080b0440 legacy=0x7faa080703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 -- 172.21.15.123:0/821707317 >> v1:172.21.15.123:6789/0 conn(0x7faa080ad8b0 legacy=0x7faa080afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 -- 172.21.15.123:0/821707317 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080cc490 con 0x7faa0815c070 2023-07-21T19:08:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.635+0000 7faa077fe700 1 --2- 172.21.15.123:0/821707317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa0815c070 0x7faa080ad370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009910 tx=0x7fa9f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a360dd0fcb3b704 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa067fc700 1 -- 172.21.15.123:0/821707317 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8004230 con 0x7faa0815c070 2023-07-21T19:08:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa067fc700 1 -- 172.21.15.123:0/821707317 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8004390 con 0x7faa0815c070 2023-07-21T19:08:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa067fc700 1 -- 172.21.15.123:0/821707317 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8009e60 con 0x7faa0815c070 2023-07-21T19:08:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 -- 172.21.15.123:0/821707317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa0815c070 msgr2=0x7faa080ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 --2- 172.21.15.123:0/821707317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa0815c070 0x7faa080ad370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009910 tx=0x7fa9f8009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 -- 172.21.15.123:0/821707317 shutdown_connections 2023-07-21T19:08:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 --2- 172.21.15.123:0/821707317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa0815c070 0x7faa080ad370 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 -- 172.21.15.123:0/821707317 >> 172.21.15.123:0/821707317 conn(0x7faa080cad30 msgr2=0x7faa080cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 -- 172.21.15.123:0/821707317 shutdown_connections 2023-07-21T19:08:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.639+0000 7faa0e051700 1 -- 172.21.15.123:0/821707317 wait complete. 2023-07-21T19:08:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 Processor -- start 2023-07-21T19:08:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 -- start start 2023-07-21T19:08:23.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 0x7faa081eb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa080b0440 0x7faa080c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa0815c070 0x7faa080c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa080c7b50 con 0x7faa080ad8b0 2023-07-21T19:08:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa081f1c10 con 0x7faa0815c070 2023-07-21T19:08:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa0e051700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa081ebd80 con 0x7faa080b0440 2023-07-21T19:08:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 0x7faa081eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 0x7faa081eb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41114/0 (socket says 172.21.15.123:41114) 2023-07-21T19:08:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa077fe700 1 -- 172.21.15.123:0/4105523207 learned_addr learned my addr 172.21.15.123:0/4105523207 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa07fff700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa0815c070 0x7faa080c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.643+0000 7faa06ffd700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa080b0440 0x7faa080c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa077fe700 1 -- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa080b0440 msgr2=0x7faa080c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa077fe700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa080b0440 0x7faa080c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa077fe700 1 -- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa0815c070 msgr2=0x7faa080c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa077fe700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa0815c070 0x7faa080c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa077fe700 1 -- 172.21.15.123:0/4105523207 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8009570 con 0x7faa080ad8b0 2023-07-21T19:08:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa07fff700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa0815c070 0x7faa080c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa077fe700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 0x7faa081eb840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8004000 tx=0x7fa9f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80036c0 con 0x7faa080ad8b0 2023-07-21T19:08:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8003840 con 0x7faa080ad8b0 2023-07-21T19:08:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8003bf0 con 0x7faa080ad8b0 2023-07-21T19:08:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa080c6f40 con 0x7faa080ad8b0 2023-07-21T19:08:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa080c7500 con 0x7faa080ad8b0 2023-07-21T19:08:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.647+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa080c7cc0 con 0x7faa080ad8b0 2023-07-21T19:08:23.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.651+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9f8003d50 con 0x7faa080ad8b0 2023-07-21T19:08:23.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.651+0000 7fa9effff700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9f40662f0 0x7fa9f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.651+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9f8085910 con 0x7faa080ad8b0 2023-07-21T19:08:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.651+0000 7faa06ffd700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9f40662f0 0x7fa9f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.655+0000 7faa06ffd700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9f40662f0 0x7fa9f40687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa080ca1e0 tx=0x7fa9fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:23.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.659+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa9f8052b30 con 0x7faa080ad8b0 2023-07-21T19:08:23.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.867+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa0804dcb0 con 0x7faa080ad8b0 2023-07-21T19:08:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.867+0000 7fa9effff700 1 -- 172.21.15.123:0/4105523207 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7fa9f8056150 con 0x7faa080ad8b0 2023-07-21T19:08:23.882 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:23.882 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:08:23.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9f40662f0 msgr2=0x7fa9f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9f40662f0 0x7fa9f40687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa080ca1e0 tx=0x7fa9fc009040 comp rx=0 tx=0).stop 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 msgr2=0x7faa081eb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 0x7faa081eb840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8004000 tx=0x7fa9f8004770 comp rx=0 tx=0).stop 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 shutdown_connections 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9f40662f0 0x7fa9f40687a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa0815c070 0x7faa080c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa080b0440 0x7faa080c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 --2- 172.21.15.123:0/4105523207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa080ad8b0 0x7faa081eb840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:23.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 >> 172.21.15.123:0/4105523207 conn(0x7faa080cad30 msgr2=0x7faa080afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:23.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 shutdown_connections 2023-07-21T19:08:23.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:23.871+0000 7faa0e051700 1 -- 172.21.15.123:0/4105523207 wait complete. 2023-07-21T19:08:23.887 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:08:24.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T19:07:47.865751+0000', 'modified': '2023-07-21T19:08:08.624163+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6835/2690918060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6833', 'nonce': 2690918060}, {'type': 'v1', 'addr': '172.21.15.145:6835', 'nonce': 2690918060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T19:08:24.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T19:08:24.309 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-21T19:08:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.475+0000 7fd819333700 1 Processor -- start 2023-07-21T19:08:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.475+0000 7fd819333700 1 -- start start 2023-07-21T19:08:24.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd819333700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd8140cb180 0x7fd8140ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd819333700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140ca8a0 con 0x7fd814160370 2023-07-21T19:08:24.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd819333700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140cbcd0 con 0x7fd81415ffa0 2023-07-21T19:08:24.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd819333700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140cbf70 con 0x7fd8140cb180 2023-07-21T19:08:24.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8137fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd8140cb180 0x7fd8140ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd80bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd814160370 0x7fd8140caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42584/0 (socket says 172.21.15.123:42584) 2023-07-21T19:08:24.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd80bfff700 1 -- 172.21.15.123:0/1400009165 learned_addr learned my addr 172.21.15.123:0/1400009165 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:24.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8127fc700 1 -- 172.21.15.123:0/1400009165 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933762102 0 0) 0x7fd7fc001110 con 0x7fd814160370 2023-07-21T19:08:24.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8137fe700 1 -- 172.21.15.123:0/1400009165 >> v1:172.21.15.145:6789/0 conn(0x7fd81415ffa0 legacy=0x7fd81406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8137fe700 1 -- 172.21.15.123:0/1400009165 >> v1:172.21.15.123:6789/0 conn(0x7fd814160370 legacy=0x7fd8140caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8137fe700 1 -- 172.21.15.123:0/1400009165 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140cc250 con 0x7fd8140cb180 2023-07-21T19:08:24.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8137fe700 1 --2- 172.21.15.123:0/1400009165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd8140ce340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009d90 tx=0x7fd80c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5936bf22cddb72a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8127fc700 1 -- 172.21.15.123:0/1400009165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00e070 con 0x7fd8140cb180 2023-07-21T19:08:24.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8127fc700 1 -- 172.21.15.123:0/1400009165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c00bbd0 con 0x7fd8140cb180 2023-07-21T19:08:24.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.479+0000 7fd8127fc700 1 -- 172.21.15.123:0/1400009165 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c012430 con 0x7fd8140cb180 2023-07-21T19:08:24.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 -- 172.21.15.123:0/1400009165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 msgr2=0x7fd8140ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 --2- 172.21.15.123:0/1400009165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd8140ce340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009d90 tx=0x7fd80c00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:24.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 -- 172.21.15.123:0/1400009165 shutdown_connections 2023-07-21T19:08:24.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 --2- 172.21.15.123:0/1400009165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd8140ce340 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 -- 172.21.15.123:0/1400009165 >> 172.21.15.123:0/1400009165 conn(0x7fd81406e960 msgr2=0x7fd81406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:24.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 -- 172.21.15.123:0/1400009165 shutdown_connections 2023-07-21T19:08:24.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.483+0000 7fd819333700 1 -- 172.21.15.123:0/1400009165 wait complete. 2023-07-21T19:08:24.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 Processor -- start 2023-07-21T19:08:24.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 -- start start 2023-07-21T19:08:24.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd81415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd81415ffa0 0x7fd8140c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd814160370 0x7fd8140c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140c4320 con 0x7fd8140cb180 2023-07-21T19:08:24.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140c3710 con 0x7fd814160370 2023-07-21T19:08:24.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd819333700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140c39f0 con 0x7fd81415ffa0 2023-07-21T19:08:24.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd81415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd81415df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41138/0 (socket says 172.21.15.123:41138) 2023-07-21T19:08:24.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 -- 172.21.15.123:0/1470196924 learned_addr learned my addr 172.21.15.123:0/1470196924 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:24.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd80bfff700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd81415ffa0 0x7fd8140c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 -- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd81415ffa0 msgr2=0x7fd8140c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd81415ffa0 0x7fd8140c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd8137fe700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd814160370 0x7fd8140c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 -- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd814160370 msgr2=0x7fd8140c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd814160370 0x7fd8140c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 -- 172.21.15.123:0/1470196924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c009a70 con 0x7fd8140cb180 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.487+0000 7fd812ffd700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd81415df60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c500 tx=0x7fd80400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.491+0000 7fd80b7fe700 1 -- 172.21.15.123:0/1470196924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040052d0 con 0x7fd8140cb180 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.491+0000 7fd80b7fe700 1 -- 172.21.15.123:0/1470196924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804005430 con 0x7fd8140cb180 2023-07-21T19:08:24.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.491+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140c3cd0 con 0x7fd8140cb180 2023-07-21T19:08:24.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.491+0000 7fd80b7fe700 1 -- 172.21.15.123:0/1470196924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040055a0 con 0x7fd8140cb180 2023-07-21T19:08:24.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.491+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81415e4a0 con 0x7fd8140cb180 2023-07-21T19:08:24.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.491+0000 7fd80b7fe700 1 -- 172.21.15.123:0/1470196924 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8040038e0 con 0x7fd8140cb180 2023-07-21T19:08:24.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.495+0000 7fd80b7fe700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd7f40662f0 0x7fd7f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.495+0000 7fd80b7fe700 1 -- 172.21.15.123:0/1470196924 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd804083510 con 0x7fd8140cb180 2023-07-21T19:08:24.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.495+0000 7fd80bfff700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd7f40662f0 0x7fd7f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.495+0000 7fd80bfff700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd7f40662f0 0x7fd7f40687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8140b3b40 tx=0x7fd7fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.495+0000 7fd81c5ba740 1 Processor -- start 2023-07-21T19:08:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.495+0000 7fd81c5ba740 1 -- start start 2023-07-21T19:08:24.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x134b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092ae0 0x134bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092710 0x1300d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x121f270 con 0x1092eb0 2023-07-21T19:08:24.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x12723a0 con 0x1092ae0 2023-07-21T19:08:24.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x126b600 con 0x1092710 2023-07-21T19:08:24.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x134b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x134b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41148/0 (socket says 172.21.15.123:41148) 2023-07-21T19:08:24.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 -- 172.21.15.123:0/4150869458 learned_addr learned my addr 172.21.15.123:0/4150869458 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:24.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd80bfff700 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092ae0 0x134bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd8137fe700 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092710 0x1300d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 -- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092710 msgr2=0x1300d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092710 0x1300d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 -- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092ae0 msgr2=0x134bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092ae0 0x134bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 -- 172.21.15.123:0/4150869458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10de9e0 con 0x1092eb0 2023-07-21T19:08:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd8137fe700 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092710 0x1300d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd812ffd700 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x134b8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd8040507c0 tx=0x7fd804053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfe812893aa11b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd808ff9700 1 -- 172.21.15.123:0/4150869458 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804052400 con 0x1092eb0 2023-07-21T19:08:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd808ff9700 1 -- 172.21.15.123:0/4150869458 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804052660 con 0x1092eb0 2023-07-21T19:08:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd808ff9700 1 -- 172.21.15.123:0/4150869458 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040832c0 con 0x1092eb0 2023-07-21T19:08:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- 172.21.15.123:0/4150869458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 msgr2=0x134b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x134b8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd8040507c0 tx=0x7fd804053cf0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- 172.21.15.123:0/4150869458 shutdown_connections 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092ae0 0x134bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092710 0x1300d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/4150869458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x134b8b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- 172.21.15.123:0/4150869458 >> 172.21.15.123:0/4150869458 conn(0x12fcb60 msgr2=0x1307160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- 172.21.15.123:0/4150869458 shutdown_connections 2023-07-21T19:08:24.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.499+0000 7fd81c5ba740 1 -- 172.21.15.123:0/4150869458 wait complete. 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 -- start start 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 Processor -- start 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092ae0 0x1333f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x13550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x122db00 con 0x1092eb0 2023-07-21T19:08:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x122c470 con 0x1092710 2023-07-21T19:08:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1117b20 con 0x1092ae0 2023-07-21T19:08:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd81c5ba740 10 client.0 _ll_register_callbacks cb 0x1291530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T19:08:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x13550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x13550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41162/0 (socket says 172.21.15.123:41162) 2023-07-21T19:08:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 -- 172.21.15.123:0/1015614559 learned_addr learned my addr 172.21.15.123:0/1015614559 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd812ffd700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd80bfff700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092ae0 0x1333f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 -- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092ae0 msgr2=0x1333f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092ae0 0x1333f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 -- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 msgr2=0x1334f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 -- 172.21.15.123:0/1015614559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81415e4a0 con 0x1092eb0 2023-07-21T19:08:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd80bfff700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092ae0 0x1333f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd8137fe700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x13550c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00b730 tx=0x7fd80c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edadcbe92398f249 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd7f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-21T19:08:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.503+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/1015614559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c012430 con 0x1092eb0 2023-07-21T19:08:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12645e0 con 0x1092eb0 2023-07-21T19:08:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/1015614559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd80c003e20 con 0x1092eb0 2023-07-21T19:08:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/1015614559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd80c0098f0 con 0x1092eb0 2023-07-21T19:08:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 10 client.4926 fetch_fsmap learned FSMap version 9 2023-07-21T19:08:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1231250 con 0x1092eb0 2023-07-21T19:08:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/1015614559 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12645e0 con 0x1092eb0 2023-07-21T19:08:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/1015614559 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd80c012c80 con 0x1092eb0 2023-07-21T19:08:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 10 client.4926 fetch_fsmap finished waiting for FSMap version 9 2023-07-21T19:08:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 10 client.4926 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T19:08:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 20 client.4926 populate_metadata read hostname 'smithi123' 2023-07-21T19:08:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x10dd790 0x1335ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 4 client.4926 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T19:08:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 --> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1264300 con 0x10dd790 2023-07-21T19:08:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd812ffd700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x10dd790 0x1335ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd812ffd700 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x10dd790 0x1335ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f18f840a4762a9 server_cookie=b41db8d9c631c2f6 in_seq=0 out_seq=0 2023-07-21T19:08:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.507+0000 7fd7f1ffb700 10 client.4926 ms_handle_connect on v2:172.21.15.145:6833/2690918060 2023-07-21T19:08:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/1015614559 <== mds.0 v2:172.21.15.145:6833/2690918060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x1264300 con 0x10dd790 2023-07-21T19:08:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd7f1ffb700 10 client.4926 handle_command_reply: tid=0 2023-07-21T19:08:24.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 client.4926 shutdown 2023-07-21T19:08:24.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 msgr2=0x13550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x13550c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00b730 tx=0x7fd80c004b60 comp rx=0 tx=0).stop 2023-07-21T19:08:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 shutdown_connections 2023-07-21T19:08:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x10dd790 0x1335ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092eb0 0x13550c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092ae0 0x1333f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd7f1ffb700 0 client.4926 ms_handle_reset on v2:172.21.15.145:6833/2690918060 2023-07-21T19:08:24.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/1015614559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 >> 172.21.15.123:0/1015614559 conn(0x12fcb60 msgr2=0x1307160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 shutdown_connections 2023-07-21T19:08:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 1 -- 172.21.15.123:0/1015614559 wait complete. 2023-07-21T19:08:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.511+0000 7fd81c5ba740 20 client.4926 trim_cache size 0 max 16384 2023-07-21T19:08:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 Processor -- start 2023-07-21T19:08:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 -- start start 2023-07-21T19:08:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x1334fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1266f70 con 0x1092ae0 2023-07-21T19:08:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x126a490 con 0x1092710 2023-07-21T19:08:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.535+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x126e160 con 0x1092eb0 2023-07-21T19:08:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x1334fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x1334fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41178/0 (socket says 172.21.15.123:41178) 2023-07-21T19:08:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 -- 172.21.15.123:0/3222700949 learned_addr learned my addr 172.21.15.123:0/3222700949 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd812ffd700 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd8137fe700 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 -- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 msgr2=0x13538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 -- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 msgr2=0x1334a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 -- 172.21.15.123:0/3222700949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81406bec0 con 0x1092ae0 2023-07-21T19:08:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd8137fe700 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd80bfff700 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x1334fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c11c0 tx=0x7fd7fc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83666d7d65a4ef75 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd8097fa700 1 -- 172.21.15.123:0/3222700949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc007780 con 0x1092ae0 2023-07-21T19:08:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd8097fa700 1 -- 172.21.15.123:0/3222700949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc005900 con 0x1092ae0 2023-07-21T19:08:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd8097fa700 1 -- 172.21.15.123:0/3222700949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc005a70 con 0x1092ae0 2023-07-21T19:08:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3222700949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 msgr2=0x1334fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x1334fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c11c0 tx=0x7fd7fc012000 comp rx=0 tx=0).stop 2023-07-21T19:08:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3222700949 shutdown_connections 2023-07-21T19:08:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x1334fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3222700949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x1334a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3222700949 >> 172.21.15.123:0/3222700949 conn(0x12fcb60 msgr2=0x1307160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3222700949 shutdown_connections 2023-07-21T19:08:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3222700949 wait complete. 2023-07-21T19:08:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.539+0000 7fd81c5ba740 1 -- start start 2023-07-21T19:08:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 Processor -- start 2023-07-21T19:08:24.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x135a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x135b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13a9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x123b510 con 0x1092ae0 2023-07-21T19:08:24.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x123ad50 con 0x1092710 2023-07-21T19:08:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1273630 con 0x1092eb0 2023-07-21T19:08:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 10 client.0 _ll_register_callbacks cb 0x1223800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T19:08:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x135b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x135b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41186/0 (socket says 172.21.15.123:41186) 2023-07-21T19:08:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 -- 172.21.15.123:0/3304486808 learned_addr learned my addr 172.21.15.123:0/3304486808 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd8137fe700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 -- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 msgr2=0x13a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd812ffd700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x135a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 -- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 msgr2=0x135a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:24.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x135a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 -- 172.21.15.123:0/3304486808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc00f040 con 0x1092ae0 2023-07-21T19:08:24.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd812ffd700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x135a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:24.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd8137fe700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:24.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd80bfff700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x135b640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x120cec0 tx=0x7fd7fc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0d6aba437faf75 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:24.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd7f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-21T19:08:24.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/3304486808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc006260 con 0x1092ae0 2023-07-21T19:08:24.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/3304486808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7fc0063c0 con 0x1092ae0 2023-07-21T19:08:24.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x134b330 con 0x1092ae0 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/3304486808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7fc033ea0 con 0x1092ae0 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 10 client.4932 fetch_fsmap learned FSMap version 9 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x12175c0 con 0x1092ae0 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.543+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/3304486808 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x134b330 con 0x1092ae0 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/3304486808 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd7fc01f070 con 0x1092ae0 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 10 client.4932 fetch_fsmap finished waiting for FSMap version 9 2023-07-21T19:08:24.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 10 client.4932 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 20 client.4932 populate_metadata read hostname 'smithi123' 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x13aa400 0x1357c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 4 client.4932 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 --> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd804052660 con 0x13aa400 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd812ffd700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x13aa400 0x1357c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd7f1ffb700 10 client.4932 ms_handle_connect on v2:172.21.15.145:6833/2690918060 2023-07-21T19:08:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd812ffd700 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x13aa400 0x1357c20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf17e15d154034a server_cookie=54319c8a39737c7f in_seq=0 out_seq=0 2023-07-21T19:08:24.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd7f1ffb700 1 -- 172.21.15.123:0/3304486808 <== mds.0 v2:172.21.15.145:6833/2690918060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7fd804052660 con 0x13aa400 2023-07-21T19:08:24.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd7f1ffb700 10 client.4932 handle_command_reply: tid=0 2023-07-21T19:08:24.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 client.4932 shutdown 2023-07-21T19:08:24.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 msgr2=0x135b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x135b640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x120cec0 tx=0x7fd7fc007c70 comp rx=0 tx=0).stop 2023-07-21T19:08:24.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 shutdown_connections 2023-07-21T19:08:24.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:6833/2690918060,v1:172.21.15.145:6835/2690918060] conn(0x13aa400 0x1357c20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1092eb0 0x13a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1092ae0 0x135b640 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd7f1ffb700 0 client.4932 ms_handle_reset on v2:172.21.15.145:6833/2690918060 2023-07-21T19:08:24.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 --2- 172.21.15.123:0/3304486808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1092710 0x135a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 >> 172.21.15.123:0/3304486808 conn(0x12fcb60 msgr2=0x1334a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:24.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 shutdown_connections 2023-07-21T19:08:24.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 1 -- 172.21.15.123:0/3304486808 wait complete. 2023-07-21T19:08:24.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.547+0000 7fd81c5ba740 20 client.4932 trim_cache size 0 max 16384 2023-07-21T19:08:24.578 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:08:24.578 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "786ff8a7-6b4c-4933-876c-0b96df73a43e", 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4290, 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 36.098467253999999, 2023-07-21T19:08:24.579 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 9, 2023-07-21T19:08:24.580 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 28, 2023-07-21T19:08:24.580 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 28, 2023-07-21T19:08:24.580 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 42.018189413999998 2023-07-21T19:08:24.580 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:08:24.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd7f40662f0 msgr2=0x7fd7f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd7f40662f0 0x7fd7f40687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8140b3b40 tx=0x7fd7fc009040 comp rx=0 tx=0).stop 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 msgr2=0x7fd81415df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd81415df60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c500 tx=0x7fd80400c8c0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 shutdown_connections 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd7f40662f0 0x7fd7f40687a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd814160370 0x7fd8140c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd81415ffa0 0x7fd8140c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 --2- 172.21.15.123:0/1470196924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8140cb180 0x7fd81415df60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:24.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 >> 172.21.15.123:0/1470196924 conn(0x7fd81406e960 msgr2=0x7fd8140b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:24.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 shutdown_connections 2023-07-21T19:08:24.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:24.551+0000 7fd819333700 1 -- 172.21.15.123:0/1470196924 wait complete. 2023-07-21T19:08:24.585 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-21T19:08:24.596 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-21T19:08:24.597 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-21T19:08:24.597 INFO:tasks.ceph_fuse:client.0 config is {} 2023-07-21T19:08:24.597 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T19:08:24.597 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:24.597 INFO:tasks.ceph_fuse:client.2 config is {} 2023-07-21T19:08:24.598 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T19:08:24.598 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:24.598 INFO:tasks.ceph_fuse:client.1 config is {} 2023-07-21T19:08:24.598 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T19:08:24.598 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:24.599 INFO:tasks.ceph_fuse:client.3 config is {} 2023-07-21T19:08:24.599 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T19:08:24.599 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:24.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:24.599 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-07-21T19:08:24.621 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-21T19:08:24.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:24.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-21T19:08:24.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:24.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2023-07-21T19:08:24.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:24.924 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-07-21T19:08:24.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:24.943 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2023-07-21T19:08:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2023-07-21T19:08:25.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:08:25.033 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-21T19:08:25.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T19:08:25.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12be09f700 1 Processor -- start 2023-07-21T19:08:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12be09f700 1 -- start start 2023-07-21T19:08:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12be09f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b81599d0 0x7f12b8071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12be09f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80cde10 con 0x7f12b815ccf0 2023-07-21T19:08:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12be09f700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80cd520 con 0x7f12b80caa20 2023-07-21T19:08:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12be09f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b815d190 con 0x7f12b81599d0 2023-07-21T19:08:25.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12bd09d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b81599d0 0x7f12b8071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:25.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12bc89c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f12b815ccf0 0x7f12b80c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42590/0 (socket says 172.21.15.123:42590) 2023-07-21T19:08:25.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12bc89c700 1 -- 172.21.15.123:0/3244504951 learned_addr learned my addr 172.21.15.123:0/3244504951 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:25.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12affff700 1 -- 172.21.15.123:0/3244504951 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802453506 0 0) 0x7f12b80cde10 con 0x7f12b815ccf0 2023-07-21T19:08:25.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12affff700 1 -- 172.21.15.123:0/3244504951 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a40035d0 con 0x7f12b815ccf0 2023-07-21T19:08:25.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12bd09d700 1 -- 172.21.15.123:0/3244504951 >> v1:172.21.15.145:6789/0 conn(0x7f12b80caa20 legacy=0x7f12b80cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12bd09d700 1 -- 172.21.15.123:0/3244504951 >> v1:172.21.15.123:6789/0 conn(0x7f12b815ccf0 legacy=0x7f12b80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.191+0000 7f12bd09d700 1 -- 172.21.15.123:0/3244504951 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80715e0 con 0x7f12b81599d0 2023-07-21T19:08:25.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12bd09d700 1 --2- 172.21.15.123:0/3244504951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81599d0 0x7f12b8071000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009850 tx=0x7f12b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2cd00c876bdfe6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:25.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12affff700 1 -- 172.21.15.123:0/3244504951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011830 con 0x7f12b81599d0 2023-07-21T19:08:25.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12affff700 1 -- 172.21.15.123:0/3244504951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4011990 con 0x7f12b81599d0 2023-07-21T19:08:25.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12affff700 1 -- 172.21.15.123:0/3244504951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011d40 con 0x7f12b81599d0 2023-07-21T19:08:25.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 -- 172.21.15.123:0/3244504951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81599d0 msgr2=0x7f12b8071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 --2- 172.21.15.123:0/3244504951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81599d0 0x7f12b8071000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009850 tx=0x7f12b4009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:25.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 -- 172.21.15.123:0/3244504951 shutdown_connections 2023-07-21T19:08:25.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 --2- 172.21.15.123:0/3244504951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81599d0 0x7f12b8071000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 -- 172.21.15.123:0/3244504951 >> 172.21.15.123:0/3244504951 conn(0x7f12b806e960 msgr2=0x7f12b806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:25.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 -- 172.21.15.123:0/3244504951 shutdown_connections 2023-07-21T19:08:25.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.195+0000 7f12be09f700 1 -- 172.21.15.123:0/3244504951 wait complete. 2023-07-21T19:08:25.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 Processor -- start 2023-07-21T19:08:25.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 -- start start 2023-07-21T19:08:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b80caa20 0x7f12b815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b81599d0 0x7f12b815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 0x7f12b81f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b815f590 con 0x7f12b815ccf0 2023-07-21T19:08:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b815eca0 con 0x7f12b80caa20 2023-07-21T19:08:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b815ef40 con 0x7f12b81599d0 2023-07-21T19:08:25.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 0x7f12b81f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:25.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 0x7f12b81f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41206/0 (socket says 172.21.15.123:41206) 2023-07-21T19:08:25.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 -- 172.21.15.123:0/3833268626 learned_addr learned my addr 172.21.15.123:0/3833268626 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd09d700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b80caa20 0x7f12b815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bc89c700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b81599d0 0x7f12b815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 -- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b81599d0 msgr2=0x7f12b815fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b81599d0 0x7f12b815fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 -- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b80caa20 msgr2=0x7f12b815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b80caa20 0x7f12b815b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 -- 172.21.15.123:0/3833268626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40094b0 con 0x7f12b815ccf0 2023-07-21T19:08:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12bd89e700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 0x7f12b81f0a10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f12b000cc50 tx=0x7f12b000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000ad80 con 0x7f12b815ccf0 2023-07-21T19:08:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b815f220 con 0x7f12b815ccf0 2023-07-21T19:08:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b000ce50 con 0x7f12b815ccf0 2023-07-21T19:08:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.199+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0003c60 con 0x7f12b815ccf0 2023-07-21T19:08:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.203+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b815b5a0 con 0x7f12b815ccf0 2023-07-21T19:08:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.203+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b80ce280 con 0x7f12b815ccf0 2023-07-21T19:08:25.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.203+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12b00050d0 con 0x7f12b815ccf0 2023-07-21T19:08:25.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.207+0000 7f12adffb700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f129c0662f0 0x7f129c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:25.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.207+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12b00840c0 con 0x7f12b815ccf0 2023-07-21T19:08:25.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.207+0000 7f12bd09d700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f129c0662f0 0x7f129c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:25.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.207+0000 7f12bd09d700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f129c0662f0 0x7f129c0687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f12b40090b0 tx=0x7f12b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:25.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.211+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12b80ce280 con 0x7f12b815ccf0 2023-07-21T19:08:25.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.427+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12b80ce280 con 0x7f12b815ccf0 2023-07-21T19:08:25.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.427+0000 7f12adffb700 1 -- 172.21.15.123:0/3833268626 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f12b80ce280 con 0x7f12b815ccf0 2023-07-21T19:08:25.442 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T19:08:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f129c0662f0 msgr2=0x7f129c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f129c0662f0 0x7f129c0687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f12b40090b0 tx=0x7f12b4008030 comp rx=0 tx=0).stop 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 msgr2=0x7f12b81f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 0x7f12b81f0a10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f12b000cc50 tx=0x7f12b000a340 comp rx=0 tx=0).stop 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 shutdown_connections 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f129c0662f0 0x7f129c0687a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b815ccf0 0x7f12b81f0a10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b81599d0 0x7f12b815fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 --2- 172.21.15.123:0/3833268626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b80caa20 0x7f12b815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 >> 172.21.15.123:0/3833268626 conn(0x7f12b806e960 msgr2=0x7f12b80c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 shutdown_connections 2023-07-21T19:08:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:25.431+0000 7f12be09f700 1 -- 172.21.15.123:0/3833268626 wait complete. 2023-07-21T19:08:25.467 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T19:08:25.467 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T19:08:25.467 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2023-07-21T19:08:25.467 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T19:08:25.468 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:25.468 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T19:08:25.468 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T19:08:25.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T19:08:25.468 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T19:08:25.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.469 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2023-07-21T19:08:25.486 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:25.486 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:25.487 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T19:08:25.488 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42117sec preferred_lft 42117sec 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:a8:46:62:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T19:08:25.489 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:25.490 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T19:08:25.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.490 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:25.491 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:25.491 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2023-07-21T19:08:25.492 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2023-07-21T19:08:25.492 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2023-07-21T19:08:25.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T19:08:25.493 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:25.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.646 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T19:08:25.682 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-07-21T19:08:25.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.686 DEBUG:teuthology.orchestra.run.smithi123:> route 2023-07-21T19:08:25.754 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2023-07-21T19:08:25.754 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T19:08:25.754 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T19:08:25.754 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T19:08:25.754 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T19:08:25.754 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T19:08:25.755 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T19:08:25.755 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T19:08:25.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.755 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:25.756 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:25.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T19:08:25.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T19:08:25.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T19:08:25.757 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:25.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.893 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-07-21T19:08:25.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.909 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2023-07-21T19:08:25.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:25.970 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:25.970 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:25.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T19:08:25.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-21T19:08:25.971 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:26.083 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-21T19:08:26.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:26.084 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:26.084 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:26.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-21T19:08:26.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T19:08:26.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-21T19:08:26.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-21T19:08:26.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-21T19:08:26.086 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:26.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:26.221 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:26.221 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:26.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2023-07-21T19:08:26.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T19:08:26.222 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:26.282 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T19:08:26.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:26.283 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:26.298 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T19:08:26.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:26.299 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:26.358 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:08:26.443 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:26.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:26.518 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:26.519 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:26.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:26.520 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:08:26.581 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T19:08:26.581 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T19:08:26.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:08:26.665 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:26.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:26.746 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:26.749 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:26.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:26.750 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:08:26.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2023-07-21T19:08:26.759+0000 7f1a9a583640 -1 init, newargv = 0x5576b8d93d60 newargc=15 2023-07-21T19:08:26.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[43072]: starting ceph client 2023-07-21T19:08:26.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[43072]: starting fuse 2023-07-21T19:08:26.784 INFO:teuthology.orchestra.run.smithi123.stdout:48 2023-07-21T19:08:26.784 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2023-07-21T19:08:26.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T19:08:26.785 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2023-07-21T19:08:26.785 DEBUG:teuthology.orchestra.run.smithi123:> import re 2023-07-21T19:08:26.786 DEBUG:teuthology.orchestra.run.smithi123:> import os 2023-07-21T19:08:26.786 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2023-07-21T19:08:26.786 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:26.786 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2023-07-21T19:08:26.787 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T19:08:26.787 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2023-07-21T19:08:26.787 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T19:08:26.787 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:26.787 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2023-07-21T19:08:26.788 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2023-07-21T19:08:26.788 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2023-07-21T19:08:26.788 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2023-07-21T19:08:26.789 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:26.789 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2023-07-21T19:08:26.789 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T19:08:26.789 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T19:08:26.790 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T19:08:26.790 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2023-07-21T19:08:26.790 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2023-07-21T19:08:26.790 DEBUG:teuthology.orchestra.run.smithi123:> return f 2023-07-21T19:08:26.790 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T19:08:26.791 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:26.791 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2023-07-21T19:08:26.791 DEBUG:teuthology.orchestra.run.smithi123:> ' 2023-07-21T19:08:26.937 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.43072.asok 2023-07-21T19:08:27.123 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43072.asok 2023-07-21T19:08:27.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:27.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43072.asok status 2023-07-21T19:08:27.326 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:08:27.327 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2023-07-21T19:08:27.327 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "81cf785aa7781c4e08381c540f890cb9bc987ef9", 2023-07-21T19:08:27.327 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev)", 2023-07-21T19:08:27.327 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2023-07-21T19:08:27.327 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2023-07-21T19:08:27.327 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "43072", 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4947, 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2023-07-21T19:08:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4947 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:08:27.329 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3961621969 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3961621969 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:27.330 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4947 192.168.0.1:0/3961621969", 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/3961621969", 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 9, 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 28, 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2023-07-21T19:08:27.331 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2023-07-21T19:08:27.332 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:08:27.341 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T19:08:27.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 Processor -- start 2023-07-21T19:08:27.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 -- start start 2023-07-21T19:08:27.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 0x7fd8ac06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:27.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd8ac0b2580 0x7fd8ac0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0cd5e0 con 0x7fd8ac0cfe10 2023-07-21T19:08:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0d01e0 con 0x7fd8ac0b2580 2023-07-21T19:08:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.511+0000 7fd8b2082700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac15a1d0 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 0x7fd8ac06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8abfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd8ac0b2580 0x7fd8ac0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 0x7fd8ac06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46084/0 (socket says 172.21.15.123:46084) 2023-07-21T19:08:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 -- 172.21.15.123:0/1749187876 learned_addr learned my addr 172.21.15.123:0/1749187876 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 -- 172.21.15.123:0/1749187876 >> v2:172.21.15.145:3300/0 conn(0x7fd8ac0b2580 msgr2=0x7fd8ac0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 --2- 172.21.15.123:0/1749187876 >> v2:172.21.15.145:3300/0 conn(0x7fd8ac0b2580 0x7fd8ac0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 -- 172.21.15.123:0/1749187876 >> v1:172.21.15.145:6789/0 conn(0x7fd8ac0cfe10 legacy=0x7fd8ac0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 -- 172.21.15.123:0/1749187876 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0b6370 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8abfff700 1 --2- 172.21.15.123:0/1749187876 >> v2:172.21.15.145:3300/0 conn(0x7fd8ac0b2580 0x7fd8ac0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:27.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aaffd700 1 --2- 172.21.15.123:0/1749187876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 0x7fd8ac06c770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009910 tx=0x7fd8a0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d970efb3a632fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:27.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aa7fc700 1 -- 172.21.15.123:0/1749187876 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0011830 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aa7fc700 1 -- 172.21.15.123:0/1749187876 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0011990 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.515+0000 7fd8aa7fc700 1 -- 172.21.15.123:0/1749187876 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0011d40 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 -- 172.21.15.123:0/1749187876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 msgr2=0x7fd8ac06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 --2- 172.21.15.123:0/1749187876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 0x7fd8ac06c770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009910 tx=0x7fd8a0009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 -- 172.21.15.123:0/1749187876 shutdown_connections 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 --2- 172.21.15.123:0/1749187876 >> v2:172.21.15.145:3300/0 conn(0x7fd8ac0b2580 0x7fd8ac0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 --2- 172.21.15.123:0/1749187876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2a80 0x7fd8ac06c770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 -- 172.21.15.123:0/1749187876 >> 172.21.15.123:0/1749187876 conn(0x7fd8ac060320 msgr2=0x7fd8ac060720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:27.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 -- 172.21.15.123:0/1749187876 shutdown_connections 2023-07-21T19:08:27.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.519+0000 7fd8b2082700 1 -- 172.21.15.123:0/1749187876 wait complete. 2023-07-21T19:08:27.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 Processor -- start 2023-07-21T19:08:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 -- start start 2023-07-21T19:08:27.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2580 0x7fd8ac154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 0x7fd8ac14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8ac0cfe10 0x7fd8ac0c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0c8a40 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac1552b0 con 0x7fd8ac0cfe10 2023-07-21T19:08:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8b2082700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0c7dc0 con 0x7fd8ac0b2580 2023-07-21T19:08:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8aaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 0x7fd8ac14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8aaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 0x7fd8ac14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41216/0 (socket says 172.21.15.123:41216) 2023-07-21T19:08:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8aaffd700 1 -- 172.21.15.123:0/243557259 learned_addr learned my addr 172.21.15.123:0/243557259 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8ab7fe700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2580 0x7fd8ac154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8abfff700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8ac0cfe10 0x7fd8ac0c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8aaffd700 1 -- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2580 msgr2=0x7fd8ac154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:27.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8aaffd700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2580 0x7fd8ac154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.523+0000 7fd8aaffd700 1 -- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8ac0cfe10 msgr2=0x7fd8ac0c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:27.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd8aaffd700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8ac0cfe10 0x7fd8ac0c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd8aaffd700 1 -- 172.21.15.123:0/243557259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a4009a70 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd8aaffd700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 0x7fd8ac14e080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0013000 tx=0x7fd8a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:27.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0004590 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a001e070 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a0009570 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0003900 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac0c8380 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac0c8b80 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.527+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8a0003a60 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.531+0000 7fd893fff700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd8980662f0 0x7fd8980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:27.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.531+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8a0084fe0 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.531+0000 7fd8ab7fe700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd8980662f0 0x7fd8980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:27.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.531+0000 7fd8ab7fe700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd8980662f0 0x7fd8980687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd89c000f60 tx=0x7fd89c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:27.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.535+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd8ac0c8b80 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.751+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8ac0c8b80 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.755+0000 7fd893fff700 1 -- 172.21.15.123:0/243557259 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd8a0015070 con 0x7fd8ac0b2a80 2023-07-21T19:08:27.769 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T19:08:27.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd8980662f0 msgr2=0x7fd8980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:27.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd8980662f0 0x7fd8980687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd89c000f60 tx=0x7fd89c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:27.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 msgr2=0x7fd8ac14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:27.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 0x7fd8ac14e080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0013000 tx=0x7fd8a0004770 comp rx=0 tx=0).stop 2023-07-21T19:08:27.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 shutdown_connections 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd8980662f0 0x7fd8980687a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8ac0cfe10 0x7fd8ac0c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8ac0b2a80 0x7fd8ac14e080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 --2- 172.21.15.123:0/243557259 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd8ac0b2580 0x7fd8ac154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 >> 172.21.15.123:0/243557259 conn(0x7fd8ac060320 msgr2=0x7fd8ac0cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 shutdown_connections 2023-07-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:27.759+0000 7fd8b2082700 1 -- 172.21.15.123:0/243557259 wait complete. 2023-07-21T19:08:27.793 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T19:08:27.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T19:08:27.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2023-07-21T19:08:27.794 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-21T19:08:27.794 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:27.795 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T19:08:27.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T19:08:27.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T19:08:27.795 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-21T19:08:27.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:27.796 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2023-07-21T19:08:27.811 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:27.811 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:27.811 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:27.812 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.812 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:27.812 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.813 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:27.813 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:27.813 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2023-07-21T19:08:27.813 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2023-07-21T19:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T19:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T19:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42115sec preferred_lft 42115sec 2023-07-21T19:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2023-07-21T19:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T19:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:a8:46:62:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T19:08:27.818 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.818 INFO:teuthology.orchestra.run.smithi123.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:08:27.818 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:bd:ab:33:4d:9d brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:27.818 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T19:08:27.819 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.819 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc0:5ff:feb1:7f7e/64 scope link 2023-07-21T19:08:27.819 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.819 INFO:teuthology.orchestra.run.smithi123.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T19:08:27.819 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:bd:ab:33:4d:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T19:08:27.820 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcbd:abff:fe33:4d9d/64 scope link 2023-07-21T19:08:27.820 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:27.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:27.822 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T19:08:27.898 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-07-21T19:08:27.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:27.901 DEBUG:teuthology.orchestra.run.smithi123:> route 2023-07-21T19:08:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2023-07-21T19:08:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T19:08:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T19:08:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T19:08:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T19:08:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T19:08:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T19:08:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T19:08:27.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:27.968 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:27.969 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:27.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T19:08:27.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T19:08:27.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T19:08:27.971 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:28.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.099 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-07-21T19:08:28.117 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T19:08:28.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.119 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2023-07-21T19:08:28.177 INFO:teuthology.orchestra.run.smithi123.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-21T19:08:28.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.178 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:28.179 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:28.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T19:08:28.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-21T19:08:28.179 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:28.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-21T19:08:28.328 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:28.329 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:28.329 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:28.330 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.330 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:28.330 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.331 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:08:28.331 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 26:10:03:a1:d9:d7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T19:08:28.331 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T19:08:28.331 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.332 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::2410:3ff:fea1:d9d7/64 scope link 2023-07-21T19:08:28.332 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.334 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-21T19:08:28.411 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:28.412 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:28.412 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:28.412 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.412 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:28.412 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.412 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:08:28.413 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 26:10:03:a1:d9:d7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T19:08:28.413 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T19:08:28.413 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.413 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::2410:3ff:fea1:d9d7/64 scope link 2023-07-21T19:08:28.413 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:28.416 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-21T19:08:28.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.417 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:28.418 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:28.418 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-21T19:08:28.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-21T19:08:28.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-21T19:08:28.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-21T19:08:28.420 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-21T19:08:28.420 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:28.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.611 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:08:28.612 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:08:28.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.1 up 2023-07-21T19:08:28.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.1 master ceph-brx 2023-07-21T19:08:28.612 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:08:28.685 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-07-21T19:08:28.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:28.685 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:28.700 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-21T19:08:28.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:28.701 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:28.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:08:28.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:28.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:28.914 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:28.917 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:28.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:28.918 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:08:28.976 INFO:teuthology.orchestra.run.smithi123.stdout:48 2023-07-21T19:08:28.976 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [48] 2023-07-21T19:08:28.977 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-07-21T19:08:29.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:08:29.058 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:29.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:29.138 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:29.140 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:29.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:29.141 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:08:29.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi123.stderr:2023-07-21T19:08:29.151+0000 7f2abca88640 -1 init, newargv = 0x5654ad5ce030 newargc=15 2023-07-21T19:08:29.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi123.stderr:ceph-fuse[43208]: starting ceph client 2023-07-21T19:08:29.178 INFO:teuthology.orchestra.run.smithi123.stdout:48 2023-07-21T19:08:29.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi123.stderr:ceph-fuse[43208]: starting fuse 2023-07-21T19:08:30.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:08:30.318 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:30.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:30.391 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:30.393 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:30.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:30.394 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:08:30.456 INFO:teuthology.orchestra.run.smithi123.stdout:48 2023-07-21T19:08:30.456 INFO:teuthology.orchestra.run.smithi123.stdout:49 2023-07-21T19:08:30.457 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48, 49] 2023-07-21T19:08:30.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T19:08:30.458 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2023-07-21T19:08:30.459 DEBUG:teuthology.orchestra.run.smithi123:> import re 2023-07-21T19:08:30.459 DEBUG:teuthology.orchestra.run.smithi123:> import os 2023-07-21T19:08:30.460 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2023-07-21T19:08:30.460 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:30.461 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2023-07-21T19:08:30.462 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-07-21T19:08:30.462 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2023-07-21T19:08:30.463 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-07-21T19:08:30.464 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:30.465 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2023-07-21T19:08:30.466 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2023-07-21T19:08:30.466 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2023-07-21T19:08:30.466 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2023-07-21T19:08:30.466 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:30.467 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2023-07-21T19:08:30.467 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T19:08:30.467 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T19:08:30.467 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T19:08:30.468 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2023-07-21T19:08:30.468 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2023-07-21T19:08:30.468 DEBUG:teuthology.orchestra.run.smithi123:> return f 2023-07-21T19:08:30.468 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T19:08:30.469 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:08:30.469 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.2")) 2023-07-21T19:08:30.469 DEBUG:teuthology.orchestra.run.smithi123:> ' 2023-07-21T19:08:30.621 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.2.43208.asok 2023-07-21T19:08:30.804 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.43208.asok 2023-07-21T19:08:30.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:30.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.43208.asok status 2023-07-21T19:08:31.003 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:08:31.003 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2023-07-21T19:08:31.003 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "81cf785aa7781c4e08381c540f890cb9bc987ef9", 2023-07-21T19:08:31.003 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev)", 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "2", 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "43208", 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:31.004 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4956, 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4956 2023-07-21T19:08:31.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:31.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:08:31.006 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:08:31.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.2:0", 2023-07-21T19:08:31.006 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2357969725 2023-07-21T19:08:31.008 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:08:31.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:31.008 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:08:31.009 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:08:31.009 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.2:0", 2023-07-21T19:08:31.009 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2357969725 2023-07-21T19:08:31.009 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:08:31.009 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4956 192.168.0.2:0/2357969725", 2023-07-21T19:08:31.009 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.2:0/2357969725", 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 9, 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 29, 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2023-07-21T19:08:31.010 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:08:31.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T19:08:31.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd506108700 1 Processor -- start 2023-07-21T19:08:31.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd506108700 1 -- start start 2023-07-21T19:08:31.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd506108700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd50006d860 0x7fd5000cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:31.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd506108700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5000cc1b0 con 0x7fd50006be70 2023-07-21T19:08:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd506108700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5000cd690 con 0x7fd5000c1e00 2023-07-21T19:08:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd506108700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5000cd970 con 0x7fd50006d860 2023-07-21T19:08:31.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd4feffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd50006be70 0x7fd50006dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42604/0 (socket says 172.21.15.123:42604) 2023-07-21T19:08:31.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd4feffd700 1 -- 172.21.15.123:0/712592614 learned_addr learned my addr 172.21.15.123:0/712592614 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:31.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd4ff7fe700 1 --2- 172.21.15.123:0/712592614 >> v2:172.21.15.145:3300/0 conn(0x7fd50006d860 0x7fd5000cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:31.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd4fe7fc700 1 -- 172.21.15.123:0/712592614 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997145144 0 0) 0x7fd5000cc1b0 con 0x7fd50006be70 2023-07-21T19:08:31.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.179+0000 7fd4fe7fc700 1 -- 172.21.15.123:0/712592614 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e80035d0 con 0x7fd50006be70 2023-07-21T19:08:31.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4ff7fe700 1 -- 172.21.15.123:0/712592614 >> v1:172.21.15.145:6789/0 conn(0x7fd5000c1e00 legacy=0x7fd5000cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4ff7fe700 1 -- 172.21.15.123:0/712592614 >> v1:172.21.15.123:6789/0 conn(0x7fd50006be70 legacy=0x7fd50006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4ff7fe700 1 -- 172.21.15.123:0/712592614 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5000cdc50 con 0x7fd50006d860 2023-07-21T19:08:31.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4ff7fe700 1 --2- 172.21.15.123:0/712592614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006d860 0x7fd5000cb840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009850 tx=0x7fd4f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83738ae71f7cae27 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:31.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4fe7fc700 1 -- 172.21.15.123:0/712592614 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0011830 con 0x7fd50006d860 2023-07-21T19:08:31.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4fe7fc700 1 -- 172.21.15.123:0/712592614 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f0011990 con 0x7fd50006d860 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd4fe7fc700 1 -- 172.21.15.123:0/712592614 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0011d40 con 0x7fd50006d860 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 -- 172.21.15.123:0/712592614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006d860 msgr2=0x7fd5000cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 --2- 172.21.15.123:0/712592614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006d860 0x7fd5000cb840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009850 tx=0x7fd4f0009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 -- 172.21.15.123:0/712592614 shutdown_connections 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 --2- 172.21.15.123:0/712592614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006d860 0x7fd5000cb840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 -- 172.21.15.123:0/712592614 >> 172.21.15.123:0/712592614 conn(0x7fd5000cad30 msgr2=0x7fd5000cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:31.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 -- 172.21.15.123:0/712592614 shutdown_connections 2023-07-21T19:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.183+0000 7fd506108700 1 -- 172.21.15.123:0/712592614 wait complete. 2023-07-21T19:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 Processor -- start 2023-07-21T19:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 -- start start 2023-07-21T19:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006be70 0x7fd500155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd50006d860 0x7fd500147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 0x7fd5000c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5001f5f70 con 0x7fd5000c1e00 2023-07-21T19:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000acb50 con 0x7fd50006be70 2023-07-21T19:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd506108700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000ace30 con 0x7fd50006d860 2023-07-21T19:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 0x7fd5000c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 0x7fd5000c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41226/0 (socket says 172.21.15.123:41226) 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 -- 172.21.15.123:0/250818438 learned_addr learned my addr 172.21.15.123:0/250818438 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4feffd700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd50006d860 0x7fd500147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4ff7fe700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006be70 0x7fd500155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 -- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd50006d860 msgr2=0x7fd500147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd50006d860 0x7fd500147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 -- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006be70 msgr2=0x7fd500155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006be70 0x7fd500155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4fffff700 1 -- 172.21.15.123:0/250818438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f00094b0 con 0x7fd5000c1e00 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.187+0000 7fd4feffd700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd50006d860 0x7fd500147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd4fffff700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 0x7fd5000c3760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800cb50 tx=0x7fd4f800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8003c20 con 0x7fd5000c1e00 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd500154380 con 0x7fd5000c1e00 2023-07-21T19:08:31.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8003d80 con 0x7fd5000c1e00 2023-07-21T19:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f800aac0 con 0x7fd5000c1e00 2023-07-21T19:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd500151e10 con 0x7fd5000c1e00 2023-07-21T19:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.191+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5001541e0 con 0x7fd5000c1e00 2023-07-21T19:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.195+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4f800ac20 con 0x7fd5000c1e00 2023-07-21T19:08:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.195+0000 7fd4e7fff700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd4ec0662f0 0x7fd4ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:31.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.195+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd4f8083f70 con 0x7fd5000c1e00 2023-07-21T19:08:31.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.195+0000 7fd4ff7fe700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd4ec0662f0 0x7fd4ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.195+0000 7fd4ff7fe700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd4ec0662f0 0x7fd4ec0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00090b0 tx=0x7fd4f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:31.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.203+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd4f80b4720 con 0x7fd5000c1e00 2023-07-21T19:08:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.407+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd50004dcb0 con 0x7fd5000c1e00 2023-07-21T19:08:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.407+0000 7fd4e7fff700 1 -- 172.21.15.123:0/250818438 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd5001541e0 con 0x7fd5000c1e00 2023-07-21T19:08:31.422 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T19:08:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd4ec0662f0 msgr2=0x7fd4ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd4ec0662f0 0x7fd4ec0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00090b0 tx=0x7fd4f0008030 comp rx=0 tx=0).stop 2023-07-21T19:08:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 msgr2=0x7fd5000c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 0x7fd5000c3760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800cb50 tx=0x7fd4f800ce60 comp rx=0 tx=0).stop 2023-07-21T19:08:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 shutdown_connections 2023-07-21T19:08:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd4ec0662f0 0x7fd4ec0687a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5000c1e00 0x7fd5000c3760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd50006d860 0x7fd500147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 --2- 172.21.15.123:0/250818438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd50006be70 0x7fd500155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 >> 172.21.15.123:0/250818438 conn(0x7fd5000cad30 msgr2=0x7fd500158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 shutdown_connections 2023-07-21T19:08:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:31.411+0000 7fd506108700 1 -- 172.21.15.123:0/250818438 wait complete. 2023-07-21T19:08:31.445 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T19:08:31.445 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T19:08:31.445 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2023-07-21T19:08:31.446 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T19:08:31.446 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:31.446 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T19:08:31.446 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T19:08:31.446 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T19:08:31.447 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T19:08:31.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.447 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2023-07-21T19:08:31.468 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:31.468 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:31.468 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:31.469 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:31.469 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:31.469 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2023-07-21T19:08:31.470 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42209sec preferred_lft 42209sec 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2023-07-21T19:08:31.471 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:31.472 INFO:teuthology.orchestra.run.smithi145.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T19:08:31.472 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 02:42:3a:7d:06:1b brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:31.472 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T19:08:31.472 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:31.473 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T19:08:31.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.474 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:31.474 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:31.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add name ceph-brx type bridge 2023-07-21T19:08:31.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr flush dev ceph-brx 2023-07-21T19:08:31.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set ceph-brx up 2023-07-21T19:08:31.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T19:08:31.475 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:31.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.621 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T19:08:31.655 INFO:teuthology.orchestra.run.smithi145.stdout:1 2023-07-21T19:08:31.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.659 DEBUG:teuthology.orchestra.run.smithi145:> route 2023-07-21T19:08:31.749 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2023-07-21T19:08:31.750 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T19:08:31.750 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T19:08:31.750 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T19:08:31.750 INFO:teuthology.orchestra.run.smithi145.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T19:08:31.750 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T19:08:31.751 INFO:teuthology.orchestra.run.smithi145.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T19:08:31.751 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T19:08:31.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.752 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:31.752 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:31.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T19:08:31.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T19:08:31.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T19:08:31.753 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:31.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.881 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-07-21T19:08:31.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.899 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2023-07-21T19:08:31.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:31.958 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:31.959 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:31.959 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T19:08:31.959 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-21T19:08:31.960 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:32.066 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-21T19:08:32.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:32.067 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:32.067 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:32.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-21T19:08:32.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T19:08:32.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-21T19:08:32.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-21T19:08:32.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-21T19:08:32.069 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:32.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:32.246 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:32.246 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:32.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.0 up 2023-07-21T19:08:32.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T19:08:32.247 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:32.317 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-21T19:08:32.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:32.318 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:32.334 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T19:08:32.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:32.335 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:32.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2023-07-21T19:08:32.476 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:32.476 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:32.553 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:32.555 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:32.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:32.557 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2023-07-21T19:08:32.615 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T19:08:32.616 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-21T19:08:32.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2023-07-21T19:08:32.697 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:32.698 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:32.769 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:32.771 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:32.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:32.772 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2023-07-21T19:08:32.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:2023-07-21T19:08:32.785+0000 7fdec37b3640 -1 init, newargv = 0x555bc04ef250 newargc=15 2023-07-21T19:08:32.802 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:ceph-fuse[40286]: starting ceph client 2023-07-21T19:08:32.813 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:ceph-fuse[40286]: starting fuse 2023-07-21T19:08:32.814 INFO:teuthology.orchestra.run.smithi145.stdout:49 2023-07-21T19:08:32.815 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-21T19:08:32.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T19:08:32.816 DEBUG:teuthology.orchestra.run.smithi145:> import glob 2023-07-21T19:08:32.816 DEBUG:teuthology.orchestra.run.smithi145:> import re 2023-07-21T19:08:32.816 DEBUG:teuthology.orchestra.run.smithi145:> import os 2023-07-21T19:08:32.816 DEBUG:teuthology.orchestra.run.smithi145:> import subprocess 2023-07-21T19:08:32.817 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:32.817 DEBUG:teuthology.orchestra.run.smithi145:> def _find_admin_socket(client_name): 2023-07-21T19:08:32.817 DEBUG:teuthology.orchestra.run.smithi145:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-21T19:08:32.817 DEBUG:teuthology.orchestra.run.smithi145:> files = glob.glob(asok_path) 2023-07-21T19:08:32.818 DEBUG:teuthology.orchestra.run.smithi145:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-21T19:08:32.818 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:32.818 DEBUG:teuthology.orchestra.run.smithi145:> # Given a non-glob path, it better be there 2023-07-21T19:08:32.818 DEBUG:teuthology.orchestra.run.smithi145:> if "*" not in asok_path: 2023-07-21T19:08:32.818 DEBUG:teuthology.orchestra.run.smithi145:> assert(len(files) == 1) 2023-07-21T19:08:32.819 DEBUG:teuthology.orchestra.run.smithi145:> return files[0] 2023-07-21T19:08:32.819 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:32.819 DEBUG:teuthology.orchestra.run.smithi145:> for f in files: 2023-07-21T19:08:32.819 DEBUG:teuthology.orchestra.run.smithi145:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T19:08:32.820 DEBUG:teuthology.orchestra.run.smithi145:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T19:08:32.820 DEBUG:teuthology.orchestra.run.smithi145:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T19:08:32.820 DEBUG:teuthology.orchestra.run.smithi145:> contents = proc_f.read() 2023-07-21T19:08:32.820 DEBUG:teuthology.orchestra.run.smithi145:> if mountpoint in contents: 2023-07-21T19:08:32.820 DEBUG:teuthology.orchestra.run.smithi145:> return f 2023-07-21T19:08:32.821 DEBUG:teuthology.orchestra.run.smithi145:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T19:08:32.821 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:32.821 DEBUG:teuthology.orchestra.run.smithi145:> print(_find_admin_socket("client.1")) 2023-07-21T19:08:32.821 DEBUG:teuthology.orchestra.run.smithi145:> ' 2023-07-21T19:08:32.975 INFO:teuthology.orchestra.run.smithi145.stdout:/var/run/ceph/ceph-client.1.40286.asok 2023-07-21T19:08:33.162 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.40286.asok 2023-07-21T19:08:33.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:33.163 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.40286.asok status 2023-07-21T19:08:33.352 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2023-07-21T19:08:33.352 INFO:teuthology.orchestra.run.smithi145.stdout: "metadata": { 2023-07-21T19:08:33.352 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_sha1": "81cf785aa7781c4e08381c540f890cb9bc987ef9", 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev)", 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: "entity_id": "1", 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: "hostname": "smithi145", 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: "pid": "40286", 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: "root": "/" 2023-07-21T19:08:33.353 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:33.354 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_count": 0, 2023-07-21T19:08:33.354 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_pinned_count": 0, 2023-07-21T19:08:33.354 INFO:teuthology.orchestra.run.smithi145.stdout: "id": 4751, 2023-07-21T19:08:33.354 INFO:teuthology.orchestra.run.smithi145.stdout: "inst": { 2023-07-21T19:08:33.354 INFO:teuthology.orchestra.run.smithi145.stdout: "name": { 2023-07-21T19:08:33.355 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "client", 2023-07-21T19:08:33.355 INFO:teuthology.orchestra.run.smithi145.stdout: "num": 4751 2023-07-21T19:08:33.355 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:33.355 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2023-07-21T19:08:33.355 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 227020568 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: } 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2023-07-21T19:08:33.356 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 227020568 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: "inst_str": "client.4751 192.168.0.1:0/227020568", 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: "addr_str": "192.168.0.1:0/227020568", 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: "inode_count": 1, 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_epoch": 9, 2023-07-21T19:08:33.357 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch": 31, 2023-07-21T19:08:33.358 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch_barrier": 0, 2023-07-21T19:08:33.358 INFO:teuthology.orchestra.run.smithi145.stdout: "blocklisted": false, 2023-07-21T19:08:33.358 INFO:teuthology.orchestra.run.smithi145.stdout: "fs_name": "cephfs" 2023-07-21T19:08:33.358 INFO:teuthology.orchestra.run.smithi145.stdout:} 2023-07-21T19:08:33.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T19:08:33.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 Processor -- start 2023-07-21T19:08:33.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 -- start start 2023-07-21T19:08:33.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3e4159c30 0x7fb3e406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:33.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb3e40ce6b0 0x7fb3e406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:33.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e40cb680 con 0x7fb3e406d250 2023-07-21T19:08:33.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e406a1c0 con 0x7fb3e4159c30 2023-07-21T19:08:33.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e8f8b700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e406b000 con 0x7fb3e40ce6b0 2023-07-21T19:08:33.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3e4159c30 0x7fb3e406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:33.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3e4159c30 0x7fb3e406e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35502/0 (socket says 172.21.15.123:35502) 2023-07-21T19:08:33.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e37fe700 1 -- 172.21.15.123:0/2605758357 learned_addr learned my addr 172.21.15.123:0/2605758357 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:33.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.535+0000 7fb3e3fff700 1 --2- 172.21.15.123:0/2605758357 >> v2:172.21.15.145:3300/0 conn(0x7fb3e40ce6b0 0x7fb3e406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:33.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e37fe700 1 -- 172.21.15.123:0/2605758357 >> v2:172.21.15.145:3300/0 conn(0x7fb3e40ce6b0 msgr2=0x7fb3e406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:33.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e37fe700 1 --2- 172.21.15.123:0/2605758357 >> v2:172.21.15.145:3300/0 conn(0x7fb3e40ce6b0 0x7fb3e406eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e37fe700 1 -- 172.21.15.123:0/2605758357 >> v1:172.21.15.145:6789/0 conn(0x7fb3e406d250 legacy=0x7fb3e415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:33.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e37fe700 1 -- 172.21.15.123:0/2605758357 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e406a460 con 0x7fb3e4159c30 2023-07-21T19:08:33.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e37fe700 1 --2- 172.21.15.123:0/2605758357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e406e960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb3e406cd80 tx=0x7fb3d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b87701f4387ec17 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:33.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e27fc700 1 -- 172.21.15.123:0/2605758357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400b8a0 con 0x7fb3e4159c30 2023-07-21T19:08:33.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e27fc700 1 -- 172.21.15.123:0/2605758357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400ba00 con 0x7fb3e4159c30 2023-07-21T19:08:33.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e27fc700 1 -- 172.21.15.123:0/2605758357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400bd90 con 0x7fb3e4159c30 2023-07-21T19:08:33.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2605758357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 msgr2=0x7fb3e406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:33.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2605758357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e406e960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb3e406cd80 tx=0x7fb3d4009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2605758357 shutdown_connections 2023-07-21T19:08:33.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2605758357 >> v2:172.21.15.145:3300/0 conn(0x7fb3e40ce6b0 0x7fb3e406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2605758357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e406e960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2605758357 >> 172.21.15.123:0/2605758357 conn(0x7fb3e406fa70 msgr2=0x7fb3e406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:33.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2605758357 shutdown_connections 2023-07-21T19:08:33.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.539+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2605758357 wait complete. 2023-07-21T19:08:33.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 Processor -- start 2023-07-21T19:08:33.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 -- start start 2023-07-21T19:08:33.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3e406d250 0x7fb3e41f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:33.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3e40ce6b0 0x7fb3e413c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:33.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e41f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:33.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e413c4e0 con 0x7fb3e4159c30 2023-07-21T19:08:33.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40b07f0 con 0x7fb3e406d250 2023-07-21T19:08:33.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e8f8b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e413f080 con 0x7fb3e40ce6b0 2023-07-21T19:08:33.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e41f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:33.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e41f0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35508/0 (socket says 172.21.15.123:35508) 2023-07-21T19:08:33.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 -- 172.21.15.123:0/2845224504 learned_addr learned my addr 172.21.15.123:0/2845224504 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:33.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e37fe700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3e406d250 0x7fb3e41f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:33.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e2ffd700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3e40ce6b0 0x7fb3e413c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 -- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3e40ce6b0 msgr2=0x7fb3e413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3e40ce6b0 0x7fb3e413c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 -- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3e406d250 msgr2=0x7fb3e41f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3e406d250 0x7fb3e41f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.543+0000 7fb3e3fff700 1 -- 172.21.15.123:0/2845224504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009570 con 0x7fb3e4159c30 2023-07-21T19:08:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3e3fff700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e41f0ba0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc007e60 tx=0x7fb3dc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:33.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00ed30 con 0x7fb3e4159c30 2023-07-21T19:08:33.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc014420 con 0x7fb3e4159c30 2023-07-21T19:08:33.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e413f360 con 0x7fb3e4159c30 2023-07-21T19:08:33.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0147d0 con 0x7fb3e4159c30 2023-07-21T19:08:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e40b0a90 con 0x7fb3e4159c30 2023-07-21T19:08:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e40b0c80 con 0x7fb3e4159c30 2023-07-21T19:08:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.547+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb3dc014930 con 0x7fb3e4159c30 2023-07-21T19:08:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.551+0000 7fb3cbfff700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3d00662f0 0x7fb3d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.551+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb3dc084670 con 0x7fb3e4159c30 2023-07-21T19:08:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.551+0000 7fb3e37fe700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3d00662f0 0x7fb3d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:33.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.551+0000 7fb3e37fe700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3d00662f0 0x7fb3d00687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000c00 tx=0x7fb3d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:33.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.555+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb3dc0517c0 con 0x7fb3e4159c30 2023-07-21T19:08:33.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.763+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3e404e500 con 0x7fb3e4159c30 2023-07-21T19:08:33.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3cbfff700 1 -- 172.21.15.123:0/2845224504 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb3dc054de0 con 0x7fb3e4159c30 2023-07-21T19:08:33.780 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-21T19:08:33.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3d00662f0 msgr2=0x7fb3d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:33.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3d00662f0 0x7fb3d00687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000c00 tx=0x7fb3d4008030 comp rx=0 tx=0).stop 2023-07-21T19:08:33.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 msgr2=0x7fb3e41f0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:33.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e41f0ba0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc007e60 tx=0x7fb3dc00e3c0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 shutdown_connections 2023-07-21T19:08:33.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb3d00662f0 0x7fb3d00687a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e4159c30 0x7fb3e41f0ba0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3e40ce6b0 0x7fb3e413c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 --2- 172.21.15.123:0/2845224504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3e406d250 0x7fb3e41f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:33.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.767+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 >> 172.21.15.123:0/2845224504 conn(0x7fb3e406fa70 msgr2=0x7fb3e4155670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:33.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.771+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 shutdown_connections 2023-07-21T19:08:33.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:33.771+0000 7fb3e8f8b700 1 -- 172.21.15.123:0/2845224504 wait complete. 2023-07-21T19:08:33.802 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T19:08:33.803 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T19:08:33.803 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2023-07-21T19:08:33.803 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-21T19:08:33.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:33.804 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T19:08:33.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T19:08:33.804 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T19:08:33.805 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-21T19:08:33.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:33.805 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2023-07-21T19:08:33.824 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:33.824 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:33.825 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:33.825 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.825 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:33.826 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.826 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:33.826 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:33.827 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2023-07-21T19:08:33.827 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:33.827 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:33.828 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2023-07-21T19:08:33.828 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:08:33.828 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:33.829 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T19:08:33.829 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:33.829 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T19:08:33.829 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-07-21T19:08:33.830 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2023-07-21T19:08:33.830 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.830 INFO:teuthology.orchestra.run.smithi145.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T19:08:33.831 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 02:42:3a:7d:06:1b brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:33.831 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T19:08:33.831 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.831 INFO:teuthology.orchestra.run.smithi145.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:08:33.832 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether ce:34:99:d3:5a:79 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:08:33.832 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T19:08:33.833 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.833 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::6860:dcff:fe7e:c289/64 scope link 2023-07-21T19:08:33.833 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.833 INFO:teuthology.orchestra.run.smithi145.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T19:08:33.834 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether ce:34:99:d3:5a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T19:08:33.834 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::cc34:99ff:fed3:5a79/64 scope link 2023-07-21T19:08:33.834 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:33.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:33.836 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T19:08:33.918 INFO:teuthology.orchestra.run.smithi145.stdout:1 2023-07-21T19:08:33.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:33.921 DEBUG:teuthology.orchestra.run.smithi145:> route 2023-07-21T19:08:33.981 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2023-07-21T19:08:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T19:08:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T19:08:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T19:08:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T19:08:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T19:08:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T19:08:33.983 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T19:08:33.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:33.983 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:33.983 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:33.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T19:08:33.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T19:08:33.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T19:08:33.984 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:34.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.121 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-07-21T19:08:34.136 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T19:08:34.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.138 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2023-07-21T19:08:34.201 INFO:teuthology.orchestra.run.smithi145.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-21T19:08:34.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.202 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:34.202 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:34.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-21T19:08:34.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-21T19:08:34.203 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:34.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.316 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-21T19:08:34.348 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:34.349 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:34.349 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:34.349 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.349 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:34.349 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.349 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:08:34.350 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 9a:26:5a:73:29:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T19:08:34.350 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T19:08:34.350 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.350 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::9826:5aff:fe73:2975/64 scope link 2023-07-21T19:08:34.350 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-21T19:08:34.429 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:08:34.430 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 9a:26:5a:73:29:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T19:08:34.431 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T19:08:34.431 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.431 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::9826:5aff:fe73:2975/64 scope link 2023-07-21T19:08:34.431 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:08:34.433 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-21T19:08:34.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.434 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:34.434 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:34.434 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-21T19:08:34.434 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-21T19:08:34.434 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-21T19:08:34.435 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-21T19:08:34.435 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-21T19:08:34.435 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:34.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.624 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-07-21T19:08:34.624 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-07-21T19:08:34.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.1 up 2023-07-21T19:08:34.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.1 master ceph-brx 2023-07-21T19:08:34.625 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-07-21T19:08:34.691 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-07-21T19:08:34.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:34.691 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:34.709 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-21T19:08:34.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:08:34.710 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:34.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2023-07-21T19:08:34.843 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:34.844 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:34.918 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:34.920 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:34.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:34.921 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2023-07-21T19:08:34.981 INFO:teuthology.orchestra.run.smithi145.stdout:49 2023-07-21T19:08:34.982 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-07-21T19:08:34.982 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-07-21T19:08:35.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2023-07-21T19:08:35.066 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:08:35.067 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:08:35.136 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:08:35.137 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:08:35.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.139 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2023-07-21T19:08:35.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:2023-07-21T19:08:35.161+0000 7f33117b5640 -1 init, newargv = 0x557771b5f590 newargc=15 2023-07-21T19:08:35.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:ceph-fuse[40395]: starting ceph client 2023-07-21T19:08:35.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:ceph-fuse[40395]: starting fuse 2023-07-21T19:08:35.191 INFO:teuthology.orchestra.run.smithi145.stdout:49 2023-07-21T19:08:35.192 INFO:teuthology.orchestra.run.smithi145.stdout:50 2023-07-21T19:08:35.192 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-07-21T19:08:35.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T19:08:35.193 DEBUG:teuthology.orchestra.run.smithi145:> import glob 2023-07-21T19:08:35.193 DEBUG:teuthology.orchestra.run.smithi145:> import re 2023-07-21T19:08:35.193 DEBUG:teuthology.orchestra.run.smithi145:> import os 2023-07-21T19:08:35.193 DEBUG:teuthology.orchestra.run.smithi145:> import subprocess 2023-07-21T19:08:35.194 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:35.194 DEBUG:teuthology.orchestra.run.smithi145:> def _find_admin_socket(client_name): 2023-07-21T19:08:35.194 DEBUG:teuthology.orchestra.run.smithi145:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-07-21T19:08:35.194 DEBUG:teuthology.orchestra.run.smithi145:> files = glob.glob(asok_path) 2023-07-21T19:08:35.195 DEBUG:teuthology.orchestra.run.smithi145:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-07-21T19:08:35.195 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:35.195 DEBUG:teuthology.orchestra.run.smithi145:> # Given a non-glob path, it better be there 2023-07-21T19:08:35.195 DEBUG:teuthology.orchestra.run.smithi145:> if "*" not in asok_path: 2023-07-21T19:08:35.196 DEBUG:teuthology.orchestra.run.smithi145:> assert(len(files) == 1) 2023-07-21T19:08:35.196 DEBUG:teuthology.orchestra.run.smithi145:> return files[0] 2023-07-21T19:08:35.196 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:35.197 DEBUG:teuthology.orchestra.run.smithi145:> for f in files: 2023-07-21T19:08:35.197 DEBUG:teuthology.orchestra.run.smithi145:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T19:08:35.197 DEBUG:teuthology.orchestra.run.smithi145:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T19:08:35.197 DEBUG:teuthology.orchestra.run.smithi145:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T19:08:35.198 DEBUG:teuthology.orchestra.run.smithi145:> contents = proc_f.read() 2023-07-21T19:08:35.198 DEBUG:teuthology.orchestra.run.smithi145:> if mountpoint in contents: 2023-07-21T19:08:35.198 DEBUG:teuthology.orchestra.run.smithi145:> return f 2023-07-21T19:08:35.198 DEBUG:teuthology.orchestra.run.smithi145:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T19:08:35.199 DEBUG:teuthology.orchestra.run.smithi145:> 2023-07-21T19:08:35.199 DEBUG:teuthology.orchestra.run.smithi145:> print(_find_admin_socket("client.3")) 2023-07-21T19:08:35.199 DEBUG:teuthology.orchestra.run.smithi145:> ' 2023-07-21T19:08:35.349 INFO:teuthology.orchestra.run.smithi145.stdout:/var/run/ceph/ceph-client.3.40395.asok 2023-07-21T19:08:35.534 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.40395.asok 2023-07-21T19:08:35.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.40395.asok status 2023-07-21T19:08:35.733 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2023-07-21T19:08:35.733 INFO:teuthology.orchestra.run.smithi145.stdout: "metadata": { 2023-07-21T19:08:35.733 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_sha1": "81cf785aa7781c4e08381c540f890cb9bc987ef9", 2023-07-21T19:08:35.733 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev)", 2023-07-21T19:08:35.733 INFO:teuthology.orchestra.run.smithi145.stdout: "entity_id": "3", 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: "hostname": "smithi145", 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: "pid": "40395", 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: "root": "/" 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_count": 0, 2023-07-21T19:08:35.734 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_pinned_count": 0, 2023-07-21T19:08:35.735 INFO:teuthology.orchestra.run.smithi145.stdout: "id": 4760, 2023-07-21T19:08:35.735 INFO:teuthology.orchestra.run.smithi145.stdout: "inst": { 2023-07-21T19:08:35.735 INFO:teuthology.orchestra.run.smithi145.stdout: "name": { 2023-07-21T19:08:35.735 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "client", 2023-07-21T19:08:35.735 INFO:teuthology.orchestra.run.smithi145.stdout: "num": 4760 2023-07-21T19:08:35.735 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:35.736 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2023-07-21T19:08:35.736 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2023-07-21T19:08:35.736 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.2:0", 2023-07-21T19:08:35.736 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 1983715690 2023-07-21T19:08:35.736 INFO:teuthology.orchestra.run.smithi145.stdout: } 2023-07-21T19:08:35.736 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:35.737 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2023-07-21T19:08:35.737 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2023-07-21T19:08:35.737 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.2:0", 2023-07-21T19:08:35.737 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 1983715690 2023-07-21T19:08:35.737 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2023-07-21T19:08:35.737 INFO:teuthology.orchestra.run.smithi145.stdout: "inst_str": "client.4760 192.168.0.2:0/1983715690", 2023-07-21T19:08:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: "addr_str": "192.168.0.2:0/1983715690", 2023-07-21T19:08:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: "inode_count": 1, 2023-07-21T19:08:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_epoch": 9, 2023-07-21T19:08:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch": 31, 2023-07-21T19:08:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch_barrier": 0, 2023-07-21T19:08:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: "blocklisted": false, 2023-07-21T19:08:35.739 INFO:teuthology.orchestra.run.smithi145.stdout: "fs_name": "cephfs" 2023-07-21T19:08:35.739 INFO:teuthology.orchestra.run.smithi145.stdout:} 2023-07-21T19:08:35.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.748 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2023-07-21T19:08:35.748 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:35.768 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2023-07-21T19:08:35.768 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:35.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:35.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.847 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2023-07-21T19:08:35.847 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:35.910 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2023-07-21T19:08:35.910 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:35.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.911 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-21T19:08:35.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:35.990 DEBUG:teuthology.orchestra.run.smithi145:> stat --file-system '--printf=%T 2023-07-21T19:08:35.990 DEBUG:teuthology.orchestra.run.smithi145:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:36.006 INFO:teuthology.orchestra.run.smithi145.stdout:fuseblk 2023-07-21T19:08:36.007 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:36.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:36.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:36.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:36.081 DEBUG:teuthology.orchestra.run.smithi145:> stat --file-system '--printf=%T 2023-07-21T19:08:36.082 DEBUG:teuthology.orchestra.run.smithi145:> ' -- /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:36.141 INFO:teuthology.orchestra.run.smithi145.stdout:fuseblk 2023-07-21T19:08:36.142 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:36.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:36.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-21T19:08:36.216 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-21T19:08:36.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f302d799700 1 Processor -- start 2023-07-21T19:08:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f302d799700 1 -- start start 2023-07-21T19:08:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f302d799700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 0x7f302806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f302d799700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280ca8a0 con 0x7f302806dc50 2023-07-21T19:08:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f302d799700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280cbcd0 con 0x7f30280cb180 2023-07-21T19:08:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f302d799700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30280cbf70 con 0x7f302815ffa0 2023-07-21T19:08:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f301ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f302806dc50 0x7f30280caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55780/0 (socket says 172.21.15.123:55780) 2023-07-21T19:08:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f301ffff700 1 -- 172.21.15.123:0/1699434195 learned_addr learned my addr 172.21.15.123:0/1699434195 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.403+0000 7f3026ffd700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 0x7f302806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902362982 0 0) 0x7f3010001110 con 0x7f302806dc50 2023-07-21T19:08:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30140035d0 con 0x7f302806dc50 2023-07-21T19:08:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281876346 0 0) 0x7f30280cbcd0 con 0x7f30280cb180 2023-07-21T19:08:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3010001110 con 0x7f30280cb180 2023-07-21T19:08:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158191537 0 0) 0x7f30140035d0 con 0x7f302806dc50 2023-07-21T19:08:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 msgr2=0x7f302806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 0x7f302806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 >> v1:172.21.15.145:6789/0 conn(0x7f30280cb180 legacy=0x7f30280ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280cc250 con 0x7f302806dc50 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f3010001820 con 0x7f302806dc50 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 >> v1:172.21.15.123:6789/0 conn(0x7f302806dc50 legacy=0x7f30280caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 0x7f3014003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3014004140 0x7f3014004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3014004db0 0x7f3014005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280cbf70 con 0x7f3014004db0 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301400bbc0 con 0x7f3014004140 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301400bd50 con 0x7f302815ffa0 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3014004db0 0x7f3014005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f3026ffd700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 0x7f3014003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f301ffff700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3014004140 0x7f3014004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 -- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 msgr2=0x7f3014003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302815ffa0 0x7f3014003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 -- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3014004140 msgr2=0x7f3014004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3014004140 0x7f3014004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 -- 172.21.15.123:0/1699434195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140035d0 con 0x7f3014004db0 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3014004db0 0x7f3014005220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3020002230 tx=0x7f30140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ee7c0cd66e5022 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020001f30 con 0x7f3014004db0 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000ce40 con 0x7f3014004db0 2023-07-21T19:08:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30267fc700 1 -- 172.21.15.123:0/1699434195 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020003c60 con 0x7f3014004db0 2023-07-21T19:08:36.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f302d799700 1 -- 172.21.15.123:0/1699434195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3014004db0 msgr2=0x7f3014005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f302d799700 1 --2- 172.21.15.123:0/1699434195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3014004db0 0x7f3014005220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3020002230 tx=0x7f30140058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f30277fe700 1 -- 172.21.15.123:0/1699434195 reap_dead start 2023-07-21T19:08:36.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f302d799700 1 -- 172.21.15.123:0/1699434195 shutdown_connections 2023-07-21T19:08:36.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.407+0000 7f302d799700 1 -- 172.21.15.123:0/1699434195 >> 172.21.15.123:0/1699434195 conn(0x7f302806e960 msgr2=0x7f302806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:36.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 -- 172.21.15.123:0/1699434195 shutdown_connections 2023-07-21T19:08:36.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 -- 172.21.15.123:0/1699434195 wait complete. 2023-07-21T19:08:36.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 Processor -- start 2023-07-21T19:08:36.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 -- start start 2023-07-21T19:08:36.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3014004db0 0x7f30280c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 0x7f302815e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302806cb70 0x7f302806d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280c2d90 con 0x7f30280c2ff0 2023-07-21T19:08:36.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302806d550 con 0x7f302806cb70 2023-07-21T19:08:36.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.411+0000 7f302d799700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30280c3480 con 0x7f3014004db0 2023-07-21T19:08:36.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 0x7f302815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 0x7f302815e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35522/0 (socket says 172.21.15.123:35522) 2023-07-21T19:08:36.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 -- 172.21.15.123:0/371503231 learned_addr learned my addr 172.21.15.123:0/371503231 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:36.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f30277fe700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302806cb70 0x7f302806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f3026ffd700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3014004db0 0x7f30280c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 -- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3014004db0 msgr2=0x7f30280c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3014004db0 0x7f30280c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 -- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302806cb70 msgr2=0x7f302806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302806cb70 0x7f302806d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 -- 172.21.15.123:0/371503231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280c3760 con 0x7f30280c2ff0 2023-07-21T19:08:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301ffff700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 0x7f302815e690 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f301000eb20 tx=0x7f301000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301000c7e0 con 0x7f30280c2ff0 2023-07-21T19:08:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301000c940 con 0x7f30280c2ff0 2023-07-21T19:08:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301000ccf0 con 0x7f30280c2ff0 2023-07-21T19:08:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30280c3a40 con 0x7f30280c2ff0 2023-07-21T19:08:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30280c4000 con 0x7f30280c2ff0 2023-07-21T19:08:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.415+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028071620 con 0x7f30280c2ff0 2023-07-21T19:08:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.419+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f301001d460 con 0x7f30280c2ff0 2023-07-21T19:08:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.419+0000 7f301f7fe700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f30080662f0 0x7f30080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.419+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3010083df0 con 0x7f30280c2ff0 2023-07-21T19:08:36.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.419+0000 7f3026ffd700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f30080662f0 0x7f30080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.419+0000 7f3026ffd700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f30080662f0 0x7f30080687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3018009ac0 tx=0x7f3018008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:36.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.423+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3010050f30 con 0x7f30280c2ff0 2023-07-21T19:08:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.607+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30280ca8a0 con 0x7f30280c2ff0 2023-07-21T19:08:36.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.611+0000 7f301f7fe700 1 -- 172.21.15.123:0/371503231 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f30280ca8a0 con 0x7f30280c2ff0 2023-07-21T19:08:36.626 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:36.626 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:36.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f30080662f0 msgr2=0x7f30080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f30080662f0 0x7f30080687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3018009ac0 tx=0x7f3018008040 comp rx=0 tx=0).stop 2023-07-21T19:08:36.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 msgr2=0x7f302815e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 0x7f302815e690 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f301000eb20 tx=0x7f301000eee0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 shutdown_connections 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f30080662f0 0x7f30080687a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302806cb70 0x7f302806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30280c2ff0 0x7f302815e690 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 --2- 172.21.15.123:0/371503231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3014004db0 0x7f30280c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 >> 172.21.15.123:0/371503231 conn(0x7f302806e960 msgr2=0x7f30280caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 shutdown_connections 2023-07-21T19:08:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.615+0000 7f302d799700 1 -- 172.21.15.123:0/371503231 wait complete. 2023-07-21T19:08:36.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:36.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:36.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.811+0000 7ffac2784700 1 Processor -- start 2023-07-21T19:08:36.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.811+0000 7ffac2784700 1 -- start start 2023-07-21T19:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.811+0000 7ffac2784700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc160000 0x7ffabc06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac2784700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffabc0cd7f0 0x7ffabc0c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac2784700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0cdfb0 con 0x7ffabc1603d0 2023-07-21T19:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac2784700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc070e40 con 0x7ffabc0cd7f0 2023-07-21T19:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac2784700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0cdcd0 con 0x7ffabc160000 2023-07-21T19:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac0f81700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffabc1603d0 0x7ffabc0c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55784/0 (socket says 172.21.15.123:55784) 2023-07-21T19:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac0f81700 1 -- 172.21.15.123:0/1278357109 learned_addr learned my addr 172.21.15.123:0/1278357109 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1f83700 1 --2- 172.21.15.123:0/1278357109 >> v2:172.21.15.145:3300/0 conn(0x7ffabc0cd7f0 0x7ffabc0c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1782700 1 --2- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc160000 0x7ffabc06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffab3fff700 1 -- 172.21.15.123:0/1278357109 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365941045 0 0) 0x7ffaac001110 con 0x7ffabc1603d0 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffab3fff700 1 -- 172.21.15.123:0/1278357109 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa80035d0 con 0x7ffabc1603d0 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1f83700 1 -- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc160000 msgr2=0x7ffabc06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1f83700 1 --2- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc160000 0x7ffabc06dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1f83700 1 -- 172.21.15.123:0/1278357109 >> v1:172.21.15.123:6789/0 conn(0x7ffabc1603d0 legacy=0x7ffabc0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1f83700 1 -- 172.21.15.123:0/1278357109 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc070780 con 0x7ffabc0cd7f0 2023-07-21T19:08:36.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffac1f83700 1 --2- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0cd7f0 0x7ffabc0c0d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009d90 tx=0x7ffab400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d7b8247199468e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:36.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffab3fff700 1 -- 172.21.15.123:0/1278357109 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400e070 con 0x7ffabc0cd7f0 2023-07-21T19:08:36.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffab3fff700 1 -- 172.21.15.123:0/1278357109 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab400bb20 con 0x7ffabc0cd7f0 2023-07-21T19:08:36.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.815+0000 7ffab3fff700 1 -- 172.21.15.123:0/1278357109 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4012430 con 0x7ffabc0cd7f0 2023-07-21T19:08:36.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 -- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0cd7f0 msgr2=0x7ffabc0c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 --2- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0cd7f0 0x7ffabc0c0d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009d90 tx=0x7ffab400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 -- 172.21.15.123:0/1278357109 shutdown_connections 2023-07-21T19:08:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 --2- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0cd7f0 0x7ffabc0c0d50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 --2- 172.21.15.123:0/1278357109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc160000 0x7ffabc06dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 -- 172.21.15.123:0/1278357109 >> 172.21.15.123:0/1278357109 conn(0x7ffabc0afc60 msgr2=0x7ffabc0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:36.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 -- 172.21.15.123:0/1278357109 shutdown_connections 2023-07-21T19:08:36.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 -- 172.21.15.123:0/1278357109 wait complete. 2023-07-21T19:08:36.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 Processor -- start 2023-07-21T19:08:36.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.819+0000 7ffac2784700 1 -- start start 2023-07-21T19:08:36.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac2784700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0cd7f0 0x7ffabc1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac2784700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc160000 0x7ffabc152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac2784700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 0x7ffabc15cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac2784700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1f5690 con 0x7ffabc1603d0 2023-07-21T19:08:36.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac2784700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0c6f70 con 0x7ffabc160000 2023-07-21T19:08:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac2784700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0c6640 con 0x7ffabc0cd7f0 2023-07-21T19:08:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 0x7ffabc15cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 0x7ffabc15cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35536/0 (socket says 172.21.15.123:35536) 2023-07-21T19:08:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 -- 172.21.15.123:0/4159716542 learned_addr learned my addr 172.21.15.123:0/4159716542 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1782700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0cd7f0 0x7ffabc1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac0f81700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc160000 0x7ffabc152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 -- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0cd7f0 msgr2=0x7ffabc1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0cd7f0 0x7ffabc1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 -- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc160000 msgr2=0x7ffabc152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:36.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc160000 0x7ffabc152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:36.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 -- 172.21.15.123:0/4159716542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009a70 con 0x7ffabc1603d0 2023-07-21T19:08:36.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffac1f83700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 0x7ffabc15cdc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffab4014040 tx=0x7ffab4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:36.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.823+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4012430 con 0x7ffabc1603d0 2023-07-21T19:08:36.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.827+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4020070 con 0x7ffabc1603d0 2023-07-21T19:08:36.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.827+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40098f0 con 0x7ffabc1603d0 2023-07-21T19:08:36.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.827+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc0c6920 con 0x7ffabc1603d0 2023-07-21T19:08:36.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.827+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc153170 con 0x7ffabc1603d0 2023-07-21T19:08:36.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.827+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc04e500 con 0x7ffabc1603d0 2023-07-21T19:08:36.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.827+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffab4004040 con 0x7ffabc1603d0 2023-07-21T19:08:36.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.831+0000 7ffab1ffb700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffaa00662f0 0x7ffaa00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:36.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.831+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffab4022070 con 0x7ffabc1603d0 2023-07-21T19:08:36.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.831+0000 7ffac1782700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffaa00662f0 0x7ffaa00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:36.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.831+0000 7ffac1782700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffaa00662f0 0x7ffaa00687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009bf0 tx=0x7ffab8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:36.839+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffab4056750 con 0x7ffabc1603d0 2023-07-21T19:08:36.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:36.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:37.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.011+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffabc0c70b0 con 0x7ffabc1603d0 2023-07-21T19:08:37.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.011+0000 7ffab1ffb700 1 -- 172.21.15.123:0/4159716542 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffab402c020 con 0x7ffabc1603d0 2023-07-21T19:08:37.025 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:37.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffaa00662f0 msgr2=0x7ffaa00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffaa00662f0 0x7ffaa00687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009bf0 tx=0x7ffab8009240 comp rx=0 tx=0).stop 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 msgr2=0x7ffabc15cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 0x7ffabc15cdc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffab4014040 tx=0x7ffab4004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 shutdown_connections 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ffaa00662f0 0x7ffaa00687a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc160000 0x7ffabc152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc1603d0 0x7ffabc15cdc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 --2- 172.21.15.123:0/4159716542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0cd7f0 0x7ffabc1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 >> 172.21.15.123:0/4159716542 conn(0x7ffabc0afc60 msgr2=0x7ffabc163c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:37.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 shutdown_connections 2023-07-21T19:08:37.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.015+0000 7ffac2784700 1 -- 172.21.15.123:0/4159716542 wait complete. 2023-07-21T19:08:37.048 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:37.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.255+0000 7f834b43e700 1 Processor -- start 2023-07-21T19:08:37.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.259+0000 7f834b43e700 1 -- start start 2023-07-21T19:08:37.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.259+0000 7f834b43e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 0x7f83440cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.259+0000 7f834b43e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8344163fe0 con 0x7f8344160240 2023-07-21T19:08:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f834b43e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83440c8c30 con 0x7f8344160610 2023-07-21T19:08:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f834b43e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83440ca9e0 con 0x7f83440b0490 2023-07-21T19:08:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8344160240 0x7f83440afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55790/0 (socket says 172.21.15.123:55790) 2023-07-21T19:08:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 -- 172.21.15.123:0/2657029034 learned_addr learned my addr 172.21.15.123:0/2657029034 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:37.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83489d9700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 0x7f83440cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442540779 0 0) 0x7f8344163fe0 con 0x7f8344160240 2023-07-21T19:08:37.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83300035d0 con 0x7f8344160240 2023-07-21T19:08:37.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2093587507 0 0) 0x7f83300035d0 con 0x7f8344160240 2023-07-21T19:08:37.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 msgr2=0x7f83440cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:37.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 0x7f83440cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 >> v1:172.21.15.145:6789/0 conn(0x7f8344160610 legacy=0x7f834406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8344164230 con 0x7f8344160240 2023-07-21T19:08:37.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f8340001670 con 0x7f8344160240 2023-07-21T19:08:37.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 >> v1:172.21.15.123:6789/0 conn(0x7f8344160240 legacy=0x7f83440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330003a50 0x7f8330003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 0x7f8330004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8330004db0 0x7f8330005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440ca9e0 con 0x7f8330003a50 2023-07-21T19:08:37.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833000bb70 con 0x7f8330004db0 2023-07-21T19:08:37.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833000bd30 con 0x7f83440b0490 2023-07-21T19:08:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330003a50 0x7f8330003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83499db700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8330004db0 0x7f8330005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83489d9700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 0x7f8330004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 -- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 msgr2=0x7f8330004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83440b0490 0x7f8330004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 -- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8330004db0 msgr2=0x7f8330005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8330004db0 0x7f8330005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 -- 172.21.15.123:0/2657029034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300035d0 con 0x7f8330003a50 2023-07-21T19:08:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.263+0000 7f83491da700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330003a50 0x7f8330003e60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f834000c320 tx=0x7f83300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b3c2ee50b7bdd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340007c30 con 0x7f8330003a50 2023-07-21T19:08:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000ce80 con 0x7f8330003a50 2023-07-21T19:08:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f833bfff700 1 -- 172.21.15.123:0/2657029034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340005bc0 con 0x7f8330003a50 2023-07-21T19:08:37.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f834b43e700 1 -- 172.21.15.123:0/2657029034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330003a50 msgr2=0x7f8330003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f834b43e700 1 --2- 172.21.15.123:0/2657029034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330003a50 0x7f8330003e60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f834000c320 tx=0x7f83300058a0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f83499db700 1 -- 172.21.15.123:0/2657029034 reap_dead start 2023-07-21T19:08:37.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f834b43e700 1 -- 172.21.15.123:0/2657029034 shutdown_connections 2023-07-21T19:08:37.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f834b43e700 1 -- 172.21.15.123:0/2657029034 >> 172.21.15.123:0/2657029034 conn(0x7f83440cad80 msgr2=0x7f83440cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:37.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f834b43e700 1 -- 172.21.15.123:0/2657029034 shutdown_connections 2023-07-21T19:08:37.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.267+0000 7f834b43e700 1 -- 172.21.15.123:0/2657029034 wait complete. 2023-07-21T19:08:37.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 Processor -- start 2023-07-21T19:08:37.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 -- start start 2023-07-21T19:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8330003a50 0x7f83440c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83440c7f20 0x7f834415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 0x7f83440cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834415b0a0 con 0x7f83440c2db0 2023-07-21T19:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440c3720 con 0x7f83440c7f20 2023-07-21T19:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f834b43e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83440c3a00 con 0x7f8330003a50 2023-07-21T19:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 0x7f83440cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 0x7f83440cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35548/0 (socket says 172.21.15.123:35548) 2023-07-21T19:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 -- 172.21.15.123:0/1634395422 learned_addr learned my addr 172.21.15.123:0/1634395422 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83491da700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8330003a50 0x7f83440c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83489d9700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83440c7f20 0x7f834415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 -- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8330003a50 msgr2=0x7f83440c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8330003a50 0x7f83440c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 -- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83440c7f20 msgr2=0x7f834415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83440c7f20 0x7f834415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.271+0000 7f83499db700 1 -- 172.21.15.123:0/1634395422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440c3ce0 con 0x7f83440c2db0 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f83499db700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 0x7f83440cc600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83440b09b0 tx=0x7f833c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c003c30 con 0x7f83440c2db0 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c003db0 con 0x7f83440c2db0 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83440c3fc0 con 0x7f83440c2db0 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c005310 con 0x7f83440c2db0 2023-07-21T19:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83440c3230 con 0x7f83440c2db0 2023-07-21T19:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.275+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83440c44e0 con 0x7f83440c2db0 2023-07-21T19:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.279+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f833c005470 con 0x7f83440c2db0 2023-07-21T19:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.279+0000 7f8339ffb700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8328066320 0x7f83280687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.279+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f833c0840a0 con 0x7f83440c2db0 2023-07-21T19:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.279+0000 7f83491da700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8328066320 0x7f83280687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.279+0000 7f83491da700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8328066320 0x7f83280687d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8340001930 tx=0x7f8340007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.287+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f83440c44e0 con 0x7f83440c2db0 2023-07-21T19:08:37.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.455+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83440c44e0 con 0x7f83440c2db0 2023-07-21T19:08:37.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.455+0000 7f8339ffb700 1 -- 172.21.15.123:0/1634395422 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83440c44e0 con 0x7f83440c2db0 2023-07-21T19:08:37.470 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:37.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8328066320 msgr2=0x7f83280687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8328066320 0x7f83280687d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8340001930 tx=0x7f8340007000 comp rx=0 tx=0).stop 2023-07-21T19:08:37.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 msgr2=0x7f83440cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 0x7f83440cc600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83440b09b0 tx=0x7f833c00d150 comp rx=0 tx=0).stop 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 shutdown_connections 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8328066320 0x7f83280687d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83440c7f20 0x7f834415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83440c2db0 0x7f83440cc600 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 --2- 172.21.15.123:0/1634395422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8330003a50 0x7f83440c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 >> 172.21.15.123:0/1634395422 conn(0x7f83440cad80 msgr2=0x7f834415f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:37.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 shutdown_connections 2023-07-21T19:08:37.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.459+0000 7f834b43e700 1 -- 172.21.15.123:0/1634395422 wait complete. 2023-07-21T19:08:37.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:37.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.663+0000 7fa95d485700 1 Processor -- start 2023-07-21T19:08:37.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.663+0000 7fa95d485700 1 -- start start 2023-07-21T19:08:37.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa95d485700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9580b0770 0x7fa95806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa95d485700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa9580cab00 0x7fa9580caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa95d485700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9580cb4a0 con 0x7fa958159c60 2023-07-21T19:08:37.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa95d485700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9580714f0 con 0x7fa9580b0770 2023-07-21T19:08:37.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa95d485700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95806da00 con 0x7fa9580cab00 2023-07-21T19:08:37.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9580b0770 0x7fa95806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9580b0770 0x7fa95806d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35560/0 (socket says 172.21.15.123:35560) 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 -- 172.21.15.123:0/449496107 learned_addr learned my addr 172.21.15.123:0/449496107 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa95cc84700 1 --2- 172.21.15.123:0/449496107 >> v2:172.21.15.145:3300/0 conn(0x7fa9580cab00 0x7fa9580caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 -- 172.21.15.123:0/449496107 >> v2:172.21.15.145:3300/0 conn(0x7fa9580cab00 msgr2=0x7fa9580caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 --2- 172.21.15.123:0/449496107 >> v2:172.21.15.145:3300/0 conn(0x7fa9580cab00 0x7fa9580caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 -- 172.21.15.123:0/449496107 >> v1:172.21.15.145:6789/0 conn(0x7fa958159c60 legacy=0x7fa958070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 -- 172.21.15.123:0/449496107 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95806dce0 con 0x7fa9580b0770 2023-07-21T19:08:37.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa9577fe700 1 --2- 172.21.15.123:0/449496107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580b0770 0x7fa95806d3b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9580cbb40 tx=0x7fa94800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9821f43b59cd734b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:37.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa956ffd700 1 -- 172.21.15.123:0/449496107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800e070 con 0x7fa9580b0770 2023-07-21T19:08:37.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa956ffd700 1 -- 172.21.15.123:0/449496107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800b910 con 0x7fa9580b0770 2023-07-21T19:08:37.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.667+0000 7fa956ffd700 1 -- 172.21.15.123:0/449496107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800bcc0 con 0x7fa9580b0770 2023-07-21T19:08:37.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 -- 172.21.15.123:0/449496107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580b0770 msgr2=0x7fa95806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 --2- 172.21.15.123:0/449496107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580b0770 0x7fa95806d3b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9580cbb40 tx=0x7fa94800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:37.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 -- 172.21.15.123:0/449496107 shutdown_connections 2023-07-21T19:08:37.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 --2- 172.21.15.123:0/449496107 >> v2:172.21.15.145:3300/0 conn(0x7fa9580cab00 0x7fa9580caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 --2- 172.21.15.123:0/449496107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580b0770 0x7fa95806d3b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 -- 172.21.15.123:0/449496107 >> 172.21.15.123:0/449496107 conn(0x7fa9580afc60 msgr2=0x7fa9580b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:37.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 -- 172.21.15.123:0/449496107 shutdown_connections 2023-07-21T19:08:37.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 -- 172.21.15.123:0/449496107 wait complete. 2023-07-21T19:08:37.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.671+0000 7fa95d485700 1 Processor -- start 2023-07-21T19:08:37.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 -- start start 2023-07-21T19:08:37.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9580b0770 0x7fa9580b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 0x7fa9581f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa958159c60 0x7fa9580c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580c48f0 con 0x7fa9580cab00 2023-07-21T19:08:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580b14c0 con 0x7fa9580b0770 2023-07-21T19:08:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95d485700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580c2a80 con 0x7fa958159c60 2023-07-21T19:08:37.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 0x7fa9581f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 0x7fa9581f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35574/0 (socket says 172.21.15.123:35574) 2023-07-21T19:08:37.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 -- 172.21.15.123:0/3196168986 learned_addr learned my addr 172.21.15.123:0/3196168986 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa957fff700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9580b0770 0x7fa9580b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa95cc84700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa958159c60 0x7fa9580c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 -- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa958159c60 msgr2=0x7fa9580c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa958159c60 0x7fa9580c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 -- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9580b0770 msgr2=0x7fa9580b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9580b0770 0x7fa9580b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 -- 172.21.15.123:0/3196168986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948009b30 con 0x7fa9580cab00 2023-07-21T19:08:37.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa9577fe700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 0x7fa9581f5670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa95806b390 tx=0x7fa948004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:37.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.675+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480099b0 con 0x7fa9580cab00 2023-07-21T19:08:37.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.679+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948004970 con 0x7fa9580cab00 2023-07-21T19:08:37.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.679+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9580c4050 con 0x7fa9580cab00 2023-07-21T19:08:37.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.679+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94801b670 con 0x7fa9580cab00 2023-07-21T19:08:37.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.679+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9580c4610 con 0x7fa9580cab00 2023-07-21T19:08:37.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.679+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9580c28e0 con 0x7fa9580cab00 2023-07-21T19:08:37.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.679+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa94801b7d0 con 0x7fa9580cab00 2023-07-21T19:08:37.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.683+0000 7fa954ff9700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9380662f0 0x7fa9380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.683+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa948085310 con 0x7fa9580cab00 2023-07-21T19:08:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.683+0000 7fa957fff700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9380662f0 0x7fa9380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:37.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.683+0000 7fa957fff700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9380662f0 0x7fa9380687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa940000f60 tx=0x7fa940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:37.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.687+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa9580c28e0 con 0x7fa9580cab00 2023-07-21T19:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.859+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9580c28e0 con 0x7fa9580cab00 2023-07-21T19:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa954ff9700 1 -- 172.21.15.123:0/3196168986 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9580c28e0 con 0x7fa9580cab00 2023-07-21T19:08:37.876 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:37.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9380662f0 msgr2=0x7fa9380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9380662f0 0x7fa9380687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa940000f60 tx=0x7fa940009040 comp rx=0 tx=0).stop 2023-07-21T19:08:37.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 msgr2=0x7fa9581f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:37.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 0x7fa9581f5670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa95806b390 tx=0x7fa948004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 shutdown_connections 2023-07-21T19:08:37.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa9380662f0 0x7fa9380687a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa958159c60 0x7fa9580c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9580cab00 0x7fa9581f5670 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 --2- 172.21.15.123:0/3196168986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9580b0770 0x7fa9580b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:37.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 >> 172.21.15.123:0/3196168986 conn(0x7fa9580afc60 msgr2=0x7fa958156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:37.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 shutdown_connections 2023-07-21T19:08:37.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:37.863+0000 7fa95d485700 1 -- 172.21.15.123:0/3196168986 wait complete. 2023-07-21T19:08:37.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.059+0000 7f6ba09d9700 1 Processor -- start 2023-07-21T19:08:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.059+0000 7f6ba09d9700 1 -- start start 2023-07-21T19:08:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6ba09d9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6b9c0cd260 0x7f6b9c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6ba09d9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c0d1a60 con 0x7f6b9c0b0ee0 2023-07-21T19:08:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6ba09d9700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c0d1ef0 con 0x7f6b9c0d0610 2023-07-21T19:08:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6ba09d9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c0d0e50 con 0x7f6b9c0cd260 2023-07-21T19:08:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6b9c0b0ee0 0x7f6b9c0ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55792/0 (socket says 172.21.15.123:55792) 2023-07-21T19:08:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9b7fe700 1 -- 172.21.15.123:0/2436945584 learned_addr learned my addr 172.21.15.123:0/2436945584 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9affd700 1 --2- 172.21.15.123:0/2436945584 >> v2:172.21.15.123:3300/0 conn(0x7f6b9c0cd260 0x7f6b9c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9a7fc700 1 -- 172.21.15.123:0/2436945584 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041427957 0 0) 0x7f6b9c0d1a60 con 0x7f6b9c0b0ee0 2023-07-21T19:08:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9a7fc700 1 -- 172.21.15.123:0/2436945584 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b840035d0 con 0x7f6b9c0b0ee0 2023-07-21T19:08:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9affd700 1 -- 172.21.15.123:0/2436945584 >> v1:172.21.15.145:6789/0 conn(0x7f6b9c0d0610 legacy=0x7f6b9c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9affd700 1 -- 172.21.15.123:0/2436945584 >> v1:172.21.15.123:6789/0 conn(0x7f6b9c0b0ee0 legacy=0x7f6b9c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9affd700 1 -- 172.21.15.123:0/2436945584 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0d1130 con 0x7f6b9c0cd260 2023-07-21T19:08:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9affd700 1 --2- 172.21.15.123:0/2436945584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0d00d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009850 tx=0x7f6b90009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8efe799990c9d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9a7fc700 1 -- 172.21.15.123:0/2436945584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90011830 con 0x7f6b9c0cd260 2023-07-21T19:08:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9a7fc700 1 -- 172.21.15.123:0/2436945584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90011990 con 0x7f6b9c0cd260 2023-07-21T19:08:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.063+0000 7f6b9a7fc700 1 -- 172.21.15.123:0/2436945584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90011d20 con 0x7f6b9c0cd260 2023-07-21T19:08:38.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 -- 172.21.15.123:0/2436945584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 msgr2=0x7f6b9c0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/2436945584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0d00d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009850 tx=0x7f6b90009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:38.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 -- 172.21.15.123:0/2436945584 shutdown_connections 2023-07-21T19:08:38.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/2436945584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0d00d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 -- 172.21.15.123:0/2436945584 >> 172.21.15.123:0/2436945584 conn(0x7f6b9c060c40 msgr2=0x7f6b9c09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:38.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 -- 172.21.15.123:0/2436945584 shutdown_connections 2023-07-21T19:08:38.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 -- 172.21.15.123:0/2436945584 wait complete. 2023-07-21T19:08:38.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.067+0000 7f6ba09d9700 1 Processor -- start 2023-07-21T19:08:38.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 -- start start 2023-07-21T19:08:38.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0b0ee0 0x7f6b9c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0d0610 0x7f6b9c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0afe80 con 0x7f6b9c0cd260 2023-07-21T19:08:38.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c1552b0 con 0x7f6b9c0d0610 2023-07-21T19:08:38.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0cb6a0 con 0x7f6b9c0b0ee0 2023-07-21T19:08:38.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35588/0 (socket says 172.21.15.123:35588) 2023-07-21T19:08:38.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 -- 172.21.15.123:0/220803297 learned_addr learned my addr 172.21.15.123:0/220803297 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:38.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9b7fe700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0b0ee0 0x7f6b9c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9bfff700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0d0610 0x7f6b9c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 -- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0b0ee0 msgr2=0x7f6b9c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0b0ee0 0x7f6b9c0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 -- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0d0610 msgr2=0x7f6b9c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0d0610 0x7f6b9c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 -- 172.21.15.123:0/220803297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900094b0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9bfff700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0d0610 0x7f6b9c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b9affd700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0af940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009ba0 tx=0x7f6b90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900036c0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9001e070 con 0x7f6b9c0cd260 2023-07-21T19:08:38.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c0c7ed0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90003a60 con 0x7f6b9c0cd260 2023-07-21T19:08:38.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.071+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c0c8170 con 0x7f6b9c0cd260 2023-07-21T19:08:38.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.075+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c04e500 con 0x7f6b9c0cd260 2023-07-21T19:08:38.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.075+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b90003bc0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.079+0000 7f6b83fff700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6b88066320 0x7f6b880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.079+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b90084ff0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.079+0000 7f6b9b7fe700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6b88066320 0x7f6b880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.079+0000 7f6b9b7fe700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6b88066320 0x7f6b880687d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0011e0 tx=0x7f6b8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.083+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6b900b5720 con 0x7f6b9c0cd260 2023-07-21T19:08:38.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.251+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b9c0b4bb0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.255+0000 7f6b83fff700 1 -- 172.21.15.123:0/220803297 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b900200a0 con 0x7f6b9c0cd260 2023-07-21T19:08:38.268 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6b88066320 msgr2=0x7f6b880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6b88066320 0x7f6b880687d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0011e0 tx=0x7f6b8c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 msgr2=0x7f6b9c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0af940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009ba0 tx=0x7f6b90004770 comp rx=0 tx=0).stop 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 shutdown_connections 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6b88066320 0x7f6b880687d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0d0610 0x7f6b9c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b9c0cd260 0x7f6b9c0af940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 --2- 172.21.15.123:0/220803297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0b0ee0 0x7f6b9c0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 >> 172.21.15.123:0/220803297 conn(0x7f6b9c060c40 msgr2=0x7f6b9c0b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:38.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 shutdown_connections 2023-07-21T19:08:38.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.259+0000 7f6ba09d9700 1 -- 172.21.15.123:0/220803297 wait complete. 2023-07-21T19:08:38.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:38.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.451+0000 7fef54a7d700 1 Processor -- start 2023-07-21T19:08:38.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.451+0000 7fef54a7d700 1 -- start start 2023-07-21T19:08:38.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef54a7d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fef500b36f0 0x7fef5015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef54a7d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef500c85e0 0x7fef500c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef54a7d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500ce110 con 0x7fef500c9d50 2023-07-21T19:08:38.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef54a7d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500c8f60 con 0x7fef500c85e0 2023-07-21T19:08:38.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef54a7d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500cddb0 con 0x7fef500b36f0 2023-07-21T19:08:38.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef500c85e0 0x7fef500c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4effd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef500c9d50 0x7fef500ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55800/0 (socket says 172.21.15.123:55800) 2023-07-21T19:08:38.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4effd700 1 -- 172.21.15.123:0/3485992559 learned_addr learned my addr 172.21.15.123:0/3485992559 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:38.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4f7fe700 1 --2- 172.21.15.123:0/3485992559 >> v2:172.21.15.145:3300/0 conn(0x7fef500b36f0 0x7fef5015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4ffff700 1 -- 172.21.15.123:0/3485992559 >> v2:172.21.15.145:3300/0 conn(0x7fef500b36f0 msgr2=0x7fef5015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:38.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4ffff700 1 --2- 172.21.15.123:0/3485992559 >> v2:172.21.15.145:3300/0 conn(0x7fef500b36f0 0x7fef5015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4ffff700 1 -- 172.21.15.123:0/3485992559 >> v1:172.21.15.123:6789/0 conn(0x7fef500c9d50 legacy=0x7fef500ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4ffff700 1 -- 172.21.15.123:0/3485992559 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5015dd60 con 0x7fef500c85e0 2023-07-21T19:08:38.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4e7fc700 1 -- 172.21.15.123:0/3485992559 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814936871 0 0) 0x7fef500ce110 con 0x7fef500c9d50 2023-07-21T19:08:38.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4ffff700 1 --2- 172.21.15.123:0/3485992559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500c85e0 0x7fef500c8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fef5006ba60 tx=0x7fef4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d6d768c0586b30 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4e7fc700 1 -- 172.21.15.123:0/3485992559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800e070 con 0x7fef500c85e0 2023-07-21T19:08:38.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4e7fc700 1 -- 172.21.15.123:0/3485992559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800bb20 con 0x7fef500c85e0 2023-07-21T19:08:38.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.455+0000 7fef4e7fc700 1 -- 172.21.15.123:0/3485992559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48012430 con 0x7fef500c85e0 2023-07-21T19:08:38.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 -- 172.21.15.123:0/3485992559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500c85e0 msgr2=0x7fef500c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 --2- 172.21.15.123:0/3485992559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500c85e0 0x7fef500c8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fef5006ba60 tx=0x7fef4800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:38.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 -- 172.21.15.123:0/3485992559 shutdown_connections 2023-07-21T19:08:38.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 --2- 172.21.15.123:0/3485992559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500c85e0 0x7fef500c8a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 --2- 172.21.15.123:0/3485992559 >> v2:172.21.15.145:3300/0 conn(0x7fef500b36f0 0x7fef5015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 -- 172.21.15.123:0/3485992559 >> 172.21.15.123:0/3485992559 conn(0x7fef50060320 msgr2=0x7fef50060720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:38.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 -- 172.21.15.123:0/3485992559 shutdown_connections 2023-07-21T19:08:38.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.459+0000 7fef54a7d700 1 -- 172.21.15.123:0/3485992559 wait complete. 2023-07-21T19:08:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 Processor -- start 2023-07-21T19:08:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 -- start start 2023-07-21T19:08:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 0x7fef5014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef500c85e0 0x7fef500aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef500c9d50 0x7fef500af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015a140 con 0x7fef500b36f0 2023-07-21T19:08:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50155a30 con 0x7fef500c85e0 2023-07-21T19:08:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef54a7d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5014e400 con 0x7fef500c9d50 2023-07-21T19:08:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 0x7fef5014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 0x7fef5014dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35604/0 (socket says 172.21.15.123:35604) 2023-07-21T19:08:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 -- 172.21.15.123:0/1942616870 learned_addr learned my addr 172.21.15.123:0/1942616870 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4effd700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef500c85e0 0x7fef500aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4ffff700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef500c9d50 0x7fef500af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 -- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef500c9d50 msgr2=0x7fef500af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef500c9d50 0x7fef500af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 -- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef500c85e0 msgr2=0x7fef500aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef500c85e0 0x7fef500aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 -- 172.21.15.123:0/1942616870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009a70 con 0x7fef500b36f0 2023-07-21T19:08:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4ffff700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef500c9d50 0x7fef500af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.463+0000 7fef4f7fe700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 0x7fef5014dec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e9d0 tx=0x7fef4000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40009720 con 0x7fef500b36f0 2023-07-21T19:08:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000c850 con 0x7fef500b36f0 2023-07-21T19:08:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5015ae90 con 0x7fef500b36f0 2023-07-21T19:08:38.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000cbc0 con 0x7fef500b36f0 2023-07-21T19:08:38.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50155750 con 0x7fef500b36f0 2023-07-21T19:08:38.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5015d9d0 con 0x7fef500b36f0 2023-07-21T19:08:38.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.467+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef4000cd20 con 0x7fef500b36f0 2023-07-21T19:08:38.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.471+0000 7fef37fff700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef3c0662f0 0x7fef3c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.471+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fef40084200 con 0x7fef500b36f0 2023-07-21T19:08:38.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.471+0000 7fef4effd700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef3c0662f0 0x7fef3c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.471+0000 7fef4effd700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef3c0662f0 0x7fef3c0687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef501f20e0 tx=0x7fef44007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.475+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fef40051220 con 0x7fef500b36f0 2023-07-21T19:08:38.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.647+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fef5004e500 con 0x7fef500b36f0 2023-07-21T19:08:38.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef37fff700 1 -- 172.21.15.123:0/1942616870 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fef40054840 con 0x7fef500b36f0 2023-07-21T19:08:38.664 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:38.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef3c0662f0 msgr2=0x7fef3c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef3c0662f0 0x7fef3c0687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef501f20e0 tx=0x7fef44007e90 comp rx=0 tx=0).stop 2023-07-21T19:08:38.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 msgr2=0x7fef5014dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 0x7fef5014dec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e9d0 tx=0x7fef4000ece0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 shutdown_connections 2023-07-21T19:08:38.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef3c0662f0 0x7fef3c0687a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef500c85e0 0x7fef500aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef500c9d50 0x7fef500af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 --2- 172.21.15.123:0/1942616870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef500b36f0 0x7fef5014dec0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 >> 172.21.15.123:0/1942616870 conn(0x7fef50060320 msgr2=0x7fef500ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:38.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 shutdown_connections 2023-07-21T19:08:38.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.651+0000 7fef54a7d700 1 -- 172.21.15.123:0/1942616870 wait complete. 2023-07-21T19:08:38.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.847+0000 7f75770df700 1 Processor -- start 2023-07-21T19:08:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.847+0000 7f75770df700 1 -- start start 2023-07-21T19:08:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f75770df700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f757006be70 0x7f75700cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f75770df700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75700c1e00 0x7f75700cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f75770df700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75700cc1b0 con 0x7f757006d860 2023-07-21T19:08:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f75770df700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75700cd690 con 0x7f75700c1e00 2023-07-21T19:08:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f75770df700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75700cd970 con 0x7f757006be70 2023-07-21T19:08:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75700c1e00 0x7f75700cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75700c1e00 0x7f75700cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35606/0 (socket says 172.21.15.123:35606) 2023-07-21T19:08:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 -- 172.21.15.123:0/3985243278 learned_addr learned my addr 172.21.15.123:0/3985243278 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f756ffff700 1 --2- 172.21.15.123:0/3985243278 >> v2:172.21.15.145:3300/0 conn(0x7f757006be70 0x7f75700cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 -- 172.21.15.123:0/3985243278 >> v2:172.21.15.145:3300/0 conn(0x7f757006be70 msgr2=0x7f75700cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 --2- 172.21.15.123:0/3985243278 >> v2:172.21.15.145:3300/0 conn(0x7f757006be70 0x7f75700cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 -- 172.21.15.123:0/3985243278 >> v1:172.21.15.145:6789/0 conn(0x7f757006d860 legacy=0x7f757006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.851+0000 7f757567c700 1 -- 172.21.15.123:0/3985243278 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700cdc50 con 0x7f75700c1e00 2023-07-21T19:08:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f757567c700 1 --2- 172.21.15.123:0/3985243278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75700c1e00 0x7f75700cc640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75700b0c60 tx=0x7f756800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6674560125dfca2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f756f7fe700 1 -- 172.21.15.123:0/3985243278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756800e070 con 0x7f75700c1e00 2023-07-21T19:08:38.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f756f7fe700 1 -- 172.21.15.123:0/3985243278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756800b910 con 0x7f75700c1e00 2023-07-21T19:08:38.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f756f7fe700 1 -- 172.21.15.123:0/3985243278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756800bcc0 con 0x7f75700c1e00 2023-07-21T19:08:38.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 -- 172.21.15.123:0/3985243278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75700c1e00 msgr2=0x7f75700cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 --2- 172.21.15.123:0/3985243278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75700c1e00 0x7f75700cc640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75700b0c60 tx=0x7f756800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 -- 172.21.15.123:0/3985243278 shutdown_connections 2023-07-21T19:08:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 --2- 172.21.15.123:0/3985243278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75700c1e00 0x7f75700cc640 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 --2- 172.21.15.123:0/3985243278 >> v2:172.21.15.145:3300/0 conn(0x7f757006be70 0x7f75700cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 -- 172.21.15.123:0/3985243278 >> 172.21.15.123:0/3985243278 conn(0x7f75700cad30 msgr2=0x7f75700cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 -- 172.21.15.123:0/3985243278 shutdown_connections 2023-07-21T19:08:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.855+0000 7f75770df700 1 -- 172.21.15.123:0/3985243278 wait complete. 2023-07-21T19:08:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.859+0000 7f75770df700 1 Processor -- start 2023-07-21T19:08:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.859+0000 7f75770df700 1 -- start start 2023-07-21T19:08:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f757006be70 0x7f75700aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 0x7f75700c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75700c1e00 0x7f75700c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75701451f0 con 0x7f757006d860 2023-07-21T19:08:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700c6930 con 0x7f75700c1e00 2023-07-21T19:08:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75700c6c10 con 0x7f757006be70 2023-07-21T19:08:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 0x7f75700c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 0x7f75700c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35618/0 (socket says 172.21.15.123:35618) 2023-07-21T19:08:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 -- 172.21.15.123:0/2263314192 learned_addr learned my addr 172.21.15.123:0/2263314192 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f7574e7b700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f757006be70 0x7f75700aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f757567c700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75700c1e00 0x7f75700c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 -- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f757006be70 msgr2=0x7f75700aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f757006be70 0x7f75700aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 -- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75700c1e00 msgr2=0x7f75700c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75700c1e00 0x7f75700c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 -- 172.21.15.123:0/2263314192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568009b30 con 0x7f757006d860 2023-07-21T19:08:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f757567c700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75700c1e00 0x7f75700c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756ffff700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 0x7f75700c5d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f756000e9d0 tx=0x7f756000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560009720 con 0x7f757006d860 2023-07-21T19:08:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000c850 con 0x7f757006d860 2023-07-21T19:08:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000cbc0 con 0x7f757006d860 2023-07-21T19:08:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75700c6ef0 con 0x7f757006d860 2023-07-21T19:08:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.863+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7570142670 con 0x7f757006d860 2023-07-21T19:08:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.867+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757004dcb0 con 0x7f757006d860 2023-07-21T19:08:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.867+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f756000cd20 con 0x7f757006d860 2023-07-21T19:08:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.871+0000 7f756d7fa700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f755c066320 0x7f755c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.871+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75600841d0 con 0x7f757006d860 2023-07-21T19:08:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.871+0000 7f7574e7b700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f755c066320 0x7f755c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.871+0000 7f7574e7b700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f755c066320 0x7f755c0687d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7564000f60 tx=0x7f7564009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:38.875+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7560054d10 con 0x7f757006d860 2023-07-21T19:08:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.047+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7570072950 con 0x7f757006d860 2023-07-21T19:08:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.051+0000 7f756d7fa700 1 -- 172.21.15.123:0/2263314192 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f75600548a0 con 0x7f757006d860 2023-07-21T19:08:39.066 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:39.066 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:39.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f755c066320 msgr2=0x7f755c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f755c066320 0x7f755c0687d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7564000f60 tx=0x7f7564009040 comp rx=0 tx=0).stop 2023-07-21T19:08:39.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 msgr2=0x7f75700c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 0x7f75700c5d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f756000e9d0 tx=0x7f756000ed90 comp rx=0 tx=0).stop 2023-07-21T19:08:39.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 shutdown_connections 2023-07-21T19:08:39.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f755c066320 0x7f755c0687d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75700c1e00 0x7f75700c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f757006d860 0x7f75700c5d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 --2- 172.21.15.123:0/2263314192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f757006be70 0x7f75700aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 >> 172.21.15.123:0/2263314192 conn(0x7f75700cad30 msgr2=0x7f75700ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:39.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 shutdown_connections 2023-07-21T19:08:39.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.055+0000 7f75770df700 1 -- 172.21.15.123:0/2263314192 wait complete. 2023-07-21T19:08:39.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:39.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:39.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.255+0000 7f473f59e700 1 Processor -- start 2023-07-21T19:08:39.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.255+0000 7f473f59e700 1 -- start start 2023-07-21T19:08:39.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473f59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4740159c60 0x7f474006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47400b0770 0x7f4740070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473f59e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474006da00 con 0x7f47400cab00 2023-07-21T19:08:39.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474006dce0 con 0x7f47400b0770 2023-07-21T19:08:39.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473f59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474006dfc0 con 0x7f4740159c60 2023-07-21T19:08:39.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47400b0770 0x7f4740070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47400b0770 0x7f4740070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35630/0 (socket says 172.21.15.123:35630) 2023-07-21T19:08:39.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 -- 172.21.15.123:0/2703708860 learned_addr learned my addr 172.21.15.123:0/2703708860 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:39.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473e59c700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4740159c60 0x7f474006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 -- 172.21.15.123:0/2703708860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4740159c60 msgr2=0x7f474006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4740159c60 0x7f474006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 -- 172.21.15.123:0/2703708860 >> v1:172.21.15.145:6789/0 conn(0x7f47400cab00 legacy=0x7f47400c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 -- 172.21.15.123:0/2703708860 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400705e0 con 0x7f47400b0770 2023-07-21T19:08:39.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473e59c700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4740159c60 0x7f474006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:39.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473dd9b700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47400b0770 0x7f4740070de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4734009910 tx=0x7f4734009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ea505526d762c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:39.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473d59a700 1 -- 172.21.15.123:0/2703708860 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400ba60 con 0x7f47400b0770 2023-07-21T19:08:39.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473d59a700 1 -- 172.21.15.123:0/2703708860 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473400bbc0 con 0x7f47400b0770 2023-07-21T19:08:39.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.259+0000 7f473d59a700 1 -- 172.21.15.123:0/2703708860 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734009e60 con 0x7f47400b0770 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 -- 172.21.15.123:0/2703708860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47400b0770 msgr2=0x7f4740070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47400b0770 0x7f4740070de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4734009910 tx=0x7f4734009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 -- 172.21.15.123:0/2703708860 shutdown_connections 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47400b0770 0x7f4740070de0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 --2- 172.21.15.123:0/2703708860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4740159c60 0x7f474006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 -- 172.21.15.123:0/2703708860 >> 172.21.15.123:0/2703708860 conn(0x7f47400afc60 msgr2=0x7f47400b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:39.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 -- 172.21.15.123:0/2703708860 shutdown_connections 2023-07-21T19:08:39.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.263+0000 7f473f59e700 1 -- 172.21.15.123:0/2703708860 wait complete. 2023-07-21T19:08:39.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 Processor -- start 2023-07-21T19:08:39.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 -- start start 2023-07-21T19:08:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47400b0770 0x7f47401f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47400cab00 0x7f4740156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 0x7f47400c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400b1d70 con 0x7f4740159c60 2023-07-21T19:08:39.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400b1a40 con 0x7f47400cab00 2023-07-21T19:08:39.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.267+0000 7f473f59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4740157030 con 0x7f47400b0770 2023-07-21T19:08:39.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 0x7f47400c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 0x7f47400c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35646/0 (socket says 172.21.15.123:35646) 2023-07-21T19:08:39.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473e59c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47400b0770 0x7f47401f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 -- 172.21.15.123:0/3754304040 learned_addr learned my addr 172.21.15.123:0/3754304040 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:39.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473dd9b700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47400cab00 0x7f4740156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 -- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47400b0770 msgr2=0x7f47401f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47400b0770 0x7f47401f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 -- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47400cab00 msgr2=0x7f4740156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47400cab00 0x7f4740156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 -- 172.21.15.123:0/3754304040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009570 con 0x7f4740159c60 2023-07-21T19:08:39.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473ed9d700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 0x7f47400c7a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f473800cc50 tx=0x7f473800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:39.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738003c20 con 0x7f4740159c60 2023-07-21T19:08:39.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738003d80 con 0x7f4740159c60 2023-07-21T19:08:39.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4740157310 con 0x7f4740159c60 2023-07-21T19:08:39.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800aab0 con 0x7f4740159c60 2023-07-21T19:08:39.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.271+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47401f17a0 con 0x7f4740159c60 2023-07-21T19:08:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.275+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47400b1ee0 con 0x7f4740159c60 2023-07-21T19:08:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.275+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f473800ac10 con 0x7f4740159c60 2023-07-21T19:08:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.275+0000 7f472effd700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f47200662f0 0x7f47200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.275+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f47380840c0 con 0x7f4740159c60 2023-07-21T19:08:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.275+0000 7f473e59c700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f47200662f0 0x7f47200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.279+0000 7f473e59c700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f47200662f0 0x7f47200687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f473000c960 tx=0x7f4730008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.283+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4738051170 con 0x7f4740159c60 2023-07-21T19:08:39.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.451+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f474004e500 con 0x7f4740159c60 2023-07-21T19:08:39.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.451+0000 7f472effd700 1 -- 172.21.15.123:0/3754304040 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4738054790 con 0x7f4740159c60 2023-07-21T19:08:39.465 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f47200662f0 msgr2=0x7f47200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f47200662f0 0x7f47200687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f473000c960 tx=0x7f4730008040 comp rx=0 tx=0).stop 2023-07-21T19:08:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 msgr2=0x7f47400c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 0x7f47400c7a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f473800cc50 tx=0x7f473800cf60 comp rx=0 tx=0).stop 2023-07-21T19:08:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 shutdown_connections 2023-07-21T19:08:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f47200662f0 0x7f47200687a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47400cab00 0x7f4740156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4740159c60 0x7f47400c7a30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 --2- 172.21.15.123:0/3754304040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47400b0770 0x7f47401f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 >> 172.21.15.123:0/3754304040 conn(0x7f47400afc60 msgr2=0x7f47400caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 shutdown_connections 2023-07-21T19:08:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.455+0000 7f473f59e700 1 -- 172.21.15.123:0/3754304040 wait complete. 2023-07-21T19:08:39.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 Processor -- start 2023-07-21T19:08:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 -- start start 2023-07-21T19:08:39.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4f81603d0 0x7fe4f806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe4f80cd7f0 0x7fe4f80c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80cdfb0 con 0x7fe4f8160000 2023-07-21T19:08:39.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f8070e40 con 0x7fe4f81603d0 2023-07-21T19:08:39.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.655+0000 7fe4f759e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80cdcd0 con 0x7fe4f80cd7f0 2023-07-21T19:08:39.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4f81603d0 0x7fe4f806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4f81603d0 0x7fe4f806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35648/0 (socket says 172.21.15.123:35648) 2023-07-21T19:08:39.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 -- 172.21.15.123:0/1257482016 learned_addr learned my addr 172.21.15.123:0/1257482016 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:39.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f6d9d700 1 --2- 172.21.15.123:0/1257482016 >> v2:172.21.15.145:3300/0 conn(0x7fe4f80cd7f0 0x7fe4f80c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 -- 172.21.15.123:0/1257482016 >> v2:172.21.15.145:3300/0 conn(0x7fe4f80cd7f0 msgr2=0x7fe4f80c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:39.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 --2- 172.21.15.123:0/1257482016 >> v2:172.21.15.145:3300/0 conn(0x7fe4f80cd7f0 0x7fe4f80c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 -- 172.21.15.123:0/1257482016 >> v1:172.21.15.145:6789/0 conn(0x7fe4f8160000 legacy=0x7fe4f80c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:39.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 -- 172.21.15.123:0/1257482016 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8070780 con 0x7fe4f81603d0 2023-07-21T19:08:39.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f6d9d700 1 --2- 172.21.15.123:0/1257482016 >> v2:172.21.15.145:3300/0 conn(0x7fe4f80cd7f0 0x7fe4f80c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:39.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f5d9b700 1 --2- 172.21.15.123:0/1257482016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f806dd10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8163c20 tx=0x7fe4ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84312bd2dfa5b57c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:39.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f559a700 1 -- 172.21.15.123:0/1257482016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec004230 con 0x7fe4f81603d0 2023-07-21T19:08:39.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f559a700 1 -- 172.21.15.123:0/1257482016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec004390 con 0x7fe4f81603d0 2023-07-21T19:08:39.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f559a700 1 -- 172.21.15.123:0/1257482016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0036c0 con 0x7fe4f81603d0 2023-07-21T19:08:39.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 -- 172.21.15.123:0/1257482016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 msgr2=0x7fe4f806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 --2- 172.21.15.123:0/1257482016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f806dd10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8163c20 tx=0x7fe4ec009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 -- 172.21.15.123:0/1257482016 shutdown_connections 2023-07-21T19:08:39.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 --2- 172.21.15.123:0/1257482016 >> v2:172.21.15.145:3300/0 conn(0x7fe4f80cd7f0 0x7fe4f80c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 --2- 172.21.15.123:0/1257482016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f806dd10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 -- 172.21.15.123:0/1257482016 >> 172.21.15.123:0/1257482016 conn(0x7fe4f80afc60 msgr2=0x7fe4f80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:39.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 -- 172.21.15.123:0/1257482016 shutdown_connections 2023-07-21T19:08:39.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.659+0000 7fe4f759e700 1 -- 172.21.15.123:0/1257482016 wait complete. 2023-07-21T19:08:39.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.663+0000 7fe4f759e700 1 Processor -- start 2023-07-21T19:08:39.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.663+0000 7fe4f759e700 1 -- start start 2023-07-21T19:08:39.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4f80cd7f0 0x7fe4f81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4f8160000 0x7fe4f80c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f80b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80c6b90 con 0x7fe4f81603d0 2023-07-21T19:08:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80b22c0 con 0x7fe4f80cd7f0 2023-07-21T19:08:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80c5f10 con 0x7fe4f8160000 2023-07-21T19:08:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f80b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f80b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35654/0 (socket says 172.21.15.123:35654) 2023-07-21T19:08:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 -- 172.21.15.123:0/115302754 learned_addr learned my addr 172.21.15.123:0/115302754 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f5d9b700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4f8160000 0x7fe4f80c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f659c700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4f80cd7f0 0x7fe4f81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 -- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4f8160000 msgr2=0x7fe4f80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4f8160000 0x7fe4f80c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 -- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4f80cd7f0 msgr2=0x7fe4f81545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4f80cd7f0 0x7fe4f81545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 -- 172.21.15.123:0/115302754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec009570 con 0x7fe4f81603d0 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f6d9d700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f80b2880 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000cef0 tx=0x7fe4f000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000ad00 con 0x7fe4f81603d0 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000ae60 con 0x7fe4f81603d0 2023-07-21T19:08:39.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f80c61f0 con 0x7fe4f81603d0 2023-07-21T19:08:39.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0015680 con 0x7fe4f81603d0 2023-07-21T19:08:39.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.667+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f80c67b0 con 0x7fe4f81603d0 2023-07-21T19:08:39.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.671+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f8071240 con 0x7fe4f81603d0 2023-07-21T19:08:39.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.671+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4f000d430 con 0x7fe4f81603d0 2023-07-21T19:08:39.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.671+0000 7fe4e6ffd700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe4d80662f0 0x7fe4d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:39.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.675+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4f0084690 con 0x7fe4f81603d0 2023-07-21T19:08:39.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.675+0000 7fe4f659c700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe4d80662f0 0x7fe4d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:39.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.675+0000 7fe4f659c700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe4d80662f0 0x7fe4d80687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8005150 tx=0x7fe4e8007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:39.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.679+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe4f8071240 con 0x7fe4f81603d0 2023-07-21T19:08:39.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.851+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4f80c6cd0 con 0x7fe4f81603d0 2023-07-21T19:08:39.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.851+0000 7fe4e6ffd700 1 -- 172.21.15.123:0/115302754 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4f80c6cd0 con 0x7fe4f81603d0 2023-07-21T19:08:39.866 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe4d80662f0 msgr2=0x7fe4d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe4d80662f0 0x7fe4d80687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8005150 tx=0x7fe4e8007ee0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 msgr2=0x7fe4f80b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f80b2880 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000cef0 tx=0x7fe4f000cf20 comp rx=0 tx=0).stop 2023-07-21T19:08:39.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 shutdown_connections 2023-07-21T19:08:39.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe4d80662f0 0x7fe4d80687a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f81603d0 0x7fe4f80b2880 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4f8160000 0x7fe4f80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 --2- 172.21.15.123:0/115302754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4f80cd7f0 0x7fe4f81545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 >> 172.21.15.123:0/115302754 conn(0x7fe4f80afc60 msgr2=0x7fe4f8164500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 shutdown_connections 2023-07-21T19:08:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:39.855+0000 7fe4f759e700 1 -- 172.21.15.123:0/115302754 wait complete. 2023-07-21T19:08:39.890 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:40.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.047+0000 7fdc9acf5700 1 Processor -- start 2023-07-21T19:08:40.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.047+0000 7fdc9acf5700 1 -- start start 2023-07-21T19:08:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc9acf5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940d0920 0x7fdc940b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc9acf5700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc940d21c0 0x7fdc940b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc9acf5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc940af2e0 con 0x7fdc940cf7a0 2023-07-21T19:08:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc9acf5700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940d0030 con 0x7fdc940d21c0 2023-07-21T19:08:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc9acf5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940af5c0 con 0x7fdc940d0920 2023-07-21T19:08:40.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc98a91700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdc940cf7a0 0x7fdc940d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55810/0 (socket says 172.21.15.123:55810) 2023-07-21T19:08:40.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc98a91700 1 -- 172.21.15.123:0/1842209140 learned_addr learned my addr 172.21.15.123:0/1842209140 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:40.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8bfff700 1 --2- 172.21.15.123:0/1842209140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940d0920 0x7fdc940b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc99292700 1 --2- 172.21.15.123:0/1842209140 >> v2:172.21.15.145:3300/0 conn(0x7fdc940d21c0 0x7fdc940b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8b7fe700 1 -- 172.21.15.123:0/1842209140 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455391024 0 0) 0x7fdc940af2e0 con 0x7fdc940cf7a0 2023-07-21T19:08:40.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8b7fe700 1 -- 172.21.15.123:0/1842209140 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc7c0035d0 con 0x7fdc940cf7a0 2023-07-21T19:08:40.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1842209140 >> v2:172.21.15.145:3300/0 conn(0x7fdc940d21c0 msgr2=0x7fdc940b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:40.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8bfff700 1 --2- 172.21.15.123:0/1842209140 >> v2:172.21.15.145:3300/0 conn(0x7fdc940d21c0 0x7fdc940b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1842209140 >> v1:172.21.15.123:6789/0 conn(0x7fdc940cf7a0 legacy=0x7fdc940d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.051+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1842209140 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940af8a0 con 0x7fdc940d0920 2023-07-21T19:08:40.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc8bfff700 1 --2- 172.21.15.123:0/1842209140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940d0920 0x7fdc940b0380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009850 tx=0x7fdc84009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80866fb5f2087a57 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc8b7fe700 1 -- 172.21.15.123:0/1842209140 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84011830 con 0x7fdc940d0920 2023-07-21T19:08:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc8b7fe700 1 -- 172.21.15.123:0/1842209140 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84011990 con 0x7fdc940d0920 2023-07-21T19:08:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc8b7fe700 1 -- 172.21.15.123:0/1842209140 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84011d40 con 0x7fdc940d0920 2023-07-21T19:08:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1842209140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940d0920 msgr2=0x7fdc940b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1842209140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940d0920 0x7fdc940b0380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009850 tx=0x7fdc84009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1842209140 shutdown_connections 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1842209140 >> v2:172.21.15.145:3300/0 conn(0x7fdc940d21c0 0x7fdc940b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1842209140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940d0920 0x7fdc940b0380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1842209140 >> 172.21.15.123:0/1842209140 conn(0x7fdc9409b9c0 msgr2=0x7fdc940d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1842209140 shutdown_connections 2023-07-21T19:08:40.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.055+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1842209140 wait complete. 2023-07-21T19:08:40.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 Processor -- start 2023-07-21T19:08:40.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 -- start start 2023-07-21T19:08:40.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940cf7a0 0x7fdc94159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 0x7fdc9415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc940d21c0 0x7fdc9415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415e710 con 0x7fdc940d0920 2023-07-21T19:08:40.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415db70 con 0x7fdc940d21c0 2023-07-21T19:08:40.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc9acf5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415dde0 con 0x7fdc940cf7a0 2023-07-21T19:08:40.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 0x7fdc9415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 0x7fdc9415edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35670/0 (socket says 172.21.15.123:35670) 2023-07-21T19:08:40.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1054624537 learned_addr learned my addr 172.21.15.123:0/1054624537 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc99292700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc940d21c0 0x7fdc9415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc98a91700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940cf7a0 0x7fdc94159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940cf7a0 msgr2=0x7fdc94159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940cf7a0 0x7fdc94159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc940d21c0 msgr2=0x7fdc9415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.059+0000 7fdc8bfff700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc940d21c0 0x7fdc9415f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc8bfff700 1 -- 172.21.15.123:0/1054624537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840094b0 con 0x7fdc940d0920 2023-07-21T19:08:40.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc99292700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc940d21c0 0x7fdc9415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:40.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc98a91700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940cf7a0 0x7fdc94159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:40.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc8bfff700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 0x7fdc9415edc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdc940af700 tx=0x7fdc84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84004480 con 0x7fdc940d0920 2023-07-21T19:08:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8401f070 con 0x7fdc940d0920 2023-07-21T19:08:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9415e0c0 con 0x7fdc940d0920 2023-07-21T19:08:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840038e0 con 0x7fdc940d0920 2023-07-21T19:08:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9409c4f0 con 0x7fdc940d0920 2023-07-21T19:08:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.063+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9415e880 con 0x7fdc940d0920 2023-07-21T19:08:40.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.067+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc84021030 con 0x7fdc940d0920 2023-07-21T19:08:40.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.067+0000 7fdc897fa700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdc80066320 0x7fdc800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.067+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc84085430 con 0x7fdc940d0920 2023-07-21T19:08:40.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.067+0000 7fdc98a91700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdc80066320 0x7fdc800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.071+0000 7fdc98a91700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdc80066320 0x7fdc800687d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc90001560 tx=0x7fdc90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.071+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdc84052690 con 0x7fdc940d0920 2023-07-21T19:08:40.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.247+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc9404dcb0 con 0x7fdc940d0920 2023-07-21T19:08:40.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.247+0000 7fdc897fa700 1 -- 172.21.15.123:0/1054624537 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc84006ce0 con 0x7fdc940d0920 2023-07-21T19:08:40.261 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdc80066320 msgr2=0x7fdc800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdc80066320 0x7fdc800687d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc90001560 tx=0x7fdc90009040 comp rx=0 tx=0).stop 2023-07-21T19:08:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 msgr2=0x7fdc9415edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 0x7fdc9415edc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdc940af700 tx=0x7fdc84004770 comp rx=0 tx=0).stop 2023-07-21T19:08:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 shutdown_connections 2023-07-21T19:08:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdc80066320 0x7fdc800687d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc940d21c0 0x7fdc9415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc940d0920 0x7fdc9415edc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 --2- 172.21.15.123:0/1054624537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc940cf7a0 0x7fdc94159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 >> 172.21.15.123:0/1054624537 conn(0x7fdc9409b9c0 msgr2=0x7fdc940cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:40.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 shutdown_connections 2023-07-21T19:08:40.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.251+0000 7fdc9acf5700 1 -- 172.21.15.123:0/1054624537 wait complete. 2023-07-21T19:08:40.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.447+0000 7f15ef2c6700 1 Processor -- start 2023-07-21T19:08:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.447+0000 7f15ef2c6700 1 -- start start 2023-07-21T19:08:40.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80d0210 0x7f15e80d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15e80cf000 0x7f15e80cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8071d10 con 0x7f15e80b1c50 2023-07-21T19:08:40.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80cf9c0 con 0x7f15e80cf000 2023-07-21T19:08:40.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e815c420 con 0x7f15e80d0210 2023-07-21T19:08:40.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15e80cf000 0x7f15e80cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15e80cf000 0x7f15e80cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35684/0 (socket says 172.21.15.123:35684) 2023-07-21T19:08:40.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 -- 172.21.15.123:0/3812031788 learned_addr learned my addr 172.21.15.123:0/3812031788 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:40.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ec861700 1 --2- 172.21.15.123:0/3812031788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80d0210 0x7f15e80d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 -- 172.21.15.123:0/3812031788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80d0210 msgr2=0x7f15e80d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 --2- 172.21.15.123:0/3812031788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80d0210 0x7f15e80d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 -- 172.21.15.123:0/3812031788 >> v1:172.21.15.145:6789/0 conn(0x7f15e80b1c50 legacy=0x7f15e8071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 -- 172.21.15.123:0/3812031788 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8070840 con 0x7f15e80cf000 2023-07-21T19:08:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ed863700 1 --2- 172.21.15.123:0/3812031788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80cf000 0x7f15e80cf480 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009e50 tx=0x7f15e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a223a3cd1b3d228 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15dffff700 1 -- 172.21.15.123:0/3812031788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000e070 con 0x7f15e80cf000 2023-07-21T19:08:40.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15dffff700 1 -- 172.21.15.123:0/3812031788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000b910 con 0x7f15e80cf000 2023-07-21T19:08:40.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15dffff700 1 -- 172.21.15.123:0/3812031788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000bcc0 con 0x7f15e80cf000 2023-07-21T19:08:40.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3812031788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80cf000 msgr2=0x7f15e80cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.451+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3812031788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80cf000 0x7f15e80cf480 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009e50 tx=0x7f15e000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:40.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3812031788 shutdown_connections 2023-07-21T19:08:40.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3812031788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80cf000 0x7f15e80cf480 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3812031788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80d0210 0x7f15e80d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3812031788 >> 172.21.15.123:0/3812031788 conn(0x7f15e809b9c0 msgr2=0x7f15e80d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:40.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3812031788 shutdown_connections 2023-07-21T19:08:40.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3812031788 wait complete. 2023-07-21T19:08:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 Processor -- start 2023-07-21T19:08:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.455+0000 7f15ef2c6700 1 -- start start 2023-07-21T19:08:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 0x7f15e81479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80cf000 0x7f15e8147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15e80d0210 0x7f15e81e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81e4f40 con 0x7f15e80b1c50 2023-07-21T19:08:40.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81e5220 con 0x7f15e80d0210 2023-07-21T19:08:40.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81e5500 con 0x7f15e80cf000 2023-07-21T19:08:40.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 0x7f15e81479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 0x7f15e81479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35692/0 (socket says 172.21.15.123:35692) 2023-07-21T19:08:40.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 -- 172.21.15.123:0/3985335943 learned_addr learned my addr 172.21.15.123:0/3985335943 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:40.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ec861700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80cf000 0x7f15e8147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed863700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15e80d0210 0x7f15e81e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 -- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80cf000 msgr2=0x7f15e8147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80cf000 0x7f15e8147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 -- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15e80d0210 msgr2=0x7f15e81e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15e80d0210 0x7f15e81e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 -- 172.21.15.123:0/3985335943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0009b30 con 0x7f15e80b1c50 2023-07-21T19:08:40.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ed062700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 0x7f15e81479e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f15e400c500 tx=0x7f15e400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40052d0 con 0x7f15e80b1c50 2023-07-21T19:08:40.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e4005430 con 0x7f15e80b1c50 2023-07-21T19:08:40.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e81e57e0 con 0x7f15e80b1c50 2023-07-21T19:08:40.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40055a0 con 0x7f15e80b1c50 2023-07-21T19:08:40.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.459+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e81473b0 con 0x7f15e80b1c50 2023-07-21T19:08:40.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.463+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e81e5d00 con 0x7f15e80b1c50 2023-07-21T19:08:40.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.463+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15e40038e0 con 0x7f15e80b1c50 2023-07-21T19:08:40.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.467+0000 7f15ddffb700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f15cc0662f0 0x7f15cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.467+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f15e40830e0 con 0x7f15e80b1c50 2023-07-21T19:08:40.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.467+0000 7f15ec861700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f15cc0662f0 0x7f15cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.467+0000 7f15ec861700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f15cc0662f0 0x7f15cc0687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15e81e4a10 tx=0x7f15d8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.471+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f15e40502c0 con 0x7f15e80b1c50 2023-07-21T19:08:40.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15e8071d10 con 0x7f15e80b1c50 2023-07-21T19:08:40.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ddffb700 1 -- 172.21.15.123:0/3985335943 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15e8071d10 con 0x7f15e80b1c50 2023-07-21T19:08:40.664 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:40.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f15cc0662f0 msgr2=0x7f15cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f15cc0662f0 0x7f15cc0687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15e81e4a10 tx=0x7f15d8009240 comp rx=0 tx=0).stop 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 msgr2=0x7f15e81479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 0x7f15e81479e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f15e400c500 tx=0x7f15e400c810 comp rx=0 tx=0).stop 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 shutdown_connections 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f15cc0662f0 0x7f15cc0687a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15e80d0210 0x7f15e81e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15e80cf000 0x7f15e8147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 --2- 172.21.15.123:0/3985335943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80b1c50 0x7f15e81479e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 >> 172.21.15.123:0/3985335943 conn(0x7f15e809b9c0 msgr2=0x7f15e815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:40.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 shutdown_connections 2023-07-21T19:08:40.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.651+0000 7f15ef2c6700 1 -- 172.21.15.123:0/3985335943 wait complete. 2023-07-21T19:08:40.685 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:40.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.847+0000 7f1282c78700 1 Processor -- start 2023-07-21T19:08:40.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.847+0000 7f1282c78700 1 -- start start 2023-07-21T19:08:40.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1282c78700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f127c0afd80 0x7f127c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1282c78700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0cbed0 con 0x7f127c0ad0f0 2023-07-21T19:08:40.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1282c78700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c071820 con 0x7f127c15c200 2023-07-21T19:08:40.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1282c78700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c0ad760 con 0x7f127c0afd80 2023-07-21T19:08:40.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1281215700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f127c0ad0f0 0x7f127c0cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55824/0 (socket says 172.21.15.123:55824) 2023-07-21T19:08:40.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1281215700 1 -- 172.21.15.123:0/826829517 learned_addr learned my addr 172.21.15.123:0/826829517 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:40.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1280a14700 1 --2- 172.21.15.123:0/826829517 >> v2:172.21.15.145:3300/0 conn(0x7f127c0afd80 0x7f127c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036289340 0 0) 0x7f127c0cbed0 con 0x7f127c0ad0f0 2023-07-21T19:08:40.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f126c0035d0 con 0x7f127c0ad0f0 2023-07-21T19:08:40.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136166334 0 0) 0x7f127c071820 con 0x7f127c15c200 2023-07-21T19:08:40.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f127c0cbed0 con 0x7f127c15c200 2023-07-21T19:08:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1280a14700 1 -- 172.21.15.123:0/826829517 >> v1:172.21.15.145:6789/0 conn(0x7f127c15c200 legacy=0x7f127c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1280a14700 1 -- 172.21.15.123:0/826829517 >> v1:172.21.15.123:6789/0 conn(0x7f127c0ad0f0 legacy=0x7f127c0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4184740404 0 0) 0x7f126c0035d0 con 0x7f127c0ad0f0 2023-07-21T19:08:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1280a14700 1 -- 172.21.15.123:0/826829517 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0ada40 con 0x7f127c0afd80 2023-07-21T19:08:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f1280a14700 1 --2- 172.21.15.123:0/826829517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0afd80 0x7f127c0cb890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1270009850 tx=0x7f1270009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba0eafbd4c4456e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740019f0 con 0x7f127c0afd80 2023-07-21T19:08:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1270004030 con 0x7f127c0afd80 2023-07-21T19:08:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.851+0000 7f127b7fe700 1 -- 172.21.15.123:0/826829517 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12700043c0 con 0x7f127c0afd80 2023-07-21T19:08:40.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 -- 172.21.15.123:0/826829517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0afd80 msgr2=0x7f127c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 --2- 172.21.15.123:0/826829517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0afd80 0x7f127c0cb890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1270009850 tx=0x7f1270009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:40.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 -- 172.21.15.123:0/826829517 shutdown_connections 2023-07-21T19:08:40.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 --2- 172.21.15.123:0/826829517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0afd80 0x7f127c0cb890 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 -- 172.21.15.123:0/826829517 >> 172.21.15.123:0/826829517 conn(0x7f127c0cad80 msgr2=0x7f127c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:40.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 -- 172.21.15.123:0/826829517 shutdown_connections 2023-07-21T19:08:40.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.855+0000 7f1282c78700 1 -- 172.21.15.123:0/826829517 wait complete. 2023-07-21T19:08:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 Processor -- start 2023-07-21T19:08:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 -- start start 2023-07-21T19:08:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0ad0f0 0x7f127c0c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f127c0afd80 0x7f127c160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 0x7f127c14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1482a0 con 0x7f127c15c200 2023-07-21T19:08:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0cf0e0 con 0x7f127c0ad0f0 2023-07-21T19:08:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1282c78700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1484f0 con 0x7f127c0afd80 2023-07-21T19:08:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 0x7f127c14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 0x7f127c14a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35698/0 (socket says 172.21.15.123:35698) 2023-07-21T19:08:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 -- 172.21.15.123:0/2227145589 learned_addr learned my addr 172.21.15.123:0/2227145589 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1280a14700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0ad0f0 0x7f127c0c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f127bfff700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f127c0afd80 0x7f127c160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 -- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f127c0afd80 msgr2=0x7f127c160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f127c0afd80 0x7f127c160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 -- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0ad0f0 msgr2=0x7f127c0c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0ad0f0 0x7f127c0c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.859+0000 7f1281215700 1 -- 172.21.15.123:0/2227145589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700094b0 con 0x7f127c15c200 2023-07-21T19:08:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f1281215700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 0x7f127c14a330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1274001560 tx=0x7f127400cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400aa40 con 0x7f127c15c200 2023-07-21T19:08:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400aba0 con 0x7f127c15c200 2023-07-21T19:08:40.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c1487d0 con 0x7f127c15c200 2023-07-21T19:08:40.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740070d0 con 0x7f127c15c200 2023-07-21T19:08:40.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c15e390 con 0x7f127c15c200 2023-07-21T19:08:40.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.863+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c148cf0 con 0x7f127c15c200 2023-07-21T19:08:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.867+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1274007230 con 0x7f127c15c200 2023-07-21T19:08:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.867+0000 7f12797fa700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12600662f0 0x7f12600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:40.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.867+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12740839c0 con 0x7f127c15c200 2023-07-21T19:08:40.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.867+0000 7f1280a14700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12600662f0 0x7f12600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:40.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.871+0000 7f1280a14700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12600662f0 0x7f12600687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f12700090b0 tx=0x7f1270008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:40.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:40.875+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f127c148cf0 con 0x7f127c15c200 2023-07-21T19:08:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.043+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f127c148cf0 con 0x7f127c15c200 2023-07-21T19:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.043+0000 7f12797fa700 1 -- 172.21.15.123:0/2227145589 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1274018020 con 0x7f127c15c200 2023-07-21T19:08:41.056 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:41.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.043+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12600662f0 msgr2=0x7f12600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.043+0000 7f1282c78700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12600662f0 0x7f12600687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f12700090b0 tx=0x7f1270008030 comp rx=0 tx=0).stop 2023-07-21T19:08:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.043+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 msgr2=0x7f127c14a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.043+0000 7f1282c78700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 0x7f127c14a330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1274001560 tx=0x7f127400cec0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 shutdown_connections 2023-07-21T19:08:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f12600662f0 0x7f12600687a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c15c200 0x7f127c14a330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f127c0afd80 0x7f127c160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 --2- 172.21.15.123:0/2227145589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f127c0ad0f0 0x7f127c0c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 >> 172.21.15.123:0/2227145589 conn(0x7f127c0cad80 msgr2=0x7f127c0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 shutdown_connections 2023-07-21T19:08:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.047+0000 7f1282c78700 1 -- 172.21.15.123:0/2227145589 wait complete. 2023-07-21T19:08:41.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:41.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.235+0000 7fd22db9e700 1 Processor -- start 2023-07-21T19:08:41.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 -- start start 2023-07-21T19:08:41.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd2281599d0 0x7fd228071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd22815ccf0 0x7fd2280c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2280caa20 0x7fd2280cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280cde10 con 0x7fd2280caa20 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280cb3c0 con 0x7fd2281599d0 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22db9e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c8bf0 con 0x7fd22815ccf0 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2280caa20 0x7fd2280cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2280caa20 0x7fd2280cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35700/0 (socket says 172.21.15.123:35700) 2023-07-21T19:08:41.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 -- 172.21.15.123:0/1947446232 learned_addr learned my addr 172.21.15.123:0/1947446232 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22cb9c700 1 --2- 172.21.15.123:0/1947446232 >> v2:172.21.15.145:3300/0 conn(0x7fd2281599d0 0x7fd228071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd21ffff700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd22815ccf0 0x7fd2280c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 -- 172.21.15.123:0/1947446232 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd22815ccf0 msgr2=0x7fd2280c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd22815ccf0 0x7fd2280c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 -- 172.21.15.123:0/1947446232 >> v2:172.21.15.145:3300/0 conn(0x7fd2281599d0 msgr2=0x7fd228071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 --2- 172.21.15.123:0/1947446232 >> v2:172.21.15.145:3300/0 conn(0x7fd2281599d0 0x7fd228071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd22d39d700 1 -- 172.21.15.123:0/1947446232 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280cd520 con 0x7fd2280caa20 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.239+0000 7fd21ffff700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd22815ccf0 0x7fd2280c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22d39d700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2280caa20 0x7fd2280cae80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd2280cf0d0 tx=0x7fd22000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4609580f0a7de1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd21f7fe700 1 -- 172.21.15.123:0/1947446232 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000e070 con 0x7fd2280caa20 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd21f7fe700 1 -- 172.21.15.123:0/1947446232 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b910 con 0x7fd2280caa20 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd21f7fe700 1 -- 172.21.15.123:0/1947446232 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000bcc0 con 0x7fd2280caa20 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 -- 172.21.15.123:0/1947446232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2280caa20 msgr2=0x7fd2280cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2280caa20 0x7fd2280cae80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd2280cf0d0 tx=0x7fd22000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 -- 172.21.15.123:0/1947446232 shutdown_connections 2023-07-21T19:08:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2280caa20 0x7fd2280cae80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1947446232 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd22815ccf0 0x7fd2280c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1947446232 >> v2:172.21.15.145:3300/0 conn(0x7fd2281599d0 0x7fd228071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 -- 172.21.15.123:0/1947446232 >> 172.21.15.123:0/1947446232 conn(0x7fd22806e960 msgr2=0x7fd22806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 -- 172.21.15.123:0/1947446232 shutdown_connections 2023-07-21T19:08:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.243+0000 7fd22db9e700 1 -- 172.21.15.123:0/1947446232 wait complete. 2023-07-21T19:08:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 Processor -- start 2023-07-21T19:08:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 -- start start 2023-07-21T19:08:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280caa20 0x7fd2280c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2281599d0 0x7fd22815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 0x7fd2280b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280b28c0 con 0x7fd22815ccf0 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c13b0 con 0x7fd2281599d0 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22db9e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280b2300 con 0x7fd2280caa20 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 0x7fd2280b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 0x7fd2280b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35710/0 (socket says 172.21.15.123:35710) 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 -- 172.21.15.123:0/1792665580 learned_addr learned my addr 172.21.15.123:0/1792665580 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd21ffff700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2281599d0 0x7fd22815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22cb9c700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280caa20 0x7fd2280c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 -- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280caa20 msgr2=0x7fd2280c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280caa20 0x7fd2280c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 -- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2281599d0 msgr2=0x7fd22815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2281599d0 0x7fd22815b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22d39d700 1 -- 172.21.15.123:0/1792665580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009b30 con 0x7fd22815ccf0 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.247+0000 7fd22cb9c700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280caa20 0x7fd2280c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd22d39d700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 0x7fd2280b0ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd22806a810 tx=0x7fd220004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:41.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200099b0 con 0x7fd22815ccf0 2023-07-21T19:08:41.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220004250 con 0x7fd22815ccf0 2023-07-21T19:08:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220004600 con 0x7fd22815ccf0 2023-07-21T19:08:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2280b25e0 con 0x7fd22815ccf0 2023-07-21T19:08:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280b39e0 con 0x7fd22815ccf0 2023-07-21T19:08:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22804e500 con 0x7fd22815ccf0 2023-07-21T19:08:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.251+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd220004760 con 0x7fd22815ccf0 2023-07-21T19:08:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.255+0000 7fd21d7fa700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2140662f0 0x7fd2140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.255+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd220085160 con 0x7fd22815ccf0 2023-07-21T19:08:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.255+0000 7fd22cb9c700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2140662f0 0x7fd2140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.255+0000 7fd22cb9c700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2140662f0 0x7fd2140687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd224009b20 tx=0x7fd224008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:41.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.259+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd2200522d0 con 0x7fd22815ccf0 2023-07-21T19:08:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.435+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2280b34f0 con 0x7fd22815ccf0 2023-07-21T19:08:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.435+0000 7fd21d7fa700 1 -- 172.21.15.123:0/1792665580 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7fd2200558f0 con 0x7fd22815ccf0 2023-07-21T19:08:41.451 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:41.451 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.439+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2140662f0 msgr2=0x7fd2140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.439+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2140662f0 0x7fd2140687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd224009b20 tx=0x7fd224008040 comp rx=0 tx=0).stop 2023-07-21T19:08:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.439+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 msgr2=0x7fd2280b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.439+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 0x7fd2280b0ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd22806a810 tx=0x7fd220004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 shutdown_connections 2023-07-21T19:08:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd2140662f0 0x7fd2140687a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2281599d0 0x7fd22815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22815ccf0 0x7fd2280b0ef0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 --2- 172.21.15.123:0/1792665580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280caa20 0x7fd2280c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 >> 172.21.15.123:0/1792665580 conn(0x7fd22806e960 msgr2=0x7fd2280cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:41.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 shutdown_connections 2023-07-21T19:08:41.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.443+0000 7fd22db9e700 1 -- 172.21.15.123:0/1792665580 wait complete. 2023-07-21T19:08:41.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:41.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.643+0000 7f3d4755d700 1 Processor -- start 2023-07-21T19:08:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.643+0000 7f3d4755d700 1 -- start start 2023-07-21T19:08:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d4755d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3d400cd260 0x7f3d400d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d4755d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d4755d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400d1a60 con 0x7f3d400b0ee0 2023-07-21T19:08:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d4755d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400d1ef0 con 0x7f3d400cd260 2023-07-21T19:08:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d4755d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400d0e50 con 0x7f3d400d0610 2023-07-21T19:08:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3d400cd260 0x7f3d400d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3d400cd260 0x7f3d400d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:58052/0 (socket says 172.21.15.123:58052) 2023-07-21T19:08:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 -- 172.21.15.123:0/3022951132 learned_addr learned my addr 172.21.15.123:0/3022951132 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:41.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d46d5c700 1 --2- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 -- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 msgr2=0x7f3d400af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:41.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 --2- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 -- 172.21.15.123:0/3022951132 >> v1:172.21.15.145:6789/0 conn(0x7f3d400b0ee0 legacy=0x7f3d400ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45559700 1 -- 172.21.15.123:0/3022951132 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638855925 0 0) 0x7f3d400d1a60 con 0x7f3d400b0ee0 2023-07-21T19:08:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 -- 172.21.15.123:0/3022951132 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400d1130 con 0x7f3d400cd260 2023-07-21T19:08:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.647+0000 7f3d45d5a700 1 --2- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400cd260 0x7f3d400d00d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009910 tx=0x7f3d30009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e13a5bc9f7fbb44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d45559700 1 -- 172.21.15.123:0/3022951132 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30011830 con 0x7f3d400cd260 2023-07-21T19:08:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d45559700 1 -- 172.21.15.123:0/3022951132 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30011990 con 0x7f3d400cd260 2023-07-21T19:08:41.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d45559700 1 -- 172.21.15.123:0/3022951132 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30011d40 con 0x7f3d400cd260 2023-07-21T19:08:41.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 -- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400cd260 msgr2=0x7f3d400d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 --2- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400cd260 0x7f3d400d00d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009910 tx=0x7f3d30009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:41.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 -- 172.21.15.123:0/3022951132 shutdown_connections 2023-07-21T19:08:41.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 --2- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 --2- 172.21.15.123:0/3022951132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400cd260 0x7f3d400d00d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 -- 172.21.15.123:0/3022951132 >> 172.21.15.123:0/3022951132 conn(0x7f3d40060c40 msgr2=0x7f3d4009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:41.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 -- 172.21.15.123:0/3022951132 shutdown_connections 2023-07-21T19:08:41.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.651+0000 7f3d4755d700 1 -- 172.21.15.123:0/3022951132 wait complete. 2023-07-21T19:08:41.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 Processor -- start 2023-07-21T19:08:41.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 -- start start 2023-07-21T19:08:41.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400b0ee0 0x7f3d400b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 0x7f3d4015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400b35d0 con 0x7f3d400cd260 2023-07-21T19:08:41.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4015ab10 con 0x7f3d400b0ee0 2023-07-21T19:08:41.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400b1ff0 con 0x7f3d400d0610 2023-07-21T19:08:41.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 0x7f3d4015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 0x7f3d4015a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35718/0 (socket says 172.21.15.123:35718) 2023-07-21T19:08:41.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 -- 172.21.15.123:0/2259752235 learned_addr learned my addr 172.21.15.123:0/2259752235 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:41.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d46d5c700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4655b700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400b0ee0 0x7f3d400b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 -- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 msgr2=0x7f3d400cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 -- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400b0ee0 msgr2=0x7f3d400b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400b0ee0 0x7f3d400b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 -- 172.21.15.123:0/2259752235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d30009570 con 0x7f3d400cd260 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4655b700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400b0ee0 0x7f3d400b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d46d5c700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d45d5a700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 0x7f3d4015a5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d30014040 tx=0x7f3d30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000ba70 con 0x7f3d400cd260 2023-07-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3001e070 con 0x7f3d400cd260 2023-07-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000be50 con 0x7f3d400cd260 2023-07-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.655+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d400b22d0 con 0x7f3d400cd260 2023-07-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.659+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d400b2890 con 0x7f3d400cd260 2023-07-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.659+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4004e500 con 0x7f3d400cd260 2023-07-21T19:08:41.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.659+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d3002d450 con 0x7f3d400cd260 2023-07-21T19:08:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.663+0000 7f3d36ffd700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3d240662f0 0x7f3d240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.663+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d30085180 con 0x7f3d400cd260 2023-07-21T19:08:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.663+0000 7f3d4655b700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3d240662f0 0x7f3d240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.663+0000 7f3d4655b700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3d240662f0 0x7f3d240687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c000f60 tx=0x7f3d3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:41.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.667+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3d30052230 con 0x7f3d400cd260 2023-07-21T19:08:41.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.843+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d400cec10 con 0x7f3d400cd260 2023-07-21T19:08:41.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.843+0000 7f3d36ffd700 1 -- 172.21.15.123:0/2259752235 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d30055850 con 0x7f3d400cd260 2023-07-21T19:08:41.857 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:41.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3d240662f0 msgr2=0x7f3d240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3d240662f0 0x7f3d240687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c000f60 tx=0x7f3d3c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:41.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 msgr2=0x7f3d4015a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:41.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 0x7f3d4015a5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d30014040 tx=0x7f3d30004770 comp rx=0 tx=0).stop 2023-07-21T19:08:41.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 shutdown_connections 2023-07-21T19:08:41.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3d240662f0 0x7f3d240687a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3d400d0610 0x7f3d400cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d400cd260 0x7f3d4015a5d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 --2- 172.21.15.123:0/2259752235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d400b0ee0 0x7f3d400b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:41.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 >> 172.21.15.123:0/2259752235 conn(0x7f3d40060c40 msgr2=0x7f3d400b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:41.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 shutdown_connections 2023-07-21T19:08:41.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:41.847+0000 7f3d4755d700 1 -- 172.21.15.123:0/2259752235 wait complete. 2023-07-21T19:08:41.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:42.063 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 Processor -- start 2023-07-21T19:08:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 -- start start 2023-07-21T19:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1214160240 0x7f12140cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1214160610 0x7f12140ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1214163fe0 con 0x7f12140afd80 2023-07-21T19:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140c8c30 con 0x7f1214160240 2023-07-21T19:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121c1ed700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140ca9e0 con 0x7f1214160610 2023-07-21T19:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121a78a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f12140afd80 0x7f12140b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55830/0 (socket says 172.21.15.123:55830) 2023-07-21T19:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.051+0000 7f121a78a700 1 -- 172.21.15.123:0/32542944 learned_addr learned my addr 172.21.15.123:0/32542944 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219f89700 1 --2- 172.21.15.123:0/32542944 >> v2:172.21.15.123:3300/0 conn(0x7f1214160240 0x7f12140cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219788700 1 --2- 172.21.15.123:0/32542944 >> v2:172.21.15.145:3300/0 conn(0x7f1214160610 0x7f12140ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1218f87700 1 -- 172.21.15.123:0/32542944 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718348948 0 0) 0x7f1214163fe0 con 0x7f12140afd80 2023-07-21T19:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1218f87700 1 -- 172.21.15.123:0/32542944 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12000035d0 con 0x7f12140afd80 2023-07-21T19:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219f89700 1 -- 172.21.15.123:0/32542944 >> v2:172.21.15.145:3300/0 conn(0x7f1214160610 msgr2=0x7f12140ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:42.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219f89700 1 --2- 172.21.15.123:0/32542944 >> v2:172.21.15.145:3300/0 conn(0x7f1214160610 0x7f12140ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219f89700 1 -- 172.21.15.123:0/32542944 >> v1:172.21.15.123:6789/0 conn(0x7f12140afd80 legacy=0x7f12140b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219f89700 1 -- 172.21.15.123:0/32542944 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214164230 con 0x7f1214160240 2023-07-21T19:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1219f89700 1 --2- 172.21.15.123:0/32542944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f12140cdc20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f121406e390 tx=0x7f1210009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4ee4694bb42d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1218f87700 1 -- 172.21.15.123:0/32542944 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210011830 con 0x7f1214160240 2023-07-21T19:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1218f87700 1 -- 172.21.15.123:0/32542944 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210011990 con 0x7f1214160240 2023-07-21T19:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f1218f87700 1 -- 172.21.15.123:0/32542944 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210011d20 con 0x7f1214160240 2023-07-21T19:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 -- 172.21.15.123:0/32542944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 msgr2=0x7f12140cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 --2- 172.21.15.123:0/32542944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f12140cdc20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f121406e390 tx=0x7f1210009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 -- 172.21.15.123:0/32542944 shutdown_connections 2023-07-21T19:08:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 --2- 172.21.15.123:0/32542944 >> v2:172.21.15.145:3300/0 conn(0x7f1214160610 0x7f12140ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 --2- 172.21.15.123:0/32542944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f12140cdc20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 -- 172.21.15.123:0/32542944 >> 172.21.15.123:0/32542944 conn(0x7f12140cad80 msgr2=0x7f12140cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 -- 172.21.15.123:0/32542944 shutdown_connections 2023-07-21T19:08:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.055+0000 7f121c1ed700 1 -- 172.21.15.123:0/32542944 wait complete. 2023-07-21T19:08:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.059+0000 7f121c1ed700 1 Processor -- start 2023-07-21T19:08:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.059+0000 7f121c1ed700 1 -- start start 2023-07-21T19:08:42.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12140afd80 0x7f12140b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f121415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1214160610 0x7f12140c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121415a9e0 con 0x7f1214160240 2023-07-21T19:08:42.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c6270 con 0x7f1214160610 2023-07-21T19:08:42.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c6550 con 0x7f12140afd80 2023-07-21T19:08:42.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f121415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f121415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35732/0 (socket says 172.21.15.123:35732) 2023-07-21T19:08:42.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 -- 172.21.15.123:0/4146124358 learned_addr learned my addr 172.21.15.123:0/4146124358 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219f89700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12140afd80 0x7f12140b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121a78a700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1214160610 0x7f12140c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 -- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12140afd80 msgr2=0x7f12140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12140afd80 0x7f12140b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 -- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1214160610 msgr2=0x7f12140c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1214160610 0x7f12140c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 -- 172.21.15.123:0/4146124358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100094b0 con 0x7f1214160240 2023-07-21T19:08:42.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121a78a700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1214160610 0x7f12140c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:42.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f1219788700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f121415a4a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f120400e9d0 tx=0x7f120400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204009720 con 0x7f1214160240 2023-07-21T19:08:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120400c850 con 0x7f1214160240 2023-07-21T19:08:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140c6830 con 0x7f1214160240 2023-07-21T19:08:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400cbc0 con 0x7f1214160240 2023-07-21T19:08:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.063+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12140c6df0 con 0x7f1214160240 2023-07-21T19:08:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.067+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1214072e10 con 0x7f1214160240 2023-07-21T19:08:42.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.067+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f120400cd20 con 0x7f1214160240 2023-07-21T19:08:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.067+0000 7f120a7fc700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11f80662f0 0x7f11f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.067+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12040841a0 con 0x7f1214160240 2023-07-21T19:08:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.067+0000 7f1219f89700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11f80662f0 0x7f11f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.071+0000 7f1219f89700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11f80662f0 0x7f11f80687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1210000c00 tx=0x7f1210008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.075+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1204054d80 con 0x7f1214160240 2023-07-21T19:08:42.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.247+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f121406d2d0 con 0x7f1214160240 2023-07-21T19:08:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f120a7fc700 1 -- 172.21.15.123:0/4146124358 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1204054910 con 0x7f1214160240 2023-07-21T19:08:42.263 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11f80662f0 msgr2=0x7f11f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11f80662f0 0x7f11f80687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1210000c00 tx=0x7f1210008030 comp rx=0 tx=0).stop 2023-07-21T19:08:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 msgr2=0x7f121415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f121415a4a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f120400e9d0 tx=0x7f120400ed90 comp rx=0 tx=0).stop 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 shutdown_connections 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11f80662f0 0x7f11f80687a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1214160610 0x7f12140c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1214160240 0x7f121415a4a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 --2- 172.21.15.123:0/4146124358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12140afd80 0x7f12140b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 >> 172.21.15.123:0/4146124358 conn(0x7f12140cad80 msgr2=0x7f1214071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 shutdown_connections 2023-07-21T19:08:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.251+0000 7f121c1ed700 1 -- 172.21.15.123:0/4146124358 wait complete. 2023-07-21T19:08:42.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 Processor -- start 2023-07-21T19:08:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 -- start start 2023-07-21T19:08:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43780afd80 0x7f437815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43780c9290 con 0x7f437815df10 2023-07-21T19:08:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437815e830 con 0x7f43780afd80 2023-07-21T19:08:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f437d5c1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4378070a30 con 0x7f43780c8950 2023-07-21T19:08:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f43767fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43780afd80 0x7f437815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f43767fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43780afd80 0x7f437815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36338/0 (socket says 172.21.15.123:36338) 2023-07-21T19:08:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.451+0000 7f43767fc700 1 -- 172.21.15.123:0/914102832 learned_addr learned my addr 172.21.15.123:0/914102832 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f43777fe700 1 --2- 172.21.15.123:0/914102832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f43767fc700 1 -- 172.21.15.123:0/914102832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 msgr2=0x7f43780c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f43767fc700 1 --2- 172.21.15.123:0/914102832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f43767fc700 1 -- 172.21.15.123:0/914102832 >> v1:172.21.15.145:6789/0 conn(0x7f437815df10 legacy=0x7f43780711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f43767fc700 1 -- 172.21.15.123:0/914102832 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43780b0210 con 0x7f43780afd80 2023-07-21T19:08:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f43767fc700 1 --2- 172.21.15.123:0/914102832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f437815e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f436c009910 tx=0x7f436c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3837e3a8d9d2153 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f4375ffb700 1 -- 172.21.15.123:0/914102832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00ba60 con 0x7f43780afd80 2023-07-21T19:08:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f4375ffb700 1 -- 172.21.15.123:0/914102832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00bbc0 con 0x7f43780afd80 2023-07-21T19:08:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f4375ffb700 1 -- 172.21.15.123:0/914102832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c009e60 con 0x7f43780afd80 2023-07-21T19:08:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 -- 172.21.15.123:0/914102832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 msgr2=0x7f437815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 --2- 172.21.15.123:0/914102832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f437815e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f436c009910 tx=0x7f436c009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 -- 172.21.15.123:0/914102832 shutdown_connections 2023-07-21T19:08:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 --2- 172.21.15.123:0/914102832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 --2- 172.21.15.123:0/914102832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f437815e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 -- 172.21.15.123:0/914102832 >> 172.21.15.123:0/914102832 conn(0x7f43780cad80 msgr2=0x7f43780cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 -- 172.21.15.123:0/914102832 shutdown_connections 2023-07-21T19:08:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.455+0000 7f437d5c1700 1 -- 172.21.15.123:0/914102832 wait complete. 2023-07-21T19:08:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 Processor -- start 2023-07-21T19:08:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 -- start start 2023-07-21T19:08:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f43780c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f437806d9b0 0x7f437814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4378158da0 con 0x7f43780afd80 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43780c7280 con 0x7f437806d9b0 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.459+0000 7f437d5c1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43780c7560 con 0x7f43780c8950 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f43780c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f43780c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36354/0 (socket says 172.21.15.123:36354) 2023-07-21T19:08:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 -- 172.21.15.123:0/1247889403 learned_addr learned my addr 172.21.15.123:0/1247889403 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f43767fc700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f43777fe700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f437806d9b0 0x7f437814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 -- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 msgr2=0x7f43780a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780a7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 -- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f437806d9b0 msgr2=0x7f437814d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f437806d9b0 0x7f437814d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 -- 172.21.15.123:0/1247889403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c009570 con 0x7f43780afd80 2023-07-21T19:08:42.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f43767fc700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:42.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f43777fe700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f437806d9b0 0x7f437814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:42.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f4376ffd700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f43780c8320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f436800c500 tx=0x7f436800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680052d0 con 0x7f43780afd80 2023-07-21T19:08:42.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368005430 con 0x7f43780afd80 2023-07-21T19:08:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680055a0 con 0x7f43780afd80 2023-07-21T19:08:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43780c7840 con 0x7f43780afd80 2023-07-21T19:08:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43780c7e00 con 0x7f43780afd80 2023-07-21T19:08:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.463+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43780c8020 con 0x7f43780afd80 2023-07-21T19:08:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.467+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43680038e0 con 0x7f43780afd80 2023-07-21T19:08:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.467+0000 7f435f7fe700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f43640662f0 0x7f43640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.467+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4368083460 con 0x7f43780afd80 2023-07-21T19:08:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.467+0000 7f43767fc700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f43640662f0 0x7f43640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.467+0000 7f43767fc700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f43640662f0 0x7f43640687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f437815e770 tx=0x7f436c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.475+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4368050510 con 0x7f43780afd80 2023-07-21T19:08:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.643+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43780c9290 con 0x7f43780afd80 2023-07-21T19:08:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.643+0000 7f435f7fe700 1 -- 172.21.15.123:0/1247889403 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43780c9290 con 0x7f43780afd80 2023-07-21T19:08:42.659 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f43640662f0 msgr2=0x7f43640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f43640662f0 0x7f43640687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f437815e770 tx=0x7f436c008030 comp rx=0 tx=0).stop 2023-07-21T19:08:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 msgr2=0x7f43780c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f43780c8320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f436800c500 tx=0x7f436800c8c0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 shutdown_connections 2023-07-21T19:08:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f43640662f0 0x7f43640687a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f437806d9b0 0x7f437814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f43780c8950 0x7f43780a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 --2- 172.21.15.123:0/1247889403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43780afd80 0x7f43780c8320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 >> 172.21.15.123:0/1247889403 conn(0x7f43780cad80 msgr2=0x7f43780b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 shutdown_connections 2023-07-21T19:08:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.647+0000 7f437d5c1700 1 -- 172.21.15.123:0/1247889403 wait complete. 2023-07-21T19:08:42.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:42.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.859+0000 7fa4bd5d9700 1 Processor -- start 2023-07-21T19:08:42.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.859+0000 7fa4bd5d9700 1 -- start start 2023-07-21T19:08:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bd5d9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b80b0ee0 0x7fa4b80ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bd5d9700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa4b80cd090 0x7fa4b80d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bd5d9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80d0610 0x7fa4b815f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bd5d9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80cd4e0 con 0x7fa4b80b0ee0 2023-07-21T19:08:42.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bd5d9700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80d1a60 con 0x7fa4b80cd090 2023-07-21T19:08:42.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bd5d9700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80d1ef0 con 0x7fa4b80d0610 2023-07-21T19:08:42.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b80b0ee0 0x7fa4b80ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b80b0ee0 0x7fa4b80ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36362/0 (socket says 172.21.15.123:36362) 2023-07-21T19:08:42.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 -- 172.21.15.123:0/2141906936 learned_addr learned my addr 172.21.15.123:0/2141906936 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:42.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b77fe700 1 --2- 172.21.15.123:0/2141906936 >> v2:172.21.15.145:3300/0 conn(0x7fa4b80cd090 0x7fa4b80d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bcdd8700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80d0610 0x7fa4b815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 -- 172.21.15.123:0/2141906936 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80d0610 msgr2=0x7fa4b815f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:42.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80d0610 0x7fa4b815f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 -- 172.21.15.123:0/2141906936 >> v2:172.21.15.145:3300/0 conn(0x7fa4b80cd090 msgr2=0x7fa4b80d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:42.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 --2- 172.21.15.123:0/2141906936 >> v2:172.21.15.145:3300/0 conn(0x7fa4b80cd090 0x7fa4b80d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 -- 172.21.15.123:0/2141906936 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80d0e50 con 0x7fa4b80b0ee0 2023-07-21T19:08:42.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4bcdd8700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80d0610 0x7fa4b815f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:42.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b7fff700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80b0ee0 0x7fa4b80ccb50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80b5090 tx=0x7fa4a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d03d6f29a2db3e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b6ffd700 1 -- 172.21.15.123:0/2141906936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8011830 con 0x7fa4b80b0ee0 2023-07-21T19:08:42.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b6ffd700 1 -- 172.21.15.123:0/2141906936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8011990 con 0x7fa4b80b0ee0 2023-07-21T19:08:42.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.863+0000 7fa4b6ffd700 1 -- 172.21.15.123:0/2141906936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8011d20 con 0x7fa4b80b0ee0 2023-07-21T19:08:42.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/2141906936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80b0ee0 msgr2=0x7fa4b80ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80b0ee0 0x7fa4b80ccb50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80b5090 tx=0x7fa4a8009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/2141906936 shutdown_connections 2023-07-21T19:08:42.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80d0610 0x7fa4b815f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/2141906936 >> v2:172.21.15.145:3300/0 conn(0x7fa4b80cd090 0x7fa4b80d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/2141906936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80b0ee0 0x7fa4b80ccb50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/2141906936 >> 172.21.15.123:0/2141906936 conn(0x7fa4b8060c40 msgr2=0x7fa4b809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:42.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/2141906936 shutdown_connections 2023-07-21T19:08:42.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/2141906936 wait complete. 2023-07-21T19:08:42.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 Processor -- start 2023-07-21T19:08:42.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.867+0000 7fa4bd5d9700 1 -- start start 2023-07-21T19:08:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80b0ee0 0x7fa4b815ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 0x7fa4b815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b80d0610 0x7fa4b81f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b815d210 con 0x7fa4b80cd090 2023-07-21T19:08:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b815ca50 con 0x7fa4b80d0610 2023-07-21T19:08:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81600e0 con 0x7fa4b80b0ee0 2023-07-21T19:08:42.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 0x7fa4b815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 0x7fa4b815aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36372/0 (socket says 172.21.15.123:36372) 2023-07-21T19:08:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 -- 172.21.15.123:0/426960897 learned_addr learned my addr 172.21.15.123:0/426960897 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b7fff700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80b0ee0 0x7fa4b815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bcdd8700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b80d0610 0x7fa4b81f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 -- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80b0ee0 msgr2=0x7fa4b815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80b0ee0 0x7fa4b815ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 -- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b80d0610 msgr2=0x7fa4b81f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b80d0610 0x7fa4b81f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 -- 172.21.15.123:0/426960897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8009570 con 0x7fa4b80cd090 2023-07-21T19:08:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b77fe700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 0x7fa4b815aa20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00e7c0 tx=0x7fa4ac00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac013680 con 0x7fa4b80cd090 2023-07-21T19:08:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac0137e0 con 0x7fa4b80cd090 2023-07-21T19:08:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac013b90 con 0x7fa4b80cd090 2023-07-21T19:08:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b815c490 con 0x7fa4b80cd090 2023-07-21T19:08:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.871+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b8160380 con 0x7fa4b80cd090 2023-07-21T19:08:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.875+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b804e500 con 0x7fa4b80cd090 2023-07-21T19:08:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.875+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4ac013cf0 con 0x7fa4b80cd090 2023-07-21T19:08:42.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.875+0000 7fa4b4ff9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a40662f0 0x7fa4a40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.879+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa4ac083e70 con 0x7fa4b80cd090 2023-07-21T19:08:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.879+0000 7fa4b7fff700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a40662f0 0x7fa4a40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.879+0000 7fa4b7fff700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a40662f0 0x7fa4a40687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000c00 tx=0x7fa4a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:42.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:42.883+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa4ac050fb0 con 0x7fa4b80cd090 2023-07-21T19:08:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.055+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4b80cf1c0 con 0x7fa4b80cd090 2023-07-21T19:08:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.055+0000 7fa4b4ff9700 1 -- 172.21.15.123:0/426960897 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4ac0170a0 con 0x7fa4b80cd090 2023-07-21T19:08:43.070 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a40662f0 msgr2=0x7fa4a40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a40662f0 0x7fa4a40687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000c00 tx=0x7fa4a8008030 comp rx=0 tx=0).stop 2023-07-21T19:08:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 msgr2=0x7fa4b815aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 0x7fa4b815aa20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00e7c0 tx=0x7fa4ac00ead0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 shutdown_connections 2023-07-21T19:08:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a40662f0 0x7fa4a40687a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4b80d0610 0x7fa4b81f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b80cd090 0x7fa4b815aa20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 --2- 172.21.15.123:0/426960897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4b80b0ee0 0x7fa4b815ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.059+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 >> 172.21.15.123:0/426960897 conn(0x7fa4b8060c40 msgr2=0x7fa4b80af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.063+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 shutdown_connections 2023-07-21T19:08:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.063+0000 7fa4bd5d9700 1 -- 172.21.15.123:0/426960897 wait complete. 2023-07-21T19:08:43.097 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.267+0000 7f07a87a0700 1 Processor -- start 2023-07-21T19:08:43.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.267+0000 7f07a87a0700 1 -- start start 2023-07-21T19:08:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f07a0160240 0x7f07a00cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07a00b0490 0x7f07a00ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a0163fe0 con 0x7f07a0160610 2023-07-21T19:08:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00c8c30 con 0x7f07a00b0490 2023-07-21T19:08:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00ca9e0 con 0x7f07a0160240 2023-07-21T19:08:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a5d3b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f07a0160610 0x7f07a00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52096/0 (socket says 172.21.15.123:52096) 2023-07-21T19:08:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a5d3b700 1 -- 172.21.15.123:0/71281745 learned_addr learned my addr 172.21.15.123:0/71281745 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a6d3d700 1 --2- 172.21.15.123:0/71281745 >> v2:172.21.15.123:3300/0 conn(0x7f07a00b0490 0x7f07a00ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a653c700 1 --2- 172.21.15.123:0/71281745 >> v2:172.21.15.145:3300/0 conn(0x7f07a0160240 0x7f07a00cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a553a700 1 -- 172.21.15.123:0/71281745 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742484950 0 0) 0x7f07a0163fe0 con 0x7f07a0160610 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a553a700 1 -- 172.21.15.123:0/71281745 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c0035d0 con 0x7f07a0160610 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a6d3d700 1 -- 172.21.15.123:0/71281745 >> v2:172.21.15.145:3300/0 conn(0x7f07a0160240 msgr2=0x7f07a00cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a6d3d700 1 --2- 172.21.15.123:0/71281745 >> v2:172.21.15.145:3300/0 conn(0x7f07a0160240 0x7f07a00cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a553a700 1 -- 172.21.15.123:0/71281745 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876683673 0 0) 0x7f078c0035d0 con 0x7f07a0160610 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a6d3d700 1 -- 172.21.15.123:0/71281745 >> v1:172.21.15.123:6789/0 conn(0x7f07a0160610 legacy=0x7f07a00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a6d3d700 1 -- 172.21.15.123:0/71281745 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0164230 con 0x7f07a00b0490 2023-07-21T19:08:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a6d3d700 1 --2- 172.21.15.123:0/71281745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a00b0490 0x7f07a00ca320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07a0061170 tx=0x7f0798009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9aba83b22c379f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a553a700 1 -- 172.21.15.123:0/71281745 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790001670 con 0x7f07a00b0490 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a553a700 1 -- 172.21.15.123:0/71281745 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798004030 con 0x7f07a00b0490 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a553a700 1 -- 172.21.15.123:0/71281745 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980043c0 con 0x7f07a00b0490 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 -- 172.21.15.123:0/71281745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a00b0490 msgr2=0x7f07a00ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 --2- 172.21.15.123:0/71281745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a00b0490 0x7f07a00ca320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07a0061170 tx=0x7f0798009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 -- 172.21.15.123:0/71281745 shutdown_connections 2023-07-21T19:08:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 --2- 172.21.15.123:0/71281745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a00b0490 0x7f07a00ca320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 --2- 172.21.15.123:0/71281745 >> v2:172.21.15.145:3300/0 conn(0x7f07a0160240 0x7f07a00cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.271+0000 7f07a87a0700 1 -- 172.21.15.123:0/71281745 >> 172.21.15.123:0/71281745 conn(0x7f07a00cad80 msgr2=0x7f07a00cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:43.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 -- 172.21.15.123:0/71281745 shutdown_connections 2023-07-21T19:08:43.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 -- 172.21.15.123:0/71281745 wait complete. 2023-07-21T19:08:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 Processor -- start 2023-07-21T19:08:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 -- start start 2023-07-21T19:08:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07a00b0490 0x7f07a00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07a0160240 0x7f07a00b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 0x7f07a00c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a015d130 con 0x7f07a0160610 2023-07-21T19:08:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00c4b30 con 0x7f07a00b0490 2023-07-21T19:08:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a87a0700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00c8270 con 0x7f07a0160240 2023-07-21T19:08:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a6d3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 0x7f07a00c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a6d3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 0x7f07a00c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36388/0 (socket says 172.21.15.123:36388) 2023-07-21T19:08:43.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a653c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07a00b0490 0x7f07a00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a6d3d700 1 -- 172.21.15.123:0/159944618 learned_addr learned my addr 172.21.15.123:0/159944618 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:43.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.275+0000 7f07a5d3b700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07a0160240 0x7f07a00b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a6d3d700 1 -- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07a0160240 msgr2=0x7f07a00b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a6d3d700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07a0160240 0x7f07a00b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a6d3d700 1 -- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07a00b0490 msgr2=0x7f07a00b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a6d3d700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07a00b0490 0x7f07a00b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a6d3d700 1 -- 172.21.15.123:0/159944618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07980094b0 con 0x7f07a0160610 2023-07-21T19:08:43.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a6d3d700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 0x7f07a00c53d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0798009b70 tx=0x7f0798004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:43.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980039c0 con 0x7f07a0160610 2023-07-21T19:08:43.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a00c4200 con 0x7f07a0160610 2023-07-21T19:08:43.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079801f070 con 0x7f07a0160610 2023-07-21T19:08:43.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798003d80 con 0x7f07a0160610 2023-07-21T19:08:43.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a00c47c0 con 0x7f07a0160610 2023-07-21T19:08:43.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.279+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a004dcb0 con 0x7f07a0160610 2023-07-21T19:08:43.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.283+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0798021030 con 0x7f07a0160610 2023-07-21T19:08:43.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.283+0000 7f0796ffd700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07840662f0 0x7f07840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.283+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0798085180 con 0x7f07a0160610 2023-07-21T19:08:43.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.283+0000 7f07a653c700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07840662f0 0x7f07840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.287+0000 7f07a653c700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07840662f0 0x7f07840687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f079c0113e0 tx=0x7f079c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:43.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.287+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0798052480 con 0x7f07a0160610 2023-07-21T19:08:43.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.463+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f07a01647c0 con 0x7f07a0160610 2023-07-21T19:08:43.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.463+0000 7f0796ffd700 1 -- 172.21.15.123:0/159944618 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0798055aa0 con 0x7f07a0160610 2023-07-21T19:08:43.478 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:43.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07840662f0 msgr2=0x7f07840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07840662f0 0x7f07840687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f079c0113e0 tx=0x7f079c00b040 comp rx=0 tx=0).stop 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 msgr2=0x7f07a00c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 0x7f07a00c53d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0798009b70 tx=0x7f0798004770 comp rx=0 tx=0).stop 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 shutdown_connections 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07840662f0 0x7f07840687a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a0160610 0x7f07a00c53d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07a0160240 0x7f07a00b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 --2- 172.21.15.123:0/159944618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07a00b0490 0x7f07a00b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 >> 172.21.15.123:0/159944618 conn(0x7f07a00cad80 msgr2=0x7f07a006d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:43.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 shutdown_connections 2023-07-21T19:08:43.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.467+0000 7f07a87a0700 1 -- 172.21.15.123:0/159944618 wait complete. 2023-07-21T19:08:43.502 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.659+0000 7fef1b5ae700 1 Processor -- start 2023-07-21T19:08:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.663+0000 7fef1b5ae700 1 -- start start 2023-07-21T19:08:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.663+0000 7fef1b5ae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef140d1430 0x7fef140b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.663+0000 7fef1b5ae700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1415c2f0 con 0x7fef140b1530 2023-07-21T19:08:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.663+0000 7fef1b5ae700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef14070830 con 0x7fef1415bf20 2023-07-21T19:08:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.663+0000 7fef1b5ae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef140d1830 con 0x7fef140d1430 2023-07-21T19:08:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef140d1430 0x7fef140b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef140d1430 0x7fef140b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36392/0 (socket says 172.21.15.123:36392) 2023-07-21T19:08:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 -- 172.21.15.123:0/3274752087 learned_addr learned my addr 172.21.15.123:0/3274752087 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 -- 172.21.15.123:0/3274752087 >> v1:172.21.15.145:6789/0 conn(0x7fef1415bf20 legacy=0x7fef140b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 -- 172.21.15.123:0/3274752087 >> v1:172.21.15.123:6789/0 conn(0x7fef140b1530 legacy=0x7fef140d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 -- 172.21.15.123:0/3274752087 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14070b10 con 0x7fef140d1430 2023-07-21T19:08:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef19b4b700 1 --2- 172.21.15.123:0/3274752087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140d1430 0x7fef140b4050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009e50 tx=0x7fef0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986ec1df3d3bd102 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef0bfff700 1 -- 172.21.15.123:0/3274752087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00e070 con 0x7fef140d1430 2023-07-21T19:08:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef0bfff700 1 -- 172.21.15.123:0/3274752087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c00b9c0 con 0x7fef140d1430 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef0bfff700 1 -- 172.21.15.123:0/3274752087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00bd70 con 0x7fef140d1430 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 -- 172.21.15.123:0/3274752087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140d1430 msgr2=0x7fef140b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/3274752087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140d1430 0x7fef140b4050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009e50 tx=0x7fef0c00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 -- 172.21.15.123:0/3274752087 shutdown_connections 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/3274752087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140d1430 0x7fef140b4050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 -- 172.21.15.123:0/3274752087 >> 172.21.15.123:0/3274752087 conn(0x7fef1406fc80 msgr2=0x7fef14070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 -- 172.21.15.123:0/3274752087 shutdown_connections 2023-07-21T19:08:43.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.667+0000 7fef1b5ae700 1 -- 172.21.15.123:0/3274752087 wait complete. 2023-07-21T19:08:43.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.671+0000 7fef1b5ae700 1 Processor -- start 2023-07-21T19:08:43.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.671+0000 7fef1b5ae700 1 -- start start 2023-07-21T19:08:43.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 0x7fef14150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef140d1430 0x7fef1415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef1415bf20 0x7fef1415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1415f400 con 0x7fef140b1530 2023-07-21T19:08:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef140cbce0 con 0x7fef140d1430 2023-07-21T19:08:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef140cb440 con 0x7fef1415bf20 2023-07-21T19:08:43.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 0x7fef14150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 0x7fef14150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36394/0 (socket says 172.21.15.123:36394) 2023-07-21T19:08:43.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 -- 172.21.15.123:0/537814221 learned_addr learned my addr 172.21.15.123:0/537814221 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:43.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef18b49700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef140d1430 0x7fef1415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef19b4b700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef1415bf20 0x7fef1415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 -- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef1415bf20 msgr2=0x7fef1415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef1415bf20 0x7fef1415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 -- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef140d1430 msgr2=0x7fef1415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef140d1430 0x7fef1415c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 -- 172.21.15.123:0/537814221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c009b30 con 0x7fef140b1530 2023-07-21T19:08:43.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1934a700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 0x7fef14150e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c530 tx=0x7fef1000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:43.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100052d0 con 0x7fef140b1530 2023-07-21T19:08:43.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10005430 con 0x7fef140b1530 2023-07-21T19:08:43.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100055a0 con 0x7fef140b1530 2023-07-21T19:08:43.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef140cb720 con 0x7fef140b1530 2023-07-21T19:08:43.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.675+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef140b25b0 con 0x7fef140b1530 2023-07-21T19:08:43.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.679+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1404dcb0 con 0x7fef140b1530 2023-07-21T19:08:43.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.679+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef100038e0 con 0x7fef140b1530 2023-07-21T19:08:43.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.679+0000 7fef09ffb700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feef80662f0 0x7feef80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:43.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.683+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fef10083300 con 0x7fef140b1530 2023-07-21T19:08:43.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.683+0000 7fef18b49700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feef80662f0 0x7feef80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:43.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.683+0000 7fef18b49700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feef80662f0 0x7feef80687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef141f5fb0 tx=0x7fef04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:43.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.687+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fef100504e0 con 0x7fef140b1530 2023-07-21T19:08:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.863+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef140c9160 con 0x7fef140b1530 2023-07-21T19:08:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.863+0000 7fef09ffb700 1 -- 172.21.15.123:0/537814221 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7fef10053b00 con 0x7fef140b1530 2023-07-21T19:08:43.878 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:43.878 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feef80662f0 msgr2=0x7feef80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feef80662f0 0x7feef80687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef141f5fb0 tx=0x7fef04009040 comp rx=0 tx=0).stop 2023-07-21T19:08:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 msgr2=0x7fef14150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 0x7fef14150e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c530 tx=0x7fef1000c840 comp rx=0 tx=0).stop 2023-07-21T19:08:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 shutdown_connections 2023-07-21T19:08:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feef80662f0 0x7feef80687a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef140d1430 0x7fef1415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef1415bf20 0x7fef1415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 --2- 172.21.15.123:0/537814221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef140b1530 0x7fef14150e70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 >> 172.21.15.123:0/537814221 conn(0x7fef1406fc80 msgr2=0x7fef14158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 shutdown_connections 2023-07-21T19:08:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:43.867+0000 7fef1b5ae700 1 -- 172.21.15.123:0/537814221 wait complete. 2023-07-21T19:08:43.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:43.902 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:44.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.067+0000 7f6a41c27700 1 Processor -- start 2023-07-21T19:08:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.067+0000 7f6a41c27700 1 -- start start 2023-07-21T19:08:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41c27700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41c27700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6a3c0d07e0 0x7f6a3c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41c27700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0cd4e0 con 0x7f6a3c0cd090 2023-07-21T19:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41c27700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0d0c60 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41c27700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0d1a60 con 0x7f6a3c0b0ee0 2023-07-21T19:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6a3c0cd090 0x7f6a3c0d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52108/0 (socket says 172.21.15.123:52108) 2023-07-21T19:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3bfff700 1 -- 172.21.15.123:0/3923747891 learned_addr learned my addr 172.21.15.123:0/3923747891 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a40c25700 1 --2- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41426700 1 --2- 172.21.15.123:0/3923747891 >> v2:172.21.15.145:3300/0 conn(0x7f6a3c0d07e0 0x7f6a3c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3b7fe700 1 -- 172.21.15.123:0/3923747891 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359591183 0 0) 0x7f6a28001110 con 0x7f6a3c0cd090 2023-07-21T19:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3b7fe700 1 -- 172.21.15.123:0/3923747891 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a2c0035d0 con 0x7f6a3c0cd090 2023-07-21T19:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41426700 1 -- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 msgr2=0x7f6a3c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41426700 1 --2- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41426700 1 -- 172.21.15.123:0/3923747891 >> v1:172.21.15.123:6789/0 conn(0x7f6a3c0cd090 legacy=0x7f6a3c0d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41426700 1 -- 172.21.15.123:0/3923747891 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0d1ef0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a41426700 1 --2- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c0af0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009dc0 tx=0x7f6a3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27150a2b104baa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3b7fe700 1 -- 172.21.15.123:0/3923747891 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400e070 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3b7fe700 1 -- 172.21.15.123:0/3923747891 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400bae0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.071+0000 7f6a3b7fe700 1 -- 172.21.15.123:0/3923747891 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400be90 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 -- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0d07e0 msgr2=0x7f6a3c0af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 --2- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c0af0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009dc0 tx=0x7f6a3400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 -- 172.21.15.123:0/3923747891 shutdown_connections 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 --2- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c0af0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 --2- 172.21.15.123:0/3923747891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 -- 172.21.15.123:0/3923747891 >> 172.21.15.123:0/3923747891 conn(0x7f6a3c060c40 msgr2=0x7f6a3c09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 -- 172.21.15.123:0/3923747891 shutdown_connections 2023-07-21T19:08:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 -- 172.21.15.123:0/3923747891 wait complete. 2023-07-21T19:08:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 Processor -- start 2023-07-21T19:08:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 -- start start 2023-07-21T19:08:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.075+0000 7f6a41c27700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0cd090 0x7f6a3c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41c27700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41c27700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0ca420 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41c27700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0ca700 con 0x7f6a3c0cd090 2023-07-21T19:08:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41c27700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0ca9e0 con 0x7f6a3c0b0ee0 2023-07-21T19:08:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a3bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0cd090 0x7f6a3c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a40c25700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c15fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36406/0 (socket says 172.21.15.123:36406) 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 -- 172.21.15.123:0/218828297 learned_addr learned my addr 172.21.15.123:0/218828297 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 -- 172.21.15.123:0/218828297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 msgr2=0x7f6a3c0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 -- 172.21.15.123:0/218828297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0cd090 msgr2=0x7f6a3c1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0cd090 0x7f6a3c1593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 -- 172.21.15.123:0/218828297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009a70 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41426700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c15fa10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400b370 tx=0x7f6a34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340044d0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34020070 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34004870 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c0cacc0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.079+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c159930 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.083+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c0cb1e0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.083+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a34012430 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.083+0000 7f6a397fa700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6a200662f0 0x7f6a200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.083+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a34022070 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.087+0000 7f6a40c25700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6a200662f0 0x7f6a200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.087+0000 7f6a40c25700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6a200662f0 0x7f6a200687a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009b50 tx=0x7f6a30009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.091+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6a3c0cb1e0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.259+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a3c0cb1e0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.259+0000 7f6a397fa700 1 -- 172.21.15.123:0/218828297 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a3c0cb1e0 con 0x7f6a3c0d07e0 2023-07-21T19:08:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:44.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6a200662f0 msgr2=0x7f6a200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6a200662f0 0x7f6a200687a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009b50 tx=0x7f6a30009240 comp rx=0 tx=0).stop 2023-07-21T19:08:44.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 msgr2=0x7f6a3c15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c15fa10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400b370 tx=0x7f6a34004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 shutdown_connections 2023-07-21T19:08:44.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6a200662f0 0x7f6a200687a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a3c0cd090 0x7f6a3c1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a3c0d07e0 0x7f6a3c15fa10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 --2- 172.21.15.123:0/218828297 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a3c0b0ee0 0x7f6a3c0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 >> 172.21.15.123:0/218828297 conn(0x7f6a3c060c40 msgr2=0x7f6a3c0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 shutdown_connections 2023-07-21T19:08:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.263+0000 7f6a41c27700 1 -- 172.21.15.123:0/218828297 wait complete. 2023-07-21T19:08:44.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f465d769700 1 Processor -- start 2023-07-21T19:08:44.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f465d769700 1 -- start start 2023-07-21T19:08:44.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f465d769700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f46580b0ee0 0x7f46580ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f465d769700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580cd4e0 con 0x7f46580cd090 2023-07-21T19:08:44.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f465d769700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580d1a60 con 0x7f46580d07e0 2023-07-21T19:08:44.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f465d769700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580d0c60 con 0x7f46580b0ee0 2023-07-21T19:08:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f46580b0ee0 0x7f46580ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f46580b0ee0 0x7f46580ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44452/0 (socket says 172.21.15.123:44452) 2023-07-21T19:08:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f46567fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f46580cd090 0x7f46580d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52118/0 (socket says 172.21.15.123:52118) 2023-07-21T19:08:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 -- 172.21.15.123:0/3043264005 learned_addr learned my addr 172.21.15.123:0/3043264005 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 -- 172.21.15.123:0/3043264005 >> v1:172.21.15.145:6789/0 conn(0x7f46580d07e0 legacy=0x7f46580af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4655ffb700 1 -- 172.21.15.123:0/3043264005 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516736767 0 0) 0x7f46580d1a60 con 0x7f46580d07e0 2023-07-21T19:08:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 -- 172.21.15.123:0/3043264005 >> v1:172.21.15.123:6789/0 conn(0x7f46580cd090 legacy=0x7f46580d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 -- 172.21.15.123:0/3043264005 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580d1ef0 con 0x7f46580b0ee0 2023-07-21T19:08:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.463+0000 7f4656ffd700 1 --2- 172.21.15.123:0/3043264005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580b0ee0 0x7f46580ccb50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4648009910 tx=0x7f4648009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ea9fe17ba3e8f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f4655ffb700 1 -- 172.21.15.123:0/3043264005 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800ba60 con 0x7f46580b0ee0 2023-07-21T19:08:44.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f4655ffb700 1 -- 172.21.15.123:0/3043264005 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800bbc0 con 0x7f46580b0ee0 2023-07-21T19:08:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f4655ffb700 1 -- 172.21.15.123:0/3043264005 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648009e60 con 0x7f46580b0ee0 2023-07-21T19:08:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 -- 172.21.15.123:0/3043264005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580b0ee0 msgr2=0x7f46580ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 --2- 172.21.15.123:0/3043264005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580b0ee0 0x7f46580ccb50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4648009910 tx=0x7f4648009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:44.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 -- 172.21.15.123:0/3043264005 shutdown_connections 2023-07-21T19:08:44.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 --2- 172.21.15.123:0/3043264005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580b0ee0 0x7f46580ccb50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 -- 172.21.15.123:0/3043264005 >> 172.21.15.123:0/3043264005 conn(0x7f4658060c40 msgr2=0x7f465809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:44.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 -- 172.21.15.123:0/3043264005 shutdown_connections 2023-07-21T19:08:44.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 -- 172.21.15.123:0/3043264005 wait complete. 2023-07-21T19:08:44.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 Processor -- start 2023-07-21T19:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.467+0000 7f465d769700 1 -- start start 2023-07-21T19:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 0x7f465815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46580cd090 0x7f46580b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580d07e0 0x7f46580b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46581493e0 con 0x7f46580b0ee0 2023-07-21T19:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46580b7100 con 0x7f46580d07e0 2023-07-21T19:08:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580b73e0 con 0x7f46580cd090 2023-07-21T19:08:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 0x7f465815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 0x7f465815a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36408/0 (socket says 172.21.15.123:36408) 2023-07-21T19:08:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 -- 172.21.15.123:0/1526675483 learned_addr learned my addr 172.21.15.123:0/1526675483 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 -- 172.21.15.123:0/1526675483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46580cd090 msgr2=0x7f46580b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46580cd090 0x7f46580b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 -- 172.21.15.123:0/1526675483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580d07e0 msgr2=0x7f46580b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580d07e0 0x7f46580b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 -- 172.21.15.123:0/1526675483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648009570 con 0x7f46580b0ee0 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f4656ffd700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 0x7f465815a4b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4648000c00 tx=0x7f4648004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648011a70 con 0x7f46580b0ee0 2023-07-21T19:08:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464801e070 con 0x7f46580b0ee0 2023-07-21T19:08:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648011e10 con 0x7f46580b0ee0 2023-07-21T19:08:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46580b76c0 con 0x7f46580b0ee0 2023-07-21T19:08:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.471+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46580b7c80 con 0x7f46580b0ee0 2023-07-21T19:08:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.475+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465804e500 con 0x7f46580b0ee0 2023-07-21T19:08:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.475+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f464802d450 con 0x7f46580b0ee0 2023-07-21T19:08:44.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.475+0000 7f463f7fe700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f46440662f0 0x7f46440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.479+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4648085190 con 0x7f46580b0ee0 2023-07-21T19:08:44.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.479+0000 7f46567fc700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f46440662f0 0x7f46440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.479+0000 7f46567fc700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f46440662f0 0x7f46440687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46581f42f0 tx=0x7f464c007a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.483+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4648052370 con 0x7f46580b0ee0 2023-07-21T19:08:44.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.659+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46580b18d0 con 0x7f46580b0ee0 2023-07-21T19:08:44.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.659+0000 7f463f7fe700 1 -- 172.21.15.123:0/1526675483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4648055990 con 0x7f46580b0ee0 2023-07-21T19:08:44.673 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:44.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f46440662f0 msgr2=0x7f46440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f46440662f0 0x7f46440687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46581f42f0 tx=0x7f464c007a70 comp rx=0 tx=0).stop 2023-07-21T19:08:44.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 msgr2=0x7f465815a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 0x7f465815a4b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4648000c00 tx=0x7f4648004770 comp rx=0 tx=0).stop 2023-07-21T19:08:44.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 shutdown_connections 2023-07-21T19:08:44.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f46440662f0 0x7f46440687a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46580d07e0 0x7f46580b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46580cd090 0x7f46580b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 --2- 172.21.15.123:0/1526675483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46580b0ee0 0x7f465815a4b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 >> 172.21.15.123:0/1526675483 conn(0x7f4658060c40 msgr2=0x7f465815b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:44.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 shutdown_connections 2023-07-21T19:08:44.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.663+0000 7f465d769700 1 -- 172.21.15.123:0/1526675483 wait complete. 2023-07-21T19:08:44.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:44.876 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 Processor -- start 2023-07-21T19:08:44.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 -- start start 2023-07-21T19:08:44.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f11d4158a20 0x7f11d40cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11d406c220 0x7f11d40cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d406d310 con 0x7f11d40cb820 2023-07-21T19:08:44.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d406c700 con 0x7f11d406c220 2023-07-21T19:08:44.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.863+0000 7f11d9ae4700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d406c9e0 con 0x7f11d4158a20 2023-07-21T19:08:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11d406c220 0x7f11d40cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11d406c220 0x7f11d40cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36422/0 (socket says 172.21.15.123:36422) 2023-07-21T19:08:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 -- 172.21.15.123:0/2575233806 learned_addr learned my addr 172.21.15.123:0/2575233806 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d92e3700 1 --1- 172.21.15.123:0/2575233806 >> v1:172.21.15.123:6789/0 conn(0x7f11d40cb820 0x7f11d406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52124/0 (socket says 172.21.15.123:52124) 2023-07-21T19:08:44.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d8ae2700 1 --2- 172.21.15.123:0/2575233806 >> v2:172.21.15.145:3300/0 conn(0x7f11d4158a20 0x7f11d40cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d37fe700 1 -- 172.21.15.123:0/2575233806 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469191641 0 0) 0x7f11d406d310 con 0x7f11d40cb820 2023-07-21T19:08:44.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d37fe700 1 -- 172.21.15.123:0/2575233806 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc0035d0 con 0x7f11d40cb820 2023-07-21T19:08:44.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 -- 172.21.15.123:0/2575233806 >> v2:172.21.15.145:3300/0 conn(0x7f11d4158a20 msgr2=0x7f11d40cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:44.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 --2- 172.21.15.123:0/2575233806 >> v2:172.21.15.145:3300/0 conn(0x7f11d4158a20 0x7f11d40cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 -- 172.21.15.123:0/2575233806 >> v1:172.21.15.123:6789/0 conn(0x7f11d40cb820 legacy=0x7f11d406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 -- 172.21.15.123:0/2575233806 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d406ccc0 con 0x7f11d406c220 2023-07-21T19:08:44.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d3fff700 1 --2- 172.21.15.123:0/2575233806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d40cbd20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11d406b0f0 tx=0x7f11c400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0b3c1c4702521b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d37fe700 1 -- 172.21.15.123:0/2575233806 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400dd30 con 0x7f11d406c220 2023-07-21T19:08:44.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d37fe700 1 -- 172.21.15.123:0/2575233806 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c400de90 con 0x7f11d406c220 2023-07-21T19:08:44.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d37fe700 1 -- 172.21.15.123:0/2575233806 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4010690 con 0x7f11d406c220 2023-07-21T19:08:44.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 -- 172.21.15.123:0/2575233806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 msgr2=0x7f11d40cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/2575233806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d40cbd20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11d406b0f0 tx=0x7f11c400be90 comp rx=0 tx=0).stop 2023-07-21T19:08:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 -- 172.21.15.123:0/2575233806 shutdown_connections 2023-07-21T19:08:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/2575233806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d40cbd20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/2575233806 >> v2:172.21.15.145:3300/0 conn(0x7f11d4158a20 0x7f11d40cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 -- 172.21.15.123:0/2575233806 >> 172.21.15.123:0/2575233806 conn(0x7f11d40afc60 msgr2=0x7f11d40b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:44.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 -- 172.21.15.123:0/2575233806 shutdown_connections 2023-07-21T19:08:44.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.867+0000 7f11d9ae4700 1 -- 172.21.15.123:0/2575233806 wait complete. 2023-07-21T19:08:44.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.871+0000 7f11d9ae4700 1 Processor -- start 2023-07-21T19:08:44.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.871+0000 7f11d9ae4700 1 -- start start 2023-07-21T19:08:44.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d4157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11d40cb820 0x7f11d41f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4158a20 0x7f11d415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41f1010 con 0x7f11d406c220 2023-07-21T19:08:44.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40accd0 con 0x7f11d4158a20 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d415a260 con 0x7f11d40cb820 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d4157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d4157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36434/0 (socket says 172.21.15.123:36434) 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 -- 172.21.15.123:0/1076544343 learned_addr learned my addr 172.21.15.123:0/1076544343 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d3fff700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11d40cb820 0x7f11d41f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d92e3700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4158a20 0x7f11d415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 -- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11d40cb820 msgr2=0x7f11d41f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11d40cb820 0x7f11d41f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 -- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4158a20 msgr2=0x7f11d415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:44.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4158a20 0x7f11d415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:44.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 -- 172.21.15.123:0/1076544343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c400b810 con 0x7f11d406c220 2023-07-21T19:08:44.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d8ae2700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d4157690 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11c800e840 tx=0x7f11c800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80095a0 con 0x7f11d406c220 2023-07-21T19:08:44.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8013680 con 0x7f11d406c220 2023-07-21T19:08:44.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d415bd90 con 0x7f11d406c220 2023-07-21T19:08:44.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80139f0 con 0x7f11d406c220 2023-07-21T19:08:44.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.875+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d40ac680 con 0x7f11d406c220 2023-07-21T19:08:44.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.879+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d404e500 con 0x7f11d406c220 2023-07-21T19:08:44.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.879+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11c8013b50 con 0x7f11d406c220 2023-07-21T19:08:44.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.879+0000 7f11d17fa700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11c00662f0 0x7f11c00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:44.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.883+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11c80842b0 con 0x7f11d406c220 2023-07-21T19:08:44.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.883+0000 7f11d3fff700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11c00662f0 0x7f11c00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:44.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.883+0000 7f11d3fff700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11c00662f0 0x7f11c00687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f11d406c630 tx=0x7f11c401b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:44.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:44.887+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f11c8051400 con 0x7f11d406c220 2023-07-21T19:08:45.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.063+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11d40b40d0 con 0x7f11d406c220 2023-07-21T19:08:45.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.063+0000 7f11d17fa700 1 -- 172.21.15.123:0/1076544343 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11c8054a20 con 0x7f11d406c220 2023-07-21T19:08:45.076 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:45.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11c00662f0 msgr2=0x7f11c00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11c00662f0 0x7f11c00687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f11d406c630 tx=0x7f11c401b040 comp rx=0 tx=0).stop 2023-07-21T19:08:45.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 msgr2=0x7f11d4157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d4157690 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11c800e840 tx=0x7f11c800eb50 comp rx=0 tx=0).stop 2023-07-21T19:08:45.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 shutdown_connections 2023-07-21T19:08:45.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f11c00662f0 0x7f11c00687a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4158a20 0x7f11d415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f11d40cb820 0x7f11d41f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 --2- 172.21.15.123:0/1076544343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d406c220 0x7f11d4157690 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 >> 172.21.15.123:0/1076544343 conn(0x7f11d40afc60 msgr2=0x7f11d40c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:45.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 shutdown_connections 2023-07-21T19:08:45.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.067+0000 7f11d9ae4700 1 -- 172.21.15.123:0/1076544343 wait complete. 2023-07-21T19:08:45.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa71542c700 1 Processor -- start 2023-07-21T19:08:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa71542c700 1 -- start start 2023-07-21T19:08:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa71542c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa7100d0210 0x7fa7100d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa71542c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa710071d10 con 0x7fa7100b1c50 2023-07-21T19:08:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa71542c700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71015c420 con 0x7fa7100cf000 2023-07-21T19:08:45.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa71542c700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa710070840 con 0x7fa7100d0210 2023-07-21T19:08:45.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa70effd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7100b1c50 0x7fa710071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52128/0 (socket says 172.21.15.123:52128) 2023-07-21T19:08:45.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.263+0000 7fa70effd700 1 -- 172.21.15.123:0/174106821 learned_addr learned my addr 172.21.15.123:0/174106821 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:45.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70e7fc700 1 --2- 172.21.15.123:0/174106821 >> v2:172.21.15.145:3300/0 conn(0x7fa7100d0210 0x7fa7100d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70dffb700 1 -- 172.21.15.123:0/174106821 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698276356 0 0) 0x7fa700001110 con 0x7fa7100b1c50 2023-07-21T19:08:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70dffb700 1 -- 172.21.15.123:0/174106821 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f80035d0 con 0x7fa7100b1c50 2023-07-21T19:08:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70e7fc700 1 -- 172.21.15.123:0/174106821 >> v1:172.21.15.145:6789/0 conn(0x7fa7100cf000 legacy=0x7fa7100ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70e7fc700 1 -- 172.21.15.123:0/174106821 >> v1:172.21.15.123:6789/0 conn(0x7fa7100b1c50 legacy=0x7fa710071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70e7fc700 1 -- 172.21.15.123:0/174106821 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710070b20 con 0x7fa7100d0210 2023-07-21T19:08:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70e7fc700 1 --2- 172.21.15.123:0/174106821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100d0210 0x7fa7100d0640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa704009850 tx=0x7fa704009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c05a3af7c7007d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70dffb700 1 -- 172.21.15.123:0/174106821 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704011830 con 0x7fa7100d0210 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70dffb700 1 -- 172.21.15.123:0/174106821 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704011990 con 0x7fa7100d0210 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa70dffb700 1 -- 172.21.15.123:0/174106821 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704011d40 con 0x7fa7100d0210 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 -- 172.21.15.123:0/174106821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100d0210 msgr2=0x7fa7100d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 --2- 172.21.15.123:0/174106821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100d0210 0x7fa7100d0640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa704009850 tx=0x7fa704009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 -- 172.21.15.123:0/174106821 shutdown_connections 2023-07-21T19:08:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 --2- 172.21.15.123:0/174106821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100d0210 0x7fa7100d0640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 -- 172.21.15.123:0/174106821 >> 172.21.15.123:0/174106821 conn(0x7fa71009b9c0 msgr2=0x7fa7100d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 -- 172.21.15.123:0/174106821 shutdown_connections 2023-07-21T19:08:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.267+0000 7fa71542c700 1 -- 172.21.15.123:0/174106821 wait complete. 2023-07-21T19:08:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 Processor -- start 2023-07-21T19:08:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 -- start start 2023-07-21T19:08:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100b1c50 0x7fa710159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 0x7fa71009ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7100d0210 0x7fa7100b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101f1d40 con 0x7fa7100cf000 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101f2020 con 0x7fa7100b1c50 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.271+0000 7fa71542c700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101f2300 con 0x7fa7100d0210 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 0x7fa71009ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 0x7fa71009ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36442/0 (socket says 172.21.15.123:36442) 2023-07-21T19:08:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 -- 172.21.15.123:0/1621755589 learned_addr learned my addr 172.21.15.123:0/1621755589 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70effd700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100b1c50 0x7fa710159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70f7fe700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7100d0210 0x7fa7100b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 -- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7100d0210 msgr2=0x7fa7100b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7100d0210 0x7fa7100b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 -- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100b1c50 msgr2=0x7fa710159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100b1c50 0x7fa710159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 -- 172.21.15.123:0/1621755589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040094b0 con 0x7fa7100cf000 2023-07-21T19:08:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70effd700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100b1c50 0x7fa710159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa70e7fc700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 0x7fa71009ceb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa704000c00 tx=0x7fa704004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704019ab0 con 0x7fa7100cf000 2023-07-21T19:08:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70401e070 con 0x7fa7100cf000 2023-07-21T19:08:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7101f25e0 con 0x7fa7100cf000 2023-07-21T19:08:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704019e90 con 0x7fa7100cf000 2023-07-21T19:08:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.275+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71009d5d0 con 0x7fa7100cf000 2023-07-21T19:08:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.279+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7101f2b00 con 0x7fa7100cf000 2023-07-21T19:08:45.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.279+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa70402d450 con 0x7fa7100cf000 2023-07-21T19:08:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.283+0000 7fa6f77fe700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6fc066320 0x7fa6fc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.283+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa7040850f0 con 0x7fa7100cf000 2023-07-21T19:08:45.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.283+0000 7fa70effd700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6fc066320 0x7fa6fc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.283+0000 7fa70effd700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6fc066320 0x7fa6fc0687d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa700001270 tx=0x7fa700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:45.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.287+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa7101f2b00 con 0x7fa7100cf000 2023-07-21T19:08:45.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.459+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7101f2b00 con 0x7fa7100cf000 2023-07-21T19:08:45.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.459+0000 7fa6f77fe700 1 -- 172.21.15.123:0/1621755589 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7101f2b00 con 0x7fa7100cf000 2023-07-21T19:08:45.474 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:45.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6fc066320 msgr2=0x7fa6fc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6fc066320 0x7fa6fc0687d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa700001270 tx=0x7fa700009040 comp rx=0 tx=0).stop 2023-07-21T19:08:45.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 msgr2=0x7fa71009ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 0x7fa71009ceb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa704000c00 tx=0x7fa704004770 comp rx=0 tx=0).stop 2023-07-21T19:08:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 shutdown_connections 2023-07-21T19:08:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6fc066320 0x7fa6fc0687d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7100d0210 0x7fa7100b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7100cf000 0x7fa71009ceb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 --2- 172.21.15.123:0/1621755589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7100b1c50 0x7fa710159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 >> 172.21.15.123:0/1621755589 conn(0x7fa71009b9c0 msgr2=0x7fa71015b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:45.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 shutdown_connections 2023-07-21T19:08:45.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.463+0000 7fa71542c700 1 -- 172.21.15.123:0/1621755589 wait complete. 2023-07-21T19:08:45.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.659+0000 7ff15a8b8700 1 Processor -- start 2023-07-21T19:08:45.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff15a8b8700 1 -- start start 2023-07-21T19:08:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff15a8b8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff1540b06c0 0x7ff1540b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff15a8b8700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff15a8b8700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1540cbb60 con 0x7ff1540b1380 2023-07-21T19:08:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff15a8b8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1540b0f60 con 0x7ff1540b06c0 2023-07-21T19:08:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff15a8b8700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540cb510 con 0x7ff1540b18d0 2023-07-21T19:08:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1598b6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff1540b06c0 0x7ff1540b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1590b5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1598b6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff1540b06c0 0x7ff1540b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36446/0 (socket says 172.21.15.123:36446) 2023-07-21T19:08:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1598b6700 1 -- 172.21.15.123:0/2157530117 learned_addr learned my addr 172.21.15.123:0/2157530117 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1590b5700 1 -- 172.21.15.123:0/2157530117 >> v2:172.21.15.123:3300/0 conn(0x7ff1540b06c0 msgr2=0x7ff1540b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1590b5700 1 --2- 172.21.15.123:0/2157530117 >> v2:172.21.15.123:3300/0 conn(0x7ff1540b06c0 0x7ff1540b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1590b5700 1 -- 172.21.15.123:0/2157530117 >> v1:172.21.15.145:6789/0 conn(0x7ff1540b1380 legacy=0x7ff1540cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1590b5700 1 -- 172.21.15.123:0/2157530117 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540cb7f0 con 0x7ff1540b18d0 2023-07-21T19:08:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.663+0000 7ff1590b5700 1 --2- 172.21.15.123:0/2157530117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540cdf00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff144009850 tx=0x7ff144009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d4d8d7487d47b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff1588b4700 1 -- 172.21.15.123:0/2157530117 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144011830 con 0x7ff1540b18d0 2023-07-21T19:08:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff1588b4700 1 -- 172.21.15.123:0/2157530117 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff144011990 con 0x7ff1540b18d0 2023-07-21T19:08:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff1588b4700 1 -- 172.21.15.123:0/2157530117 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144011d40 con 0x7ff1540b18d0 2023-07-21T19:08:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 -- 172.21.15.123:0/2157530117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 msgr2=0x7ff1540cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/2157530117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540cdf00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff144009850 tx=0x7ff144009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 -- 172.21.15.123:0/2157530117 shutdown_connections 2023-07-21T19:08:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/2157530117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540cdf00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/2157530117 >> v2:172.21.15.123:3300/0 conn(0x7ff1540b06c0 0x7ff1540b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 -- 172.21.15.123:0/2157530117 >> 172.21.15.123:0/2157530117 conn(0x7ff154099600 msgr2=0x7ff1540d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 -- 172.21.15.123:0/2157530117 shutdown_connections 2023-07-21T19:08:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.667+0000 7ff15a8b8700 1 -- 172.21.15.123:0/2157530117 wait complete. 2023-07-21T19:08:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 Processor -- start 2023-07-21T19:08:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 -- start start 2023-07-21T19:08:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 0x7ff1541517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1540b1380 0x7ff1540aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540aec80 con 0x7ff1540b06c0 2023-07-21T19:08:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1541ef520 con 0x7ff1540b1380 2023-07-21T19:08:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff154151d00 con 0x7ff1540b18d0 2023-07-21T19:08:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 0x7ff1541517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 0x7ff1541517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36460/0 (socket says 172.21.15.123:36460) 2023-07-21T19:08:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 -- 172.21.15.123:0/444968552 learned_addr learned my addr 172.21.15.123:0/444968552 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1590b5700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1540b1380 0x7ff1540aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a0b7700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 -- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 msgr2=0x7ff1540af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 -- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1540b1380 msgr2=0x7ff1540aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1540b1380 0x7ff1540aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 -- 172.21.15.123:0/444968552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440094b0 con 0x7ff1540b06c0 2023-07-21T19:08:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff1598b6700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 0x7ff1541517c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff15000e930 tx=0x7ff15000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500096c0 con 0x7ff1540b06c0 2023-07-21T19:08:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150013680 con 0x7ff1540b06c0 2023-07-21T19:08:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150013a30 con 0x7ff1540b06c0 2023-07-21T19:08:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.671+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540ae9a0 con 0x7ff1540b06c0 2023-07-21T19:08:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.675+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1540c7880 con 0x7ff1540b06c0 2023-07-21T19:08:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.675+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1540c73c0 con 0x7ff1540b06c0 2023-07-21T19:08:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.675+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff150013b90 con 0x7ff1540b06c0 2023-07-21T19:08:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.679+0000 7ff14a7fc700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1380662f0 0x7ff1380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:45.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.679+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff150084370 con 0x7ff1540b06c0 2023-07-21T19:08:45.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.679+0000 7ff1590b5700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1380662f0 0x7ff1380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:45.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.679+0000 7ff1590b5700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1380662f0 0x7ff1380687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1540b1d00 tx=0x7ff14401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.683+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff1500513a0 con 0x7ff1540b06c0 2023-07-21T19:08:45.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.851+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff15404e500 con 0x7ff1540b06c0 2023-07-21T19:08:45.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.851+0000 7ff14a7fc700 1 -- 172.21.15.123:0/444968552 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff1500549c0 con 0x7ff1540b06c0 2023-07-21T19:08:45.865 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1380662f0 msgr2=0x7ff1380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1380662f0 0x7ff1380687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1540b1d00 tx=0x7ff14401c040 comp rx=0 tx=0).stop 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 msgr2=0x7ff1541517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 0x7ff1541517c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff15000e930 tx=0x7ff15000ec40 comp rx=0 tx=0).stop 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 shutdown_connections 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1380662f0 0x7ff1380687a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1540b1380 0x7ff1540aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1540b18d0 0x7ff1540af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 --2- 172.21.15.123:0/444968552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1540b06c0 0x7ff1541517c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:45.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 >> 172.21.15.123:0/444968552 conn(0x7ff154099600 msgr2=0x7ff15406a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:45.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 shutdown_connections 2023-07-21T19:08:45.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:45.855+0000 7ff15a8b8700 1 -- 172.21.15.123:0/444968552 wait complete. 2023-07-21T19:08:45.941 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T19:08:45.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-21T19:08:46.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 Processor -- start 2023-07-21T19:08:46.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 -- start start 2023-07-21T19:08:46.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f071806d860 0x7f07180cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f07180c1e00 0x7f07180cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07180cc1b0 con 0x7f071806be70 2023-07-21T19:08:46.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07180cd690 con 0x7f071806d860 2023-07-21T19:08:46.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f071dd08700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07180cd970 con 0x7f07180c1e00 2023-07-21T19:08:46.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f071806d860 0x7f07180cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f071806d860 0x7f07180cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36474/0 (socket says 172.21.15.123:36474) 2023-07-21T19:08:46.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 -- 172.21.15.123:0/485278615 learned_addr learned my addr 172.21.15.123:0/485278615 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f0717fff700 1 --2- 172.21.15.123:0/485278615 >> v2:172.21.15.145:3300/0 conn(0x7f07180c1e00 0x7f07180cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 -- 172.21.15.123:0/485278615 >> v2:172.21.15.145:3300/0 conn(0x7f07180c1e00 msgr2=0x7f07180cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 --2- 172.21.15.123:0/485278615 >> v2:172.21.15.145:3300/0 conn(0x7f07180c1e00 0x7f07180cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 -- 172.21.15.123:0/485278615 >> v1:172.21.15.145:6789/0 conn(0x7f071806be70 legacy=0x7f071806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.107+0000 7f07177fe700 1 -- 172.21.15.123:0/485278615 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07180cdc50 con 0x7f071806d860 2023-07-21T19:08:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f07177fe700 1 --2- 172.21.15.123:0/485278615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180cb840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f071806ba40 tx=0x7f0708009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1356f0b916df47 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f0716ffd700 1 -- 172.21.15.123:0/485278615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800b8a0 con 0x7f071806d860 2023-07-21T19:08:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f0716ffd700 1 -- 172.21.15.123:0/485278615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800ba00 con 0x7f071806d860 2023-07-21T19:08:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f0716ffd700 1 -- 172.21.15.123:0/485278615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800bd90 con 0x7f071806d860 2023-07-21T19:08:46.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 -- 172.21.15.123:0/485278615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 msgr2=0x7f07180cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 --2- 172.21.15.123:0/485278615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180cb840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f071806ba40 tx=0x7f0708009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 -- 172.21.15.123:0/485278615 shutdown_connections 2023-07-21T19:08:46.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 --2- 172.21.15.123:0/485278615 >> v2:172.21.15.145:3300/0 conn(0x7f07180c1e00 0x7f07180cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 --2- 172.21.15.123:0/485278615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180cb840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 -- 172.21.15.123:0/485278615 >> 172.21.15.123:0/485278615 conn(0x7f07180cad30 msgr2=0x7f07180cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:46.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 -- 172.21.15.123:0/485278615 shutdown_connections 2023-07-21T19:08:46.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.111+0000 7f071dd08700 1 -- 172.21.15.123:0/485278615 wait complete. 2023-07-21T19:08:46.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 Processor -- start 2023-07-21T19:08:46.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 -- start start 2023-07-21T19:08:46.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f071806be70 0x7f0718155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07180c1e00 0x7f07180c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0718155aa0 con 0x7f071806d860 2023-07-21T19:08:46.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071815a440 con 0x7f07180c1e00 2023-07-21T19:08:46.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f071dd08700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07180c5380 con 0x7f071806be70 2023-07-21T19:08:46.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36488/0 (socket says 172.21.15.123:36488) 2023-07-21T19:08:46.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 -- 172.21.15.123:0/3571179363 learned_addr learned my addr 172.21.15.123:0/3571179363 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:46.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f07177fe700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f071806be70 0x7f0718155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f0717fff700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07180c1e00 0x7f07180c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 -- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f071806be70 msgr2=0x7f0718155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f071806be70 0x7f0718155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 -- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07180c1e00 msgr2=0x7f07180c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07180c1e00 0x7f07180c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 -- 172.21.15.123:0/3571179363 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708009570 con 0x7f071806d860 2023-07-21T19:08:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f070ffff700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180b3b40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f070000c500 tx=0x7f070000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.115+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07000052d0 con 0x7f071806d860 2023-07-21T19:08:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.119+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700005430 con 0x7f071806d860 2023-07-21T19:08:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.119+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07000055a0 con 0x7f071806d860 2023-07-21T19:08:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.119+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07180c5660 con 0x7f071806d860 2023-07-21T19:08:46.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.119+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07180b2fa0 con 0x7f071806d860 2023-07-21T19:08:46.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.119+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071806a330 con 0x7f071806d860 2023-07-21T19:08:46.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.119+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07000038e0 con 0x7f071806d860 2023-07-21T19:08:46.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.123+0000 7f0714ff9700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06f80662f0 0x7f06f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.123+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0700083400 con 0x7f071806d860 2023-07-21T19:08:46.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.123+0000 7f07177fe700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06f80662f0 0x7f06f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.123+0000 7f07177fe700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06f80662f0 0x7f06f80687a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0708000c00 tx=0x7f0708008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:46.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.127+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f07000505e0 con 0x7f071806d860 2023-07-21T19:08:46.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.367+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f071804dcb0 con 0x7f071806d860 2023-07-21T19:08:46.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.603+0000 7f0714ff9700 1 -- 172.21.15.123:0/3571179363 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v80) v1 ==== 147+0+0 (secure 0 0 0) 0x7f0700053c00 con 0x7f071806d860 2023-07-21T19:08:46.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06f80662f0 msgr2=0x7f06f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06f80662f0 0x7f06f80687a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0708000c00 tx=0x7f0708008030 comp rx=0 tx=0).stop 2023-07-21T19:08:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 msgr2=0x7f07180b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180b3b40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f070000c500 tx=0x7f070000c810 comp rx=0 tx=0).stop 2023-07-21T19:08:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 shutdown_connections 2023-07-21T19:08:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06f80662f0 0x7f06f80687a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07180c1e00 0x7f07180c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071806d860 0x7f07180b3b40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 --2- 172.21.15.123:0/3571179363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f071806be70 0x7f0718155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 >> 172.21.15.123:0/3571179363 conn(0x7f07180cad30 msgr2=0x7f0718156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:46.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 shutdown_connections 2023-07-21T19:08:46.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.607+0000 7f071dd08700 1 -- 172.21.15.123:0/3571179363 wait complete. 2023-07-21T19:08:46.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T19:08:46.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 Processor -- start 2023-07-21T19:08:46.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 -- start start 2023-07-21T19:08:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc7480ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7480cd090 0x7fc7480d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480cd4e0 con 0x7fc7480d0610 2023-07-21T19:08:46.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7480d1a60 con 0x7fc7480cd090 2023-07-21T19:08:46.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.807+0000 7fc74cacb700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480d1ef0 con 0x7fc7480b0ee0 2023-07-21T19:08:46.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc747fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc7480d0610 0x7fc74815f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52132/0 (socket says 172.21.15.123:52132) 2023-07-21T19:08:46.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc747fff700 1 -- 172.21.15.123:0/4272439659 learned_addr learned my addr 172.21.15.123:0/4272439659 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:46.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc746ffd700 1 --2- 172.21.15.123:0/4272439659 >> v2:172.21.15.123:3300/0 conn(0x7fc7480cd090 0x7fc7480d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc7477fe700 1 --2- 172.21.15.123:0/4272439659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc7480ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc7467fc700 1 -- 172.21.15.123:0/4272439659 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010061609 0 0) 0x7fc740001490 con 0x7fc7480d0610 2023-07-21T19:08:46.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc7467fc700 1 -- 172.21.15.123:0/4272439659 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7300035d0 con 0x7fc7480d0610 2023-07-21T19:08:46.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc746ffd700 1 -- 172.21.15.123:0/4272439659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 msgr2=0x7fc7480ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:46.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc746ffd700 1 --2- 172.21.15.123:0/4272439659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc7480ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc746ffd700 1 -- 172.21.15.123:0/4272439659 >> v1:172.21.15.123:6789/0 conn(0x7fc7480d0610 legacy=0x7fc74815f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc746ffd700 1 -- 172.21.15.123:0/4272439659 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480d0e50 con 0x7fc7480cd090 2023-07-21T19:08:46.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc746ffd700 1 --2- 172.21.15.123:0/4272439659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480cd090 0x7fc7480d00d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009880 tx=0x7fc73c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651744a0a0d9a7d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:46.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc7467fc700 1 -- 172.21.15.123:0/4272439659 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c011830 con 0x7fc7480cd090 2023-07-21T19:08:46.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc7467fc700 1 -- 172.21.15.123:0/4272439659 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c011990 con 0x7fc7480cd090 2023-07-21T19:08:46.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc7467fc700 1 -- 172.21.15.123:0/4272439659 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c011d00 con 0x7fc7480cd090 2023-07-21T19:08:46.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 -- 172.21.15.123:0/4272439659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480cd090 msgr2=0x7fc7480d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 --2- 172.21.15.123:0/4272439659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480cd090 0x7fc7480d00d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009880 tx=0x7fc73c009b90 comp rx=0 tx=0).stop 2023-07-21T19:08:46.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 -- 172.21.15.123:0/4272439659 shutdown_connections 2023-07-21T19:08:46.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 --2- 172.21.15.123:0/4272439659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480cd090 0x7fc7480d00d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 --2- 172.21.15.123:0/4272439659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc7480ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 -- 172.21.15.123:0/4272439659 >> 172.21.15.123:0/4272439659 conn(0x7fc748060c40 msgr2=0x7fc74809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:46.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 -- 172.21.15.123:0/4272439659 shutdown_connections 2023-07-21T19:08:46.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.811+0000 7fc74cacb700 1 -- 172.21.15.123:0/4272439659 wait complete. 2023-07-21T19:08:46.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 Processor -- start 2023-07-21T19:08:46.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 -- start start 2023-07-21T19:08:46.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc748156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7480cd090 0x7fc7481f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 0x7fc748070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc748071020 con 0x7fc7480d0610 2023-07-21T19:08:46.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7481f11e0 con 0x7fc7480cd090 2023-07-21T19:08:46.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.815+0000 7fc74cacb700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7481f1760 con 0x7fc7480b0ee0 2023-07-21T19:08:46.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 0x7fc748070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 0x7fc748070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36508/0 (socket says 172.21.15.123:36508) 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 -- 172.21.15.123:0/1639502962 learned_addr learned my addr 172.21.15.123:0/1639502962 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc7477fe700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc748156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc746ffd700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7480cd090 0x7fc7481f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 -- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 msgr2=0x7fc748156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc748156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 -- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7480cd090 msgr2=0x7fc7481f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:46.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7480cd090 0x7fc7481f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:46.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 -- 172.21.15.123:0/1639502962 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0094b0 con 0x7fc7480d0610 2023-07-21T19:08:46.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc7477fe700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc748156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:46.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc747fff700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 0x7fc748070280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc74000cb40 tx=0x7fc74000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:46.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000a9e0 con 0x7fc7480d0610 2023-07-21T19:08:46.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74000ab40 con 0x7fc7480d0610 2023-07-21T19:08:46.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7481f2130 con 0x7fc7480d0610 2023-07-21T19:08:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000ce60 con 0x7fc7480d0610 2023-07-21T19:08:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc748070a60 con 0x7fc7480d0610 2023-07-21T19:08:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.819+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74804e500 con 0x7fc7480d0610 2023-07-21T19:08:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.823+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc74001b3b0 con 0x7fc7480d0610 2023-07-21T19:08:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.823+0000 7fc72ffff700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc7340662f0 0x7fc7340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.823+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc740083970 con 0x7fc7480d0610 2023-07-21T19:08:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.823+0000 7fc7477fe700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc7340662f0 0x7fc7340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.827+0000 7fc7477fe700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc7340662f0 0x7fc7340687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc748071c40 tx=0x7fc738008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:46.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:46.831+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc740050ac0 con 0x7fc7480d0610 2023-07-21T19:08:47.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.003+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7480cd4e0 con 0x7fc7480d0610 2023-07-21T19:08:47.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.015+0000 7fc72ffff700 1 -- 172.21.15.123:0/1639502962 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7480cd4e0 con 0x7fc7480d0610 2023-07-21T19:08:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc7340662f0 msgr2=0x7fc7340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc7340662f0 0x7fc7340687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc748071c40 tx=0x7fc738008040 comp rx=0 tx=0).stop 2023-07-21T19:08:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 msgr2=0x7fc748070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 0x7fc748070280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc74000cb40 tx=0x7fc74000cc20 comp rx=0 tx=0).stop 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 shutdown_connections 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc7340662f0 0x7fc7340687a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7480cd090 0x7fc7481f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7480d0610 0x7fc748070280 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 --2- 172.21.15.123:0/1639502962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7480b0ee0 0x7fc748156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 >> 172.21.15.123:0/1639502962 conn(0x7fc748060c40 msgr2=0x7fc7480cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 shutdown_connections 2023-07-21T19:08:47.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.019+0000 7fc74cacb700 1 -- 172.21.15.123:0/1639502962 wait complete. 2023-07-21T19:08:47.054 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T19:08:47.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T19:08:47.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T19:08:47.142 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T19:08:47.143 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:47.143 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:47.160 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:47.161 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:47.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:47.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 Processor -- start 2023-07-21T19:08:47.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 -- start start 2023-07-21T19:08:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff7b406be70 0x7ff7b40cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7b40c1e00 0x7ff7b40cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b40cc1b0 con 0x7ff7b406d860 2023-07-21T19:08:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b40cd690 con 0x7ff7b40c1e00 2023-07-21T19:08:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7ba3cd700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b40cd970 con 0x7ff7b406be70 2023-07-21T19:08:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7b40c1e00 0x7ff7b40cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7b40c1e00 0x7ff7b40cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36514/0 (socket says 172.21.15.123:36514) 2023-07-21T19:08:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 -- 172.21.15.123:0/895850323 learned_addr learned my addr 172.21.15.123:0/895850323 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b37fe700 1 --2- 172.21.15.123:0/895850323 >> v2:172.21.15.145:3300/0 conn(0x7ff7b406be70 0x7ff7b40cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 -- 172.21.15.123:0/895850323 >> v2:172.21.15.145:3300/0 conn(0x7ff7b406be70 msgr2=0x7ff7b40cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 --2- 172.21.15.123:0/895850323 >> v2:172.21.15.145:3300/0 conn(0x7ff7b406be70 0x7ff7b40cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 -- 172.21.15.123:0/895850323 >> v1:172.21.15.145:6789/0 conn(0x7ff7b406d860 legacy=0x7ff7b406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.435+0000 7ff7b896a700 1 -- 172.21.15.123:0/895850323 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40cdc50 con 0x7ff7b40c1e00 2023-07-21T19:08:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7b896a700 1 --2- 172.21.15.123:0/895850323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40cc640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40b0c60 tx=0x7ff7ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dd25c37240ae89 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7b2ffd700 1 -- 172.21.15.123:0/895850323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00e070 con 0x7ff7b40c1e00 2023-07-21T19:08:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7b2ffd700 1 -- 172.21.15.123:0/895850323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00b910 con 0x7ff7b40c1e00 2023-07-21T19:08:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7b2ffd700 1 -- 172.21.15.123:0/895850323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00bcc0 con 0x7ff7b40c1e00 2023-07-21T19:08:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/895850323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b40c1e00 msgr2=0x7ff7b40cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/895850323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40cc640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40b0c60 tx=0x7ff7ac00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/895850323 shutdown_connections 2023-07-21T19:08:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/895850323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40cc640 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/895850323 >> v2:172.21.15.145:3300/0 conn(0x7ff7b406be70 0x7ff7b40cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/895850323 >> 172.21.15.123:0/895850323 conn(0x7ff7b40cad30 msgr2=0x7ff7b40cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/895850323 shutdown_connections 2023-07-21T19:08:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.439+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/895850323 wait complete. 2023-07-21T19:08:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 Processor -- start 2023-07-21T19:08:47.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 -- start start 2023-07-21T19:08:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 0x7ff7b40aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7b406d860 0x7ff7b40c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41451f0 con 0x7ff7b406be70 2023-07-21T19:08:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40c6930 con 0x7ff7b40c1e00 2023-07-21T19:08:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7ba3cd700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40c6c10 con 0x7ff7b406d860 2023-07-21T19:08:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 0x7ff7b40aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 0x7ff7b40aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36528/0 (socket says 172.21.15.123:36528) 2023-07-21T19:08:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 -- 172.21.15.123:0/1464849327 learned_addr learned my addr 172.21.15.123:0/1464849327 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b37fe700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7b406d860 0x7ff7b40c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b896a700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 -- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7b406d860 msgr2=0x7ff7b40c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7b406d860 0x7ff7b40c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 -- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b40c1e00 msgr2=0x7ff7b40c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.443+0000 7ff7b3fff700 1 -- 172.21.15.123:0/1464849327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009b30 con 0x7ff7b406be70 2023-07-21T19:08:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7b3fff700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 0x7ff7b40aef90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c500 tx=0x7ff7a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40052d0 con 0x7ff7b406be70 2023-07-21T19:08:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4005430 con 0x7ff7b406be70 2023-07-21T19:08:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40055a0 con 0x7ff7b406be70 2023-07-21T19:08:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b40c6ef0 con 0x7ff7b406be70 2023-07-21T19:08:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b4142670 con 0x7ff7b406be70 2023-07-21T19:08:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.447+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b404dcb0 con 0x7ff7b406be70 2023-07-21T19:08:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.451+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7a40038e0 con 0x7ff7b406be70 2023-07-21T19:08:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.451+0000 7ff7b0ff9700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff7a0066320 0x7ff7a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.451+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7a4083490 con 0x7ff7b406be70 2023-07-21T19:08:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.451+0000 7ff7b37fe700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff7a0066320 0x7ff7a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.455+0000 7ff7b37fe700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff7a0066320 0x7ff7a00687d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40ad3c0 tx=0x7ff7a8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.459+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff7a4050540 con 0x7ff7b406be70 2023-07-21T19:08:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.631+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b4072950 con 0x7ff7b406be70 2023-07-21T19:08:47.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.635+0000 7ff7b0ff9700 1 -- 172.21.15.123:0/1464849327 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7ff7a4053b60 con 0x7ff7b406be70 2023-07-21T19:08:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:47.663 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:47.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff7a0066320 msgr2=0x7ff7a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff7a0066320 0x7ff7a00687d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40ad3c0 tx=0x7ff7a8009240 comp rx=0 tx=0).stop 2023-07-21T19:08:47.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 msgr2=0x7ff7b40aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 0x7ff7b40aef90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c500 tx=0x7ff7a400c810 comp rx=0 tx=0).stop 2023-07-21T19:08:47.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 shutdown_connections 2023-07-21T19:08:47.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff7a0066320 0x7ff7a00687d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b40c1e00 0x7ff7b40c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7b406d860 0x7ff7b40c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 --2- 172.21.15.123:0/1464849327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b406be70 0x7ff7b40aef90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 >> 172.21.15.123:0/1464849327 conn(0x7ff7b40cad30 msgr2=0x7ff7b40ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:47.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 shutdown_connections 2023-07-21T19:08:47.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.639+0000 7ff7ba3cd700 1 -- 172.21.15.123:0/1464849327 wait complete. 2023-07-21T19:08:47.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:47.675 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 Processor -- start 2023-07-21T19:08:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 -- start start 2023-07-21T19:08:47.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f07100afd80 0x7f071015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07100c8950 0x7f07100c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100c9290 con 0x7f071015df10 2023-07-21T19:08:47.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071015e830 con 0x7f07100c8950 2023-07-21T19:08:47.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f0715078700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0710070a30 con 0x7f07100afd80 2023-07-21T19:08:47.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f070f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07100c8950 0x7f07100c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f070f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07100c8950 0x7f07100c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36544/0 (socket says 172.21.15.123:36544) 2023-07-21T19:08:47.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.839+0000 7f070f59e700 1 -- 172.21.15.123:0/2070943690 learned_addr learned my addr 172.21.15.123:0/2070943690 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:47.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070e59c700 1 --2- 172.21.15.123:0/2070943690 >> v2:172.21.15.145:3300/0 conn(0x7f07100afd80 0x7f071015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070dd9b700 1 -- 172.21.15.123:0/2070943690 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234204740 0 0) 0x7f0700001110 con 0x7f071015df10 2023-07-21T19:08:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070f59e700 1 -- 172.21.15.123:0/2070943690 >> v2:172.21.15.145:3300/0 conn(0x7f07100afd80 msgr2=0x7f071015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070f59e700 1 --2- 172.21.15.123:0/2070943690 >> v2:172.21.15.145:3300/0 conn(0x7f07100afd80 0x7f071015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070f59e700 1 -- 172.21.15.123:0/2070943690 >> v1:172.21.15.145:6789/0 conn(0x7f071015df10 legacy=0x7f07100711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070f59e700 1 -- 172.21.15.123:0/2070943690 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100b0210 con 0x7f07100c8950 2023-07-21T19:08:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070f59e700 1 --2- 172.21.15.123:0/2070943690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100c8950 0x7f07100c8d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f071006bef0 tx=0x7f070800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91aa7b99d889e97a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070dd9b700 1 -- 172.21.15.123:0/2070943690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800e070 con 0x7f07100c8950 2023-07-21T19:08:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070dd9b700 1 -- 172.21.15.123:0/2070943690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800b910 con 0x7f07100c8950 2023-07-21T19:08:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f070dd9b700 1 -- 172.21.15.123:0/2070943690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800bcc0 con 0x7f07100c8950 2023-07-21T19:08:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 -- 172.21.15.123:0/2070943690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100c8950 msgr2=0x7f07100c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 --2- 172.21.15.123:0/2070943690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100c8950 0x7f07100c8d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f071006bef0 tx=0x7f070800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 -- 172.21.15.123:0/2070943690 shutdown_connections 2023-07-21T19:08:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 --2- 172.21.15.123:0/2070943690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100c8950 0x7f07100c8d50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 --2- 172.21.15.123:0/2070943690 >> v2:172.21.15.145:3300/0 conn(0x7f07100afd80 0x7f071015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 -- 172.21.15.123:0/2070943690 >> 172.21.15.123:0/2070943690 conn(0x7f07100cad80 msgr2=0x7f07100cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 -- 172.21.15.123:0/2070943690 shutdown_connections 2023-07-21T19:08:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.843+0000 7f0715078700 1 -- 172.21.15.123:0/2070943690 wait complete. 2023-07-21T19:08:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.847+0000 7f0715078700 1 Processor -- start 2023-07-21T19:08:47.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.847+0000 7f0715078700 1 -- start start 2023-07-21T19:08:47.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07100afd80 0x7f07100b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07100c8950 0x7f0710154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 0x7f07101554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b3430 con 0x7f0710154b90 2023-07-21T19:08:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100abd00 con 0x7f07100c8950 2023-07-21T19:08:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b23e0 con 0x7f07100afd80 2023-07-21T19:08:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 0x7f07101554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 0x7f07101554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36560/0 (socket says 172.21.15.123:36560) 2023-07-21T19:08:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 -- 172.21.15.123:0/1854148228 learned_addr learned my addr 172.21.15.123:0/1854148228 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070ed9d700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07100afd80 0x7f07100b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070e59c700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07100c8950 0x7f0710154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 -- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07100afd80 msgr2=0x7f07100b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07100afd80 0x7f07100b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 -- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07100c8950 msgr2=0x7f0710154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07100c8950 0x7f0710154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 -- 172.21.15.123:0/1854148228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708009b30 con 0x7f0710154b90 2023-07-21T19:08:47.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f070f59e700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 0x7f07101554f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f071006e410 tx=0x7f0708004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:47.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708004840 con 0x7f0710154b90 2023-07-21T19:08:47.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080099b0 con 0x7f0710154b90 2023-07-21T19:08:47.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07100b1b40 con 0x7f0710154b90 2023-07-21T19:08:47.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070801c680 con 0x7f0710154b90 2023-07-21T19:08:47.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.851+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07100b2100 con 0x7f0710154b90 2023-07-21T19:08:47.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.855+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07100abe70 con 0x7f0710154b90 2023-07-21T19:08:47.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.855+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f070801c7e0 con 0x7f0710154b90 2023-07-21T19:08:47.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.859+0000 7f06f77fe700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06fc0662f0 0x7f06fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.859+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0708085c60 con 0x7f0710154b90 2023-07-21T19:08:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.859+0000 7f070ed9d700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06fc0662f0 0x7f06fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.859+0000 7f070ed9d700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06fc0662f0 0x7f06fc0687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0700000f60 tx=0x7f0700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:47.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:47.863+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0708052d20 con 0x7f0710154b90 2023-07-21T19:08:48.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.035+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f071004dcb0 con 0x7f0710154b90 2023-07-21T19:08:48.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.035+0000 7f06f77fe700 1 -- 172.21.15.123:0/1854148228 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0708056340 con 0x7f0710154b90 2023-07-21T19:08:48.048 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:48.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06fc0662f0 msgr2=0x7f06fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06fc0662f0 0x7f06fc0687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0700000f60 tx=0x7f0700009040 comp rx=0 tx=0).stop 2023-07-21T19:08:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 msgr2=0x7f07101554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 0x7f07101554f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f071006e410 tx=0x7f0708004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 shutdown_connections 2023-07-21T19:08:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f06fc0662f0 0x7f06fc0687a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07100c8950 0x7f0710154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710154b90 0x7f07101554f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 --2- 172.21.15.123:0/1854148228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07100afd80 0x7f07100b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 >> 172.21.15.123:0/1854148228 conn(0x7f07100cad80 msgr2=0x7f071006d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 shutdown_connections 2023-07-21T19:08:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.039+0000 7f0715078700 1 -- 172.21.15.123:0/1854148228 wait complete. 2023-07-21T19:08:48.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:48.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.239+0000 7fa7d9fa0700 1 Processor -- start 2023-07-21T19:08:48.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.239+0000 7fa7d9fa0700 1 -- start start 2023-07-21T19:08:48.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40d0210 0x7fa7d40d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7d40cf000 0x7fa7d40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d4071d10 con 0x7fa7d40b1c50 2023-07-21T19:08:48.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40cf9c0 con 0x7fa7d40cf000 2023-07-21T19:08:48.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415c420 con 0x7fa7d40d0210 2023-07-21T19:08:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7d40b1c50 0x7fa7d4071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52136/0 (socket says 172.21.15.123:52136) 2023-07-21T19:08:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d37fe700 1 -- 172.21.15.123:0/4250937215 learned_addr learned my addr 172.21.15.123:0/4250937215 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d3fff700 1 --2- 172.21.15.123:0/4250937215 >> v2:172.21.15.123:3300/0 conn(0x7fa7d40cf000 0x7fa7d40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d2ffd700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40d0210 0x7fa7d40d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d3fff700 1 -- 172.21.15.123:0/4250937215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40d0210 msgr2=0x7fa7d40d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d3fff700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40d0210 0x7fa7d40d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d3fff700 1 -- 172.21.15.123:0/4250937215 >> v1:172.21.15.123:6789/0 conn(0x7fa7d40b1c50 legacy=0x7fa7d4071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d3fff700 1 -- 172.21.15.123:0/4250937215 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d4070840 con 0x7fa7d40cf000 2023-07-21T19:08:48.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d2ffd700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40d0210 0x7fa7d40d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:48.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d27fc700 1 -- 172.21.15.123:0/4250937215 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755711266 0 0) 0x7fa7c4001110 con 0x7fa7d40b1c50 2023-07-21T19:08:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d3fff700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40cf000 0x7fa7d40cf480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009d90 tx=0x7fa7cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c951eea79ed211e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d27fc700 1 -- 172.21.15.123:0/4250937215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00e070 con 0x7fa7d40cf000 2023-07-21T19:08:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d27fc700 1 -- 172.21.15.123:0/4250937215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc00bbd0 con 0x7fa7d40cf000 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d27fc700 1 -- 172.21.15.123:0/4250937215 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc012430 con 0x7fa7d40cf000 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4250937215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40cf000 msgr2=0x7fa7d40cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.243+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40cf000 0x7fa7d40cf480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009d90 tx=0x7fa7cc00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4250937215 shutdown_connections 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40cf000 0x7fa7d40cf480 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4250937215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40d0210 0x7fa7d40d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4250937215 >> 172.21.15.123:0/4250937215 conn(0x7fa7d409b9c0 msgr2=0x7fa7d40d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:48.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4250937215 shutdown_connections 2023-07-21T19:08:48.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4250937215 wait complete. 2023-07-21T19:08:48.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 Processor -- start 2023-07-21T19:08:48.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.247+0000 7fa7d9fa0700 1 -- start start 2023-07-21T19:08:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 0x7fa7d415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40cf000 0x7fa7d415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7d40d0210 0x7fa7d41f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415c190 con 0x7fa7d40b1c50 2023-07-21T19:08:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415d910 con 0x7fa7d40d0210 2023-07-21T19:08:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40c6f90 con 0x7fa7d40cf000 2023-07-21T19:08:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 0x7fa7d415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 0x7fa7d415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36576/0 (socket says 172.21.15.123:36576) 2023-07-21T19:08:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 -- 172.21.15.123:0/4184395406 learned_addr learned my addr 172.21.15.123:0/4184395406 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d3fff700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7d40d0210 0x7fa7d41f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d2ffd700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40cf000 0x7fa7d415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 -- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40cf000 msgr2=0x7fa7d415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40cf000 0x7fa7d415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 -- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7d40d0210 msgr2=0x7fa7d41f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7d40d0210 0x7fa7d41f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 -- 172.21.15.123:0/4184395406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc009a70 con 0x7fa7d40b1c50 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d37fe700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 0x7fa7d415bc50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c4e0 tx=0x7fa7c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4004ca0 con 0x7fa7d40b1c50 2023-07-21T19:08:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4004e20 con 0x7fa7d40b1c50 2023-07-21T19:08:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d40c7270 con 0x7fa7d40b1c50 2023-07-21T19:08:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4007310 con 0x7fa7d40b1c50 2023-07-21T19:08:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.251+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d40c7830 con 0x7fa7d40b1c50 2023-07-21T19:08:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.255+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d404dcb0 con 0x7fa7d40b1c50 2023-07-21T19:08:48.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.255+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7c4007470 con 0x7fa7d40b1c50 2023-07-21T19:08:48.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.255+0000 7fa7bbfff700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa7c00662f0 0x7fa7c00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.259+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa7c4083a90 con 0x7fa7d40b1c50 2023-07-21T19:08:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.259+0000 7fa7d2ffd700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa7c00662f0 0x7fa7c00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.259+0000 7fa7d2ffd700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa7c00662f0 0x7fa7c00687a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa7d406e150 tx=0x7fa7c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:48.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.263+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa7c4050bd0 con 0x7fa7d40b1c50 2023-07-21T19:08:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.443+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7d4071d10 con 0x7fa7d40b1c50 2023-07-21T19:08:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.443+0000 7fa7bbfff700 1 -- 172.21.15.123:0/4184395406 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7d4071d10 con 0x7fa7d40b1c50 2023-07-21T19:08:48.458 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:48.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa7c00662f0 msgr2=0x7fa7c00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa7c00662f0 0x7fa7c00687a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa7d406e150 tx=0x7fa7c8008040 comp rx=0 tx=0).stop 2023-07-21T19:08:48.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 msgr2=0x7fa7d415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 0x7fa7d415bc50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c4e0 tx=0x7fa7c400c7f0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 shutdown_connections 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa7c00662f0 0x7fa7c00687a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7d40d0210 0x7fa7d41f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa7d40cf000 0x7fa7d415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 --2- 172.21.15.123:0/4184395406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d40b1c50 0x7fa7d415bc50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 >> 172.21.15.123:0/4184395406 conn(0x7fa7d409b9c0 msgr2=0x7fa7d40b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 shutdown_connections 2023-07-21T19:08:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.447+0000 7fa7d9fa0700 1 -- 172.21.15.123:0/4184395406 wait complete. 2023-07-21T19:08:48.482 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:48.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 Processor -- start 2023-07-21T19:08:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 -- start start 2023-07-21T19:08:48.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f92181603d0 0x7f921806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92180cd7f0 0x7f92180c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180cdfb0 con 0x7f9218160000 2023-07-21T19:08:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9218070e40 con 0x7f92180cd7f0 2023-07-21T19:08:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921ef7e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92180cdcd0 con 0x7f92181603d0 2023-07-21T19:08:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921e77d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92180cd7f0 0x7f92180c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921e77d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92180cd7f0 0x7f92180c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36588/0 (socket says 172.21.15.123:36588) 2023-07-21T19:08:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921e77d700 1 -- 172.21.15.123:0/3951767364 learned_addr learned my addr 172.21.15.123:0/3951767364 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.655+0000 7f921d77b700 1 --2- 172.21.15.123:0/3951767364 >> v2:172.21.15.145:3300/0 conn(0x7f92181603d0 0x7f921806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921e77d700 1 -- 172.21.15.123:0/3951767364 >> v2:172.21.15.145:3300/0 conn(0x7f92181603d0 msgr2=0x7f921806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921e77d700 1 --2- 172.21.15.123:0/3951767364 >> v2:172.21.15.145:3300/0 conn(0x7f92181603d0 0x7f921806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921e77d700 1 -- 172.21.15.123:0/3951767364 >> v1:172.21.15.145:6789/0 conn(0x7f9218160000 legacy=0x7f92180c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921e77d700 1 -- 172.21.15.123:0/3951767364 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218070780 con 0x7f92180cd7f0 2023-07-21T19:08:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921e77d700 1 --2- 172.21.15.123:0/3951767364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92180cd7f0 0x7f92180c0d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9218071a20 tx=0x7f921000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cc76943bcbcbea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:48.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921cf7a700 1 -- 172.21.15.123:0/3951767364 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000e070 con 0x7f92180cd7f0 2023-07-21T19:08:48.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921cf7a700 1 -- 172.21.15.123:0/3951767364 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921000b910 con 0x7f92180cd7f0 2023-07-21T19:08:48.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921cf7a700 1 -- 172.21.15.123:0/3951767364 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000bcc0 con 0x7f92180cd7f0 2023-07-21T19:08:48.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 -- 172.21.15.123:0/3951767364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92180cd7f0 msgr2=0x7f92180c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 --2- 172.21.15.123:0/3951767364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92180cd7f0 0x7f92180c0d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9218071a20 tx=0x7f921000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:48.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 -- 172.21.15.123:0/3951767364 shutdown_connections 2023-07-21T19:08:48.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 --2- 172.21.15.123:0/3951767364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92180cd7f0 0x7f92180c0d50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 --2- 172.21.15.123:0/3951767364 >> v2:172.21.15.145:3300/0 conn(0x7f92181603d0 0x7f921806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 -- 172.21.15.123:0/3951767364 >> 172.21.15.123:0/3951767364 conn(0x7f92180afc60 msgr2=0x7f92180b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:48.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 -- 172.21.15.123:0/3951767364 shutdown_connections 2023-07-21T19:08:48.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.659+0000 7f921ef7e700 1 -- 172.21.15.123:0/3951767364 wait complete. 2023-07-21T19:08:48.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.663+0000 7f921ef7e700 1 Processor -- start 2023-07-21T19:08:48.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.663+0000 7f921ef7e700 1 -- start start 2023-07-21T19:08:48.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92180cd7f0 0x7f9218153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 0x7f92180b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92181603d0 0x7f9218159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181535a0 con 0x7f9218160000 2023-07-21T19:08:48.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c7db0 con 0x7f92180cd7f0 2023-07-21T19:08:48.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180b1a30 con 0x7f92181603d0 2023-07-21T19:08:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 0x7f92180b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 0x7f92180b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36600/0 (socket says 172.21.15.123:36600) 2023-07-21T19:08:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 -- 172.21.15.123:0/2251037861 learned_addr learned my addr 172.21.15.123:0/2251037861 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921df7c700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92180cd7f0 0x7f9218153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921e77d700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92181603d0 0x7f9218159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 -- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92181603d0 msgr2=0x7f9218159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92181603d0 0x7f9218159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 -- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92180cd7f0 msgr2=0x7f9218153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92180cd7f0 0x7f9218153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 -- 172.21.15.123:0/2251037861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210009b30 con 0x7f9218160000 2023-07-21T19:08:48.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921d77b700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 0x7f92180b2230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f920800e840 tx=0x7f920800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080095a0 con 0x7f9218160000 2023-07-21T19:08:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208013680 con 0x7f9218160000 2023-07-21T19:08:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92180b1d10 con 0x7f9218160000 2023-07-21T19:08:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080139f0 con 0x7f9218160000 2023-07-21T19:08:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.667+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92180b2770 con 0x7f9218160000 2023-07-21T19:08:48.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.671+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921804e500 con 0x7f9218160000 2023-07-21T19:08:48.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.671+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9208013b50 con 0x7f9218160000 2023-07-21T19:08:48.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.671+0000 7f920e7fc700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f91fc0662f0 0x7f91fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.671+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9208083f00 con 0x7f9218160000 2023-07-21T19:08:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.671+0000 7f921df7c700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f91fc0662f0 0x7f91fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.675+0000 7f921df7c700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f91fc0662f0 0x7f91fc0687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9214000f60 tx=0x7f9214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:48.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.679+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9208054a60 con 0x7f9218160000 2023-07-21T19:08:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.847+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92180b02e0 con 0x7f9218160000 2023-07-21T19:08:48.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f920e7fc700 1 -- 172.21.15.123:0/2251037861 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92080545f0 con 0x7f9218160000 2023-07-21T19:08:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f91fc0662f0 msgr2=0x7f91fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f91fc0662f0 0x7f91fc0687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9214000f60 tx=0x7f9214009040 comp rx=0 tx=0).stop 2023-07-21T19:08:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 msgr2=0x7f92180b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 0x7f92180b2230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f920800e840 tx=0x7f920800eb50 comp rx=0 tx=0).stop 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 shutdown_connections 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f91fc0662f0 0x7f91fc0687a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92181603d0 0x7f9218159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9218160000 0x7f92180b2230 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 --2- 172.21.15.123:0/2251037861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92180cd7f0 0x7f9218153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 >> 172.21.15.123:0/2251037861 conn(0x7f92180afc60 msgr2=0x7f92180c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 shutdown_connections 2023-07-21T19:08:48.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:48.851+0000 7f921ef7e700 1 -- 172.21.15.123:0/2251037861 wait complete. 2023-07-21T19:08:48.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 Processor -- start 2023-07-21T19:08:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 -- start start 2023-07-21T19:08:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72e0159c60 0x7f72e006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e00b0770 0x7f72e0070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e006da00 con 0x7f72e00cab00 2023-07-21T19:08:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e006dce0 con 0x7f72e0159c60 2023-07-21T19:08:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.055+0000 7f72dffff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e006dfc0 con 0x7f72e00b0770 2023-07-21T19:08:49.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72df7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72e00cab00 0x7f72e00c1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52150/0 (socket says 172.21.15.123:52150) 2023-07-21T19:08:49.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72df7fe700 1 -- 172.21.15.123:0/3022737900 learned_addr learned my addr 172.21.15.123:0/3022737900 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:49.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72deffd700 1 --2- 172.21.15.123:0/3022737900 >> v2:172.21.15.123:3300/0 conn(0x7f72e0159c60 0x7f72e006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72de7fc700 1 --2- 172.21.15.123:0/3022737900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e00b0770 0x7f72e0070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72deffd700 1 -- 172.21.15.123:0/3022737900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e00b0770 msgr2=0x7f72e0070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72deffd700 1 --2- 172.21.15.123:0/3022737900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e00b0770 0x7f72e0070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72deffd700 1 -- 172.21.15.123:0/3022737900 >> v1:172.21.15.123:6789/0 conn(0x7f72e00cab00 legacy=0x7f72e00c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72ddffb700 1 -- 172.21.15.123:0/3022737900 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686721139 0 0) 0x7f72e006da00 con 0x7f72e00cab00 2023-07-21T19:08:49.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72deffd700 1 -- 172.21.15.123:0/3022737900 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00705e0 con 0x7f72e0159c60 2023-07-21T19:08:49.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72deffd700 1 --2- 172.21.15.123:0/3022737900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0159c60 0x7f72e006d3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009850 tx=0x7f72d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9986872a3bbbd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72ddffb700 1 -- 172.21.15.123:0/3022737900 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011830 con 0x7f72e0159c60 2023-07-21T19:08:49.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72ddffb700 1 -- 172.21.15.123:0/3022737900 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d0011990 con 0x7f72e0159c60 2023-07-21T19:08:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72ddffb700 1 -- 172.21.15.123:0/3022737900 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011d40 con 0x7f72e0159c60 2023-07-21T19:08:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 -- 172.21.15.123:0/3022737900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0159c60 msgr2=0x7f72e006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 --2- 172.21.15.123:0/3022737900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0159c60 0x7f72e006d3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009850 tx=0x7f72d0009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 -- 172.21.15.123:0/3022737900 shutdown_connections 2023-07-21T19:08:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 --2- 172.21.15.123:0/3022737900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e00b0770 0x7f72e0070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 --2- 172.21.15.123:0/3022737900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0159c60 0x7f72e006d3b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 -- 172.21.15.123:0/3022737900 >> 172.21.15.123:0/3022737900 conn(0x7f72e00afc60 msgr2=0x7f72e00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 -- 172.21.15.123:0/3022737900 shutdown_connections 2023-07-21T19:08:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.059+0000 7f72dffff700 1 -- 172.21.15.123:0/3022737900 wait complete. 2023-07-21T19:08:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 Processor -- start 2023-07-21T19:08:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 -- start start 2023-07-21T19:08:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72e00b0770 0x7f72e00ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 0x7f72e014f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e0159c60 0x7f72e00b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c2f30 con 0x7f72e00cab00 2023-07-21T19:08:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e014fc40 con 0x7f72e00b0770 2023-07-21T19:08:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72dffff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01e2b20 con 0x7f72e0159c60 2023-07-21T19:08:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 0x7f72e014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 0x7f72e014f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36628/0 (socket says 172.21.15.123:36628) 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72de7fc700 1 -- 172.21.15.123:0/3283458655 learned_addr learned my addr 172.21.15.123:0/3283458655 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72df7fe700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e0159c60 0x7f72e00b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.063+0000 7f72deffd700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72e00b0770 0x7f72e00ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72de7fc700 1 -- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e0159c60 msgr2=0x7f72e00b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72de7fc700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e0159c60 0x7f72e00b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72de7fc700 1 -- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72e00b0770 msgr2=0x7f72e00ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72de7fc700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72e00b0770 0x7f72e00ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72de7fc700 1 -- 172.21.15.123:0/3283458655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d00094b0 con 0x7f72e00cab00 2023-07-21T19:08:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72deffd700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72e00b0770 0x7f72e00ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72df7fe700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e0159c60 0x7f72e00b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72de7fc700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 0x7f72e014f700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f72d400e9d0 tx=0x7f72d400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4009720 con 0x7f72e00cab00 2023-07-21T19:08:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400c850 con 0x7f72e00cab00 2023-07-21T19:08:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e00c3180 con 0x7f72e00cab00 2023-07-21T19:08:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400cbc0 con 0x7f72e00cab00 2023-07-21T19:08:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e00c3740 con 0x7f72e00cab00 2023-07-21T19:08:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e01e45f0 con 0x7f72e00cab00 2023-07-21T19:08:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.067+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72d400cd20 con 0x7f72e00cab00 2023-07-21T19:08:49.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.071+0000 7f72c77fe700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f72cc0662f0 0x7f72cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.071+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f72d40841a0 con 0x7f72e00cab00 2023-07-21T19:08:49.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.071+0000 7f72deffd700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f72cc0662f0 0x7f72cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.071+0000 7f72deffd700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f72cc0662f0 0x7f72cc0687a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f72d00090b0 tx=0x7f72d001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.075+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f72e01e45f0 con 0x7f72e00cab00 2023-07-21T19:08:49.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.247+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72e01e45f0 con 0x7f72e00cab00 2023-07-21T19:08:49.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.251+0000 7f72c77fe700 1 -- 172.21.15.123:0/3283458655 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72e01e45f0 con 0x7f72e00cab00 2023-07-21T19:08:49.263 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:49.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f72cc0662f0 msgr2=0x7f72cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f72cc0662f0 0x7f72cc0687a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f72d00090b0 tx=0x7f72d001c040 comp rx=0 tx=0).stop 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 msgr2=0x7f72e014f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 0x7f72e014f700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f72d400e9d0 tx=0x7f72d400ed90 comp rx=0 tx=0).stop 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 shutdown_connections 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f72cc0662f0 0x7f72cc0687a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72e0159c60 0x7f72e00b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e00cab00 0x7f72e014f700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 --2- 172.21.15.123:0/3283458655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72e00b0770 0x7f72e00ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 >> 172.21.15.123:0/3283458655 conn(0x7f72e00afc60 msgr2=0x7f72e00c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 shutdown_connections 2023-07-21T19:08:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.255+0000 7f72dffff700 1 -- 172.21.15.123:0/3283458655 wait complete. 2023-07-21T19:08:49.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:49.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 Processor -- start 2023-07-21T19:08:49.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 -- start start 2023-07-21T19:08:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd53c0b0ee0 0x7fd53c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd53c0cd090 0x7fd53c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0cd4e0 con 0x7fd53c0d0610 2023-07-21T19:08:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0d1a60 con 0x7fd53c0b0ee0 2023-07-21T19:08:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd541400700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0d1ef0 con 0x7fd53c0cd090 2023-07-21T19:08:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd53b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd53c0d0610 0x7fd53c15f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52162/0 (socket says 172.21.15.123:52162) 2023-07-21T19:08:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.455+0000 7fd53b7fe700 1 -- 172.21.15.123:0/1572680378 learned_addr learned my addr 172.21.15.123:0/1572680378 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53affd700 1 --2- 172.21.15.123:0/1572680378 >> v2:172.21.15.123:3300/0 conn(0x7fd53c0b0ee0 0x7fd53c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53a7fc700 1 --2- 172.21.15.123:0/1572680378 >> v2:172.21.15.145:3300/0 conn(0x7fd53c0cd090 0x7fd53c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd539ffb700 1 -- 172.21.15.123:0/1572680378 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803561628 0 0) 0x7fd534001490 con 0x7fd53c0d0610 2023-07-21T19:08:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd539ffb700 1 -- 172.21.15.123:0/1572680378 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240035d0 con 0x7fd53c0d0610 2023-07-21T19:08:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53a7fc700 1 -- 172.21.15.123:0/1572680378 >> v2:172.21.15.123:3300/0 conn(0x7fd53c0b0ee0 msgr2=0x7fd53c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53a7fc700 1 --2- 172.21.15.123:0/1572680378 >> v2:172.21.15.123:3300/0 conn(0x7fd53c0b0ee0 0x7fd53c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53a7fc700 1 -- 172.21.15.123:0/1572680378 >> v1:172.21.15.123:6789/0 conn(0x7fd53c0d0610 legacy=0x7fd53c15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd539ffb700 1 -- 172.21.15.123:0/1572680378 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259512401 0 0) 0x7fd5240035d0 con 0x7fd53c0d0610 2023-07-21T19:08:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53a7fc700 1 -- 172.21.15.123:0/1572680378 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0d0e50 con 0x7fd53c0cd090 2023-07-21T19:08:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53affd700 1 --2- 172.21.15.123:0/1572680378 >> v2:172.21.15.123:3300/0 conn(0x7fd53c0b0ee0 0x7fd53c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd53a7fc700 1 --2- 172.21.15.123:0/1572680378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0cd090 0x7fd53c0d00d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0b5090 tx=0x7fd530009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2031447e847268a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd539ffb700 1 -- 172.21.15.123:0/1572680378 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534001b80 con 0x7fd53c0cd090 2023-07-21T19:08:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd539ffb700 1 -- 172.21.15.123:0/1572680378 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530004030 con 0x7fd53c0cd090 2023-07-21T19:08:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd539ffb700 1 -- 172.21.15.123:0/1572680378 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300043c0 con 0x7fd53c0cd090 2023-07-21T19:08:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd541400700 1 -- 172.21.15.123:0/1572680378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0cd090 msgr2=0x7fd53c0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd541400700 1 --2- 172.21.15.123:0/1572680378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0cd090 0x7fd53c0d00d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0b5090 tx=0x7fd530009b30 comp rx=0 tx=0).stop 2023-07-21T19:08:49.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd541400700 1 -- 172.21.15.123:0/1572680378 shutdown_connections 2023-07-21T19:08:49.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd541400700 1 --2- 172.21.15.123:0/1572680378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0cd090 0x7fd53c0d00d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd541400700 1 --2- 172.21.15.123:0/1572680378 >> v2:172.21.15.123:3300/0 conn(0x7fd53c0b0ee0 0x7fd53c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.459+0000 7fd541400700 1 -- 172.21.15.123:0/1572680378 >> 172.21.15.123:0/1572680378 conn(0x7fd53c060c40 msgr2=0x7fd53c09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.463+0000 7fd541400700 1 -- 172.21.15.123:0/1572680378 shutdown_connections 2023-07-21T19:08:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.463+0000 7fd541400700 1 -- 172.21.15.123:0/1572680378 wait complete. 2023-07-21T19:08:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.463+0000 7fd541400700 1 Processor -- start 2023-07-21T19:08:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.463+0000 7fd541400700 1 -- start start 2023-07-21T19:08:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0b0ee0 0x7fd53c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd53c0cd090 0x7fd53c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 0x7fd53c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0ca750 con 0x7fd53c0d0610 2023-07-21T19:08:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0caa30 con 0x7fd53c0b0ee0 2023-07-21T19:08:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cad10 con 0x7fd53c0cd090 2023-07-21T19:08:49.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 0x7fd53c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53affd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0b0ee0 0x7fd53c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 0x7fd53c15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36638/0 (socket says 172.21.15.123:36638) 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 -- 172.21.15.123:0/1034551671 learned_addr learned my addr 172.21.15.123:0/1034551671 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53a7fc700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd53c0cd090 0x7fd53c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 -- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd53c0cd090 msgr2=0x7fd53c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd53c0cd090 0x7fd53c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 -- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0b0ee0 msgr2=0x7fd53c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0b0ee0 0x7fd53c0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 -- 172.21.15.123:0/1034551671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c0094b0 con 0x7fd53c0d0610 2023-07-21T19:08:49.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53affd700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0b0ee0 0x7fd53c0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:49.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd53b7fe700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 0x7fd53c15cc60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd53400cc90 tx=0x7fd53400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400aad0 con 0x7fd53c0d0610 2023-07-21T19:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53400ac30 con 0x7fd53c0d0610 2023-07-21T19:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5340070d0 con 0x7fd53c0d0610 2023-07-21T19:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5300094b0 con 0x7fd53c0d0610 2023-07-21T19:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.467+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0cb2d0 con 0x7fd53c0d0610 2023-07-21T19:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.471+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c0cb4c0 con 0x7fd53c0d0610 2023-07-21T19:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.471+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd534007230 con 0x7fd53c0d0610 2023-07-21T19:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.475+0000 7fd5237fe700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd5280662f0 0x7fd5280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.475+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd534083a30 con 0x7fd53c0d0610 2023-07-21T19:08:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.475+0000 7fd53affd700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd5280662f0 0x7fd5280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.475+0000 7fd53affd700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd5280662f0 0x7fd5280687a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0113d0 tx=0x7fd52c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.479+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd534050b70 con 0x7fd53c0d0610 2023-07-21T19:08:49.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.651+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd53c0cd4e0 con 0x7fd53c0d0610 2023-07-21T19:08:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.651+0000 7fd5237fe700 1 -- 172.21.15.123:0/1034551671 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd53c0cd4e0 con 0x7fd53c0d0610 2023-07-21T19:08:49.665 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:49.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd5280662f0 msgr2=0x7fd5280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd5280662f0 0x7fd5280687a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0113d0 tx=0x7fd52c009240 comp rx=0 tx=0).stop 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 msgr2=0x7fd53c15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 0x7fd53c15cc60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd53400cc90 tx=0x7fd53400a060 comp rx=0 tx=0).stop 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 shutdown_connections 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd5280662f0 0x7fd5280687a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd53c0d0610 0x7fd53c15cc60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd53c0cd090 0x7fd53c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 --2- 172.21.15.123:0/1034551671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd53c0b0ee0 0x7fd53c0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 >> 172.21.15.123:0/1034551671 conn(0x7fd53c060c40 msgr2=0x7fd53c06fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 shutdown_connections 2023-07-21T19:08:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.655+0000 7fd541400700 1 -- 172.21.15.123:0/1034551671 wait complete. 2023-07-21T19:08:49.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:08:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.851+0000 7fd92134d700 1 Processor -- start 2023-07-21T19:08:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd92134d700 1 -- start start 2023-07-21T19:08:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd92134d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c06dc20 0x7fd91c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd92134d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd91c0c9820 0x7fd91c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd92134d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c159d60 con 0x7fd91c158fe0 2023-07-21T19:08:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd92134d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0cd250 con 0x7fd91c0c9820 2023-07-21T19:08:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd92134d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c8a60 con 0x7fd91c06dc20 2023-07-21T19:08:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd91c0c9820 0x7fd91c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91affd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c06dc20 0x7fd91c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd91c0c9820 0x7fd91c0ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44616/0 (socket says 172.21.15.123:44616) 2023-07-21T19:08:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 -- 172.21.15.123:0/2333037583 learned_addr learned my addr 172.21.15.123:0/2333037583 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91b7fe700 1 --1- 172.21.15.123:0/2333037583 >> v1:172.21.15.145:6789/0 conn(0x7fd91c158fe0 0x7fd91c159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:36164/0 (socket says 172.21.15.123:36164) 2023-07-21T19:08:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 -- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c06dc20 msgr2=0x7fd91c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 --2- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c06dc20 0x7fd91c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 -- 172.21.15.123:0/2333037583 >> v1:172.21.15.145:6789/0 conn(0x7fd91c158fe0 legacy=0x7fd91c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.855+0000 7fd91a7fc700 1 -- 172.21.15.123:0/2333037583 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0c8d40 con 0x7fd91c0c9820 2023-07-21T19:08:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd91a7fc700 1 --2- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c0c9820 0x7fd91c0ce410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd910009940 tx=0x7fd910009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ccffa3d812d968c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd919ffb700 1 -- 172.21.15.123:0/2333037583 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910011830 con 0x7fd91c0c9820 2023-07-21T19:08:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd919ffb700 1 -- 172.21.15.123:0/2333037583 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910011990 con 0x7fd91c0c9820 2023-07-21T19:08:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd919ffb700 1 -- 172.21.15.123:0/2333037583 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910011d20 con 0x7fd91c0c9820 2023-07-21T19:08:49.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 -- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c0c9820 msgr2=0x7fd91c0ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 --2- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c0c9820 0x7fd91c0ce410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd910009940 tx=0x7fd910009c50 comp rx=0 tx=0).stop 2023-07-21T19:08:49.873 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 -- 172.21.15.123:0/2333037583 shutdown_connections 2023-07-21T19:08:49.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 --2- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c0c9820 0x7fd91c0ce410 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 --2- 172.21.15.123:0/2333037583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c06dc20 0x7fd91c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 -- 172.21.15.123:0/2333037583 >> 172.21.15.123:0/2333037583 conn(0x7fd91c06e960 msgr2=0x7fd91c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:49.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 -- 172.21.15.123:0/2333037583 shutdown_connections 2023-07-21T19:08:49.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.859+0000 7fd92134d700 1 -- 172.21.15.123:0/2333037583 wait complete. 2023-07-21T19:08:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 Processor -- start 2023-07-21T19:08:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 -- start start 2023-07-21T19:08:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 0x7fd91c1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c9820 0x7fd91c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c158fe0 0x7fd91c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0ae660 con 0x7fd91c06dc20 2023-07-21T19:08:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0ae940 con 0x7fd91c158fe0 2023-07-21T19:08:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd92134d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0aec20 con 0x7fd91c0c9820 2023-07-21T19:08:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 0x7fd91c1f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 0x7fd91c1f0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36644/0 (socket says 172.21.15.123:36644) 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 -- 172.21.15.123:0/1086951903 learned_addr learned my addr 172.21.15.123:0/1086951903 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91a7fc700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c9820 0x7fd91c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91b7fe700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c158fe0 0x7fd91c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 -- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c9820 msgr2=0x7fd91c0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c9820 0x7fd91c0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 -- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c158fe0 msgr2=0x7fd91c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c158fe0 0x7fd91c0b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91affd700 1 -- 172.21.15.123:0/1086951903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009570 con 0x7fd91c06dc20 2023-07-21T19:08:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.863+0000 7fd91b7fe700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c158fe0 0x7fd91c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd91affd700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 0x7fd91c1f0a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00e9d0 tx=0x7fd90c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c009720 con 0x7fd91c06dc20 2023-07-21T19:08:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00c850 con 0x7fd91c06dc20 2023-07-21T19:08:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c0b0f90 con 0x7fd91c06dc20 2023-07-21T19:08:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00cbc0 con 0x7fd91c06dc20 2023-07-21T19:08:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c154fa0 con 0x7fd91c06dc20 2023-07-21T19:08:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.867+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c15d050 con 0x7fd91c06dc20 2023-07-21T19:08:49.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.871+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd90c00cd20 con 0x7fd91c06dc20 2023-07-21T19:08:49.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.871+0000 7fd9037fe700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd9080662f0 0x7fd9080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.871+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd90c084170 con 0x7fd91c06dc20 2023-07-21T19:08:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.871+0000 7fd91a7fc700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd9080662f0 0x7fd9080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.871+0000 7fd91a7fc700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd9080662f0 0x7fd9080687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0c9c10 tx=0x7fd910008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:49.879+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd90c051220 con 0x7fd91c06dc20 2023-07-21T19:08:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.067+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd91c04e500 con 0x7fd91c06dc20 2023-07-21T19:08:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.067+0000 7fd9037fe700 1 -- 172.21.15.123:0/1086951903 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd90c054840 con 0x7fd91c06dc20 2023-07-21T19:08:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd9080662f0 msgr2=0x7fd9080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd9080662f0 0x7fd9080687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0c9c10 tx=0x7fd910008030 comp rx=0 tx=0).stop 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 msgr2=0x7fd91c1f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 0x7fd91c1f0a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00e9d0 tx=0x7fd90c00ece0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 shutdown_connections 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd9080662f0 0x7fd9080687a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c158fe0 0x7fd91c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c9820 0x7fd91c0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 --2- 172.21.15.123:0/1086951903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd91c06dc20 0x7fd91c1f0a20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 >> 172.21.15.123:0/1086951903 conn(0x7fd91c06e960 msgr2=0x7fd91c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 shutdown_connections 2023-07-21T19:08:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.071+0000 7fd92134d700 1 -- 172.21.15.123:0/1086951903 wait complete. 2023-07-21T19:08:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:08:50.111 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:50.112 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:50.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:50.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.335+0000 7f81af962700 1 Processor -- start 2023-07-21T19:08:50.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.335+0000 7f81af962700 1 -- start start 2023-07-21T19:08:50.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81af962700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a815bf20 0x7f81a80b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81af962700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f81a80d1430 0x7f81a80b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81af962700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a815c2f0 con 0x7f81a80b1530 2023-07-21T19:08:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81af962700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a8070830 con 0x7f81a80d1430 2023-07-21T19:08:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81af962700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8070b10 con 0x7f81a815bf20 2023-07-21T19:08:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81ad6fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a815bf20 0x7f81a80b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f81a80d1430 0x7f81a80b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f81a80d1430 0x7f81a80b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44636/0 (socket says 172.21.15.123:44636) 2023-07-21T19:08:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 -- 172.21.15.123:0/1290654009 learned_addr learned my addr 172.21.15.123:0/1290654009 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 -- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a815bf20 msgr2=0x7f81a80b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 --2- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a815bf20 0x7f81a80b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 -- 172.21.15.123:0/1290654009 >> v1:172.21.15.145:6789/0 conn(0x7f81a80b1530 legacy=0x7f81a80d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 -- 172.21.15.123:0/1290654009 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80cccc0 con 0x7f81a80d1430 2023-07-21T19:08:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.339+0000 7f81adeff700 1 --2- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a80d1430 0x7f81a80b4050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009e50 tx=0x7f81a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c6e6f7dbb26707 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f819ffff700 1 -- 172.21.15.123:0/1290654009 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a000e070 con 0x7f81a80d1430 2023-07-21T19:08:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f819ffff700 1 -- 172.21.15.123:0/1290654009 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a000b910 con 0x7f81a80d1430 2023-07-21T19:08:50.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f819ffff700 1 -- 172.21.15.123:0/1290654009 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a000bcc0 con 0x7f81a80d1430 2023-07-21T19:08:50.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 -- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a80d1430 msgr2=0x7f81a80b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 --2- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a80d1430 0x7f81a80b4050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009e50 tx=0x7f81a000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 -- 172.21.15.123:0/1290654009 shutdown_connections 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 --2- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a80d1430 0x7f81a80b4050 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 --2- 172.21.15.123:0/1290654009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a815bf20 0x7f81a80b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 -- 172.21.15.123:0/1290654009 >> 172.21.15.123:0/1290654009 conn(0x7f81a806fc80 msgr2=0x7f81a8070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 -- 172.21.15.123:0/1290654009 shutdown_connections 2023-07-21T19:08:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.343+0000 7f81af962700 1 -- 172.21.15.123:0/1290654009 wait complete. 2023-07-21T19:08:50.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 Processor -- start 2023-07-21T19:08:50.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 -- start start 2023-07-21T19:08:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a80b1530 0x7f81a80c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 0x7f81a80b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a815bf20 0x7f81a80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80b8290 con 0x7f81a80d1430 2023-07-21T19:08:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80b68d0 con 0x7f81a815bf20 2023-07-21T19:08:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80b6bb0 con 0x7f81a80b1530 2023-07-21T19:08:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 0x7f81a80b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 0x7f81a80b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36646/0 (socket says 172.21.15.123:36646) 2023-07-21T19:08:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 -- 172.21.15.123:0/356557031 learned_addr learned my addr 172.21.15.123:0/356557031 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81ad6fe700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a80b1530 0x7f81a80c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81adeff700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a815bf20 0x7f81a80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 -- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a80b1530 msgr2=0x7f81a80c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a80b1530 0x7f81a80c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 -- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a815bf20 msgr2=0x7f81a80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a815bf20 0x7f81a80b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 -- 172.21.15.123:0/356557031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0009b30 con 0x7f81a80d1430 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81acefd700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 0x7f81a80b7d50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f819800c500 tx=0x7f819800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980052d0 con 0x7f81a80d1430 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198005430 con 0x7f81a80d1430 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980055a0 con 0x7f81a80d1430 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.347+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a80b6e90 con 0x7f81a80d1430 2023-07-21T19:08:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.351+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a80b7450 con 0x7f81a80d1430 2023-07-21T19:08:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.351+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a80b7610 con 0x7f81a80d1430 2023-07-21T19:08:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.351+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81980038e0 con 0x7f81a80d1430 2023-07-21T19:08:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.355+0000 7f819dffb700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f818c066320 0x7f818c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.355+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8198083250 con 0x7f81a80d1430 2023-07-21T19:08:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.355+0000 7f81ad6fe700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f818c066320 0x7f818c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.355+0000 7f81ad6fe700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f818c066320 0x7f818c0687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b8400 tx=0x7f81a4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:50.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.363+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8198050430 con 0x7f81a80d1430 2023-07-21T19:08:50.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.535+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81a804dcb0 con 0x7f81a80d1430 2023-07-21T19:08:50.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.539+0000 7f819dffb700 1 -- 172.21.15.123:0/356557031 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f8198053a50 con 0x7f81a80d1430 2023-07-21T19:08:50.552 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:50.552 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:50.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.539+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f818c066320 msgr2=0x7f818c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.539+0000 7f81af962700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f818c066320 0x7f818c0687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b8400 tx=0x7f81a4009240 comp rx=0 tx=0).stop 2023-07-21T19:08:50.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.539+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 msgr2=0x7f81a80b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.539+0000 7f81af962700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 0x7f81a80b7d50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f819800c500 tx=0x7f819800c810 comp rx=0 tx=0).stop 2023-07-21T19:08:50.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 shutdown_connections 2023-07-21T19:08:50.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f818c066320 0x7f818c0687d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a815bf20 0x7f81a80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81a80d1430 0x7f81a80b7d50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 --2- 172.21.15.123:0/356557031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81a80b1530 0x7f81a80c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 >> 172.21.15.123:0/356557031 conn(0x7f81a806fc80 msgr2=0x7f81a815e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:50.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 shutdown_connections 2023-07-21T19:08:50.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.543+0000 7f81af962700 1 -- 172.21.15.123:0/356557031 wait complete. 2023-07-21T19:08:50.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:50.577 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 Processor -- start 2023-07-21T19:08:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 -- start start 2023-07-21T19:08:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f602006d670 0x7f6020070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6020070b40 0x7f602006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020070fa0 con 0x7f602015fed0 2023-07-21T19:08:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602006db50 con 0x7f6020070b40 2023-07-21T19:08:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f6026def700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602006de30 con 0x7f602006d670 2023-07-21T19:08:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f60265ee700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6020070b40 0x7f602006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f60265ee700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6020070b40 0x7f602006c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36658/0 (socket says 172.21.15.123:36658) 2023-07-21T19:08:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.747+0000 7f60265ee700 1 -- 172.21.15.123:0/2823622627 learned_addr learned my addr 172.21.15.123:0/2823622627 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60255ec700 1 --2- 172.21.15.123:0/2823622627 >> v2:172.21.15.145:3300/0 conn(0x7f602006d670 0x7f6020070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60265ee700 1 -- 172.21.15.123:0/2823622627 >> v2:172.21.15.145:3300/0 conn(0x7f602006d670 msgr2=0x7f6020070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60265ee700 1 --2- 172.21.15.123:0/2823622627 >> v2:172.21.15.145:3300/0 conn(0x7f602006d670 0x7f6020070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60265ee700 1 -- 172.21.15.123:0/2823622627 >> v1:172.21.15.145:6789/0 conn(0x7f602015fed0 legacy=0x7f60200cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60265ee700 1 -- 172.21.15.123:0/2823622627 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602006bc60 con 0x7f6020070b40 2023-07-21T19:08:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60255ec700 1 --2- 172.21.15.123:0/2823622627 >> v2:172.21.15.145:3300/0 conn(0x7f602006d670 0x7f6020070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f60265ee700 1 --2- 172.21.15.123:0/2823622627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f602006c740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f60200caa30 tx=0x7f601800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a038c94d5f94b98 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6024deb700 1 -- 172.21.15.123:0/2823622627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800e070 con 0x7f6020070b40 2023-07-21T19:08:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6024deb700 1 -- 172.21.15.123:0/2823622627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018003a40 con 0x7f6020070b40 2023-07-21T19:08:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6024deb700 1 -- 172.21.15.123:0/2823622627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018003df0 con 0x7f6020070b40 2023-07-21T19:08:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 -- 172.21.15.123:0/2823622627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 msgr2=0x7f602006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 --2- 172.21.15.123:0/2823622627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f602006c740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f60200caa30 tx=0x7f601800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 -- 172.21.15.123:0/2823622627 shutdown_connections 2023-07-21T19:08:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 --2- 172.21.15.123:0/2823622627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f602006c740 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 --2- 172.21.15.123:0/2823622627 >> v2:172.21.15.145:3300/0 conn(0x7f602006d670 0x7f6020070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 -- 172.21.15.123:0/2823622627 >> 172.21.15.123:0/2823622627 conn(0x7f6020060320 msgr2=0x7f6020060720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 -- 172.21.15.123:0/2823622627 shutdown_connections 2023-07-21T19:08:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.751+0000 7f6026def700 1 -- 172.21.15.123:0/2823622627 wait complete. 2023-07-21T19:08:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 Processor -- start 2023-07-21T19:08:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 -- start start 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f602006d670 0x7f6020157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f60200b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f602015fed0 0x7f60200b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c5a70 con 0x7f6020070b40 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c62d0 con 0x7f602015fed0 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6026def700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020157a70 con 0x7f602006d670 2023-07-21T19:08:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f60200b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f60200b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36660/0 (socket says 172.21.15.123:36660) 2023-07-21T19:08:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 -- 172.21.15.123:0/1116396406 learned_addr learned my addr 172.21.15.123:0/1116396406 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60265ee700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f602015fed0 0x7f60200b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f6025ded700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f602006d670 0x7f6020157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 -- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f602006d670 msgr2=0x7f6020157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f602006d670 0x7f6020157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 -- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f602015fed0 msgr2=0x7f60200b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f602015fed0 0x7f60200b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60255ec700 1 -- 172.21.15.123:0/1116396406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009b30 con 0x7f6020070b40 2023-07-21T19:08:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.755+0000 7f60265ee700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f602015fed0 0x7f60200b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f60255ec700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f60200b2c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f601000c7f0 tx=0x7f601000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010011800 con 0x7f6020070b40 2023-07-21T19:08:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010011960 con 0x7f6020070b40 2023-07-21T19:08:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010011cf0 con 0x7f6020070b40 2023-07-21T19:08:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60200c7d70 con 0x7f6020070b40 2023-07-21T19:08:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60200c5f60 con 0x7f6020070b40 2023-07-21T19:08:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.759+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602004e500 con 0x7f6020070b40 2023-07-21T19:08:50.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.763+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6010021350 con 0x7f6020070b40 2023-07-21T19:08:50.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.763+0000 7f60167fc700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60040662f0 0x7f60040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:50.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.763+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6010083f90 con 0x7f6020070b40 2023-07-21T19:08:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.763+0000 7f6025ded700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60040662f0 0x7f60040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.763+0000 7f6025ded700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60040662f0 0x7f60040687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f601c005150 tx=0x7f601c007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.767+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f60100b4720 con 0x7f6020070b40 2023-07-21T19:08:50.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.939+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60200cad20 con 0x7f6020070b40 2023-07-21T19:08:50.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.939+0000 7f60167fc700 1 -- 172.21.15.123:0/1116396406 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6010054af0 con 0x7f6020070b40 2023-07-21T19:08:50.954 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:50.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60040662f0 msgr2=0x7f60040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60040662f0 0x7f60040687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f601c005150 tx=0x7f601c007ee0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 msgr2=0x7f60200b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f60200b2c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f601000c7f0 tx=0x7f601000cb00 comp rx=0 tx=0).stop 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 shutdown_connections 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60040662f0 0x7f60040687a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f602015fed0 0x7f60200b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6020070b40 0x7f60200b2c20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 --2- 172.21.15.123:0/1116396406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f602006d670 0x7f6020157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:50.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 >> 172.21.15.123:0/1116396406 conn(0x7f6020060320 msgr2=0x7f60200add10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:50.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 shutdown_connections 2023-07-21T19:08:50.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:50.943+0000 7f6026def700 1 -- 172.21.15.123:0/1116396406 wait complete. 2023-07-21T19:08:50.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:51.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.147+0000 7f40974c4700 1 Processor -- start 2023-07-21T19:08:51.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.147+0000 7f40974c4700 1 -- start start 2023-07-21T19:08:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f40900b0ee0 0x7f40900ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40900d07e0 0x7f40900af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900cd4e0 con 0x7f40900cd090 2023-07-21T19:08:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40900d0c60 con 0x7f40900d07e0 2023-07-21T19:08:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40900d1a60 con 0x7f40900b0ee0 2023-07-21T19:08:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40900d07e0 0x7f40900af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40900d07e0 0x7f40900af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36666/0 (socket says 172.21.15.123:36666) 2023-07-21T19:08:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 -- 172.21.15.123:0/792102956 learned_addr learned my addr 172.21.15.123:0/792102956 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:51.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40964c2700 1 --2- 172.21.15.123:0/792102956 >> v2:172.21.15.145:3300/0 conn(0x7f40900b0ee0 0x7f40900ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 -- 172.21.15.123:0/792102956 >> v2:172.21.15.145:3300/0 conn(0x7f40900b0ee0 msgr2=0x7f40900ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:51.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 --2- 172.21.15.123:0/792102956 >> v2:172.21.15.145:3300/0 conn(0x7f40900b0ee0 0x7f40900ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 -- 172.21.15.123:0/792102956 >> v1:172.21.15.123:6789/0 conn(0x7f40900cd090 legacy=0x7f40900d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 -- 172.21.15.123:0/792102956 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900d1ef0 con 0x7f40900d07e0 2023-07-21T19:08:51.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f4096cc3700 1 --2- 172.21.15.123:0/792102956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900af0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f409008b380 tx=0x7f408800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4aae75c4dde351 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40954c0700 1 -- 172.21.15.123:0/792102956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800e070 con 0x7f40900d07e0 2023-07-21T19:08:51.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40954c0700 1 -- 172.21.15.123:0/792102956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800b9c0 con 0x7f40900d07e0 2023-07-21T19:08:51.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40954c0700 1 -- 172.21.15.123:0/792102956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800bd70 con 0x7f40900d07e0 2023-07-21T19:08:51.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- 172.21.15.123:0/792102956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 msgr2=0x7f40900af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 --2- 172.21.15.123:0/792102956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900af0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f409008b380 tx=0x7f408800b330 comp rx=0 tx=0).stop 2023-07-21T19:08:51.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- 172.21.15.123:0/792102956 shutdown_connections 2023-07-21T19:08:51.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 --2- 172.21.15.123:0/792102956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900af0c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 --2- 172.21.15.123:0/792102956 >> v2:172.21.15.145:3300/0 conn(0x7f40900b0ee0 0x7f40900ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- 172.21.15.123:0/792102956 >> 172.21.15.123:0/792102956 conn(0x7f4090060c40 msgr2=0x7f409009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:51.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- 172.21.15.123:0/792102956 shutdown_connections 2023-07-21T19:08:51.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.151+0000 7f40974c4700 1 -- 172.21.15.123:0/792102956 wait complete. 2023-07-21T19:08:51.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 Processor -- start 2023-07-21T19:08:51.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 -- start start 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40900b0ee0 0x7f40900b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40900cd090 0x7f40901586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900b49a0 con 0x7f40900d07e0 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900c8c60 con 0x7f40900cd090 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40974c4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40900c7ea0 con 0x7f40900b0ee0 2023-07-21T19:08:51.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36678/0 (socket says 172.21.15.123:36678) 2023-07-21T19:08:51.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 -- 172.21.15.123:0/33997509 learned_addr learned my addr 172.21.15.123:0/33997509 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:51.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4095cc1700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40900cd090 0x7f40901586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f40964c2700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40900b0ee0 0x7f40900b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 -- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40900b0ee0 msgr2=0x7f40900b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40900b0ee0 0x7f40900b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 -- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40900cd090 msgr2=0x7f40901586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40900cd090 0x7f40901586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 -- 172.21.15.123:0/33997509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009b30 con 0x7f40900d07e0 2023-07-21T19:08:51.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.155+0000 7f4096cc3700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900cb5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f408800b370 tx=0x7f4088004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088004880 con 0x7f40900d07e0 2023-07-21T19:08:51.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40880099b0 con 0x7f40900d07e0 2023-07-21T19:08:51.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40900c8180 con 0x7f40900d07e0 2023-07-21T19:08:51.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408801c680 con 0x7f40900d07e0 2023-07-21T19:08:51.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40900c8740 con 0x7f40900d07e0 2023-07-21T19:08:51.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40900c8960 con 0x7f40900d07e0 2023-07-21T19:08:51.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.159+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f408801c7e0 con 0x7f40900d07e0 2023-07-21T19:08:51.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.163+0000 7f4086ffd700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f40740662f0 0x7f40740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.163+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4088085c50 con 0x7f40900d07e0 2023-07-21T19:08:51.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.163+0000 7f40964c2700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f40740662f0 0x7f40740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.163+0000 7f40964c2700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f40740662f0 0x7f40740687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f408c007a60 tx=0x7f408c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.167+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4088052d90 con 0x7f40900d07e0 2023-07-21T19:08:51.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.339+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f409004e500 con 0x7f40900d07e0 2023-07-21T19:08:51.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.339+0000 7f4086ffd700 1 -- 172.21.15.123:0/33997509 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f40880563b0 con 0x7f40900d07e0 2023-07-21T19:08:51.353 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f40740662f0 msgr2=0x7f40740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f40740662f0 0x7f40740687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f408c007a60 tx=0x7f408c008040 comp rx=0 tx=0).stop 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 msgr2=0x7f40900cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900cb5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f408800b370 tx=0x7f4088004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 shutdown_connections 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f40740662f0 0x7f40740687a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40900cd090 0x7f40901586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40900d07e0 0x7f40900cb5a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 --2- 172.21.15.123:0/33997509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40900b0ee0 0x7f40900b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 >> 172.21.15.123:0/33997509 conn(0x7f4090060c40 msgr2=0x7f40900b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 shutdown_connections 2023-07-21T19:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.343+0000 7f40974c4700 1 -- 172.21.15.123:0/33997509 wait complete. 2023-07-21T19:08:51.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:51.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.539+0000 7f8700365700 1 Processor -- start 2023-07-21T19:08:51.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.539+0000 7f8700365700 1 -- start start 2023-07-21T19:08:51.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f8700365700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86f80b0cb0 0x7f86f815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f8700365700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f806f970 con 0x7f86f80ca8d0 2023-07-21T19:08:51.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f8700365700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80ce790 con 0x7f86f80caca0 2023-07-21T19:08:51.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f8700365700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f80ce570 con 0x7f86f80b0cb0 2023-07-21T19:08:51.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe101700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f86f80ca8d0 0x7f86f80cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52180/0 (socket says 172.21.15.123:52180) 2023-07-21T19:08:51.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe902700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86f80b0cb0 0x7f86f815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe101700 1 -- 172.21.15.123:0/154360880 learned_addr learned my addr 172.21.15.123:0/154360880 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:51.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fd0ff700 1 -- 172.21.15.123:0/154360880 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876717320 0 0) 0x7f86f806f970 con 0x7f86f80ca8d0 2023-07-21T19:08:51.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fd0ff700 1 -- 172.21.15.123:0/154360880 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e40035d0 con 0x7f86f80ca8d0 2023-07-21T19:08:51.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe902700 1 -- 172.21.15.123:0/154360880 >> v1:172.21.15.145:6789/0 conn(0x7f86f80caca0 legacy=0x7f86f80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe902700 1 -- 172.21.15.123:0/154360880 >> v1:172.21.15.123:6789/0 conn(0x7f86f80ca8d0 legacy=0x7f86f80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe902700 1 -- 172.21.15.123:0/154360880 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f815fc80 con 0x7f86f80b0cb0 2023-07-21T19:08:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fe902700 1 --2- 172.21.15.123:0/154360880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f815b7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009d90 tx=0x7f86f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb0db4f415ada9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fd0ff700 1 -- 172.21.15.123:0/154360880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f000e070 con 0x7f86f80b0cb0 2023-07-21T19:08:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fd0ff700 1 -- 172.21.15.123:0/154360880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f000bb20 con 0x7f86f80b0cb0 2023-07-21T19:08:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.543+0000 7f86fd0ff700 1 -- 172.21.15.123:0/154360880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0012430 con 0x7f86f80b0cb0 2023-07-21T19:08:51.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- 172.21.15.123:0/154360880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 msgr2=0x7f86f815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 --2- 172.21.15.123:0/154360880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f815b7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009d90 tx=0x7f86f000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- 172.21.15.123:0/154360880 shutdown_connections 2023-07-21T19:08:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 --2- 172.21.15.123:0/154360880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f815b7a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- 172.21.15.123:0/154360880 >> 172.21.15.123:0/154360880 conn(0x7f86f80cb5a0 msgr2=0x7f86f80cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- 172.21.15.123:0/154360880 shutdown_connections 2023-07-21T19:08:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- 172.21.15.123:0/154360880 wait complete. 2023-07-21T19:08:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 Processor -- start 2023-07-21T19:08:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- start start 2023-07-21T19:08:51.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f80c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86f80ca8d0 0x7f86f81f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80caca0 0x7f86f8154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80c2a50 con 0x7f86f80b0cb0 2023-07-21T19:08:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f81f2440 con 0x7f86f80caca0 2023-07-21T19:08:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.547+0000 7f8700365700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f81552f0 con 0x7f86f80ca8d0 2023-07-21T19:08:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f80c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f80c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36700/0 (socket says 172.21.15.123:36700) 2023-07-21T19:08:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 -- 172.21.15.123:0/2561545424 learned_addr learned my addr 172.21.15.123:0/2561545424 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe902700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80caca0 0x7f86f8154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fd900700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86f80ca8d0 0x7f86f81f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 -- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86f80ca8d0 msgr2=0x7f86f81f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86f80ca8d0 0x7f86f81f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 -- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80caca0 msgr2=0x7f86f8154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80caca0 0x7f86f8154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 -- 172.21.15.123:0/2561545424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0009a70 con 0x7f86f80b0cb0 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe902700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80caca0 0x7f86f8154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86fe101700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f80c46b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c700 tx=0x7f86f400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4005d90 con 0x7f86f80b0cb0 2023-07-21T19:08:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f40070d0 con 0x7f86f80b0cb0 2023-07-21T19:08:51.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4007480 con 0x7f86f80b0cb0 2023-07-21T19:08:51.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f80c26b0 con 0x7f86f80b0cb0 2023-07-21T19:08:51.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f80c5020 con 0x7f86f80b0cb0 2023-07-21T19:08:51.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.551+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f8060b30 con 0x7f86f80b0cb0 2023-07-21T19:08:51.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.555+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86f40075e0 con 0x7f86f80b0cb0 2023-07-21T19:08:51.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.555+0000 7f86eeffd700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f86dc0662f0 0x7f86dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.555+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f86f4083710 con 0x7f86f80b0cb0 2023-07-21T19:08:51.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.555+0000 7f86fd900700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f86dc0662f0 0x7f86dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.559+0000 7f86fd900700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f86dc0662f0 0x7f86dc0687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86f8158e20 tx=0x7f86e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.563+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f86f40507d0 con 0x7f86f80b0cb0 2023-07-21T19:08:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.739+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86f804dcb0 con 0x7f86f80b0cb0 2023-07-21T19:08:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.739+0000 7f86eeffd700 1 -- 172.21.15.123:0/2561545424 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86f4053df0 con 0x7f86f80b0cb0 2023-07-21T19:08:51.753 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:51.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f86dc0662f0 msgr2=0x7f86dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f86dc0662f0 0x7f86dc0687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86f8158e20 tx=0x7f86e8009040 comp rx=0 tx=0).stop 2023-07-21T19:08:51.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 msgr2=0x7f86f80c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f80c46b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c700 tx=0x7f86f400cac0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 shutdown_connections 2023-07-21T19:08:51.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f86dc0662f0 0x7f86dc0687a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80caca0 0x7f86f8154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86f80ca8d0 0x7f86f81f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 --2- 172.21.15.123:0/2561545424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80b0cb0 0x7f86f80c46b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 >> 172.21.15.123:0/2561545424 conn(0x7f86f80cb5a0 msgr2=0x7f86f80ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:51.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 shutdown_connections 2023-07-21T19:08:51.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.743+0000 7f8700365700 1 -- 172.21.15.123:0/2561545424 wait complete. 2023-07-21T19:08:51.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.943+0000 7f1ef4a53700 1 Processor -- start 2023-07-21T19:08:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.943+0000 7f1ef4a53700 1 -- start start 2023-07-21T19:08:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1ef4a53700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef00ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1ef4a53700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 0x7f1ef00d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1ef4a53700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef00cd4e0 con 0x7f1ef00d0610 2023-07-21T19:08:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1ef4a53700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00d1a60 con 0x7f1ef00cd090 2023-07-21T19:08:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1ef4a53700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00d1ef0 con 0x7f1ef00b0ee0 2023-07-21T19:08:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eeeffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 0x7f1ef00d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eeeffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 0x7f1ef00d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:44706/0 (socket says 172.21.15.123:44706) 2023-07-21T19:08:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef00ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eeeffd700 1 -- 172.21.15.123:0/606414153 learned_addr learned my addr 172.21.15.123:0/606414153 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eeffff700 1 --1- 172.21.15.123:0/606414153 >> v1:172.21.15.145:6789/0 conn(0x7f1ef00d0610 0x7f1ef015f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:36198/0 (socket says 172.21.15.123:36198) 2023-07-21T19:08:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eef7fe700 1 -- 172.21.15.123:0/606414153 >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 msgr2=0x7f1ef00d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:51.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eef7fe700 1 --2- 172.21.15.123:0/606414153 >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 0x7f1ef00d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eef7fe700 1 -- 172.21.15.123:0/606414153 >> v1:172.21.15.145:6789/0 conn(0x7f1ef00d0610 legacy=0x7f1ef015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eef7fe700 1 -- 172.21.15.123:0/606414153 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00d0e50 con 0x7f1ef00b0ee0 2023-07-21T19:08:51.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eeeffd700 1 --2- 172.21.15.123:0/606414153 >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 0x7f1ef00d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:08:51.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.947+0000 7f1eef7fe700 1 --2- 172.21.15.123:0/606414153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef00ccb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009880 tx=0x7f1ee0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7221ada839cef69 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1eee7fc700 1 -- 172.21.15.123:0/606414153 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011830 con 0x7f1ef00b0ee0 2023-07-21T19:08:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1eee7fc700 1 -- 172.21.15.123:0/606414153 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0011990 con 0x7f1ef00b0ee0 2023-07-21T19:08:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1eee7fc700 1 -- 172.21.15.123:0/606414153 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011d20 con 0x7f1ef00b0ee0 2023-07-21T19:08:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 -- 172.21.15.123:0/606414153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 msgr2=0x7f1ef00ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/606414153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef00ccb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009880 tx=0x7f1ee0009b90 comp rx=0 tx=0).stop 2023-07-21T19:08:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 -- 172.21.15.123:0/606414153 shutdown_connections 2023-07-21T19:08:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/606414153 >> v2:172.21.15.145:3300/0 conn(0x7f1ef00cd090 0x7f1ef00d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/606414153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef00ccb50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 -- 172.21.15.123:0/606414153 >> 172.21.15.123:0/606414153 conn(0x7f1ef0060c40 msgr2=0x7f1ef009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:51.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 -- 172.21.15.123:0/606414153 shutdown_connections 2023-07-21T19:08:51.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.951+0000 7f1ef4a53700 1 -- 172.21.15.123:0/606414153 wait complete. 2023-07-21T19:08:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 Processor -- start 2023-07-21T19:08:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 -- start start 2023-07-21T19:08:51.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef014bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ef00cd090 0x7f1ef01f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 0x7f1ef01f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015f630 con 0x7f1ef00d0610 2023-07-21T19:08:51.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef014c770 con 0x7f1ef00cd090 2023-07-21T19:08:51.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.955+0000 7f1ef4a53700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015ed90 con 0x7f1ef00b0ee0 2023-07-21T19:08:51.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 0x7f1ef01f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 0x7f1ef01f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36708/0 (socket says 172.21.15.123:36708) 2023-07-21T19:08:51.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeeffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ef00cd090 0x7f1ef01f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 -- 172.21.15.123:0/3892636183 learned_addr learned my addr 172.21.15.123:0/3892636183 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:51.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eef7fe700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef014bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 -- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 msgr2=0x7f1ef014bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef014bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 -- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ef00cd090 msgr2=0x7f1ef01f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:51.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ef00cd090 0x7f1ef01f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:51.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 -- 172.21.15.123:0/3892636183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4009570 con 0x7f1ef00d0610 2023-07-21T19:08:51.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1eeffff700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 0x7f1ef01f4f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800cbd0 tx=0x7f1ee800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800aaa0 con 0x7f1ef00d0610 2023-07-21T19:08:51.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee800ac00 con 0x7f1ef00d0610 2023-07-21T19:08:51.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8007070 con 0x7f1ef00d0610 2023-07-21T19:08:51.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee00094b0 con 0x7f1ef00d0610 2023-07-21T19:08:51.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef015f350 con 0x7f1ef00d0610 2023-07-21T19:08:51.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.959+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef004e500 con 0x7f1ef00d0610 2023-07-21T19:08:51.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.963+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ee80071d0 con 0x7f1ef00d0610 2023-07-21T19:08:51.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.967+0000 7f1ed7fff700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1edc0662f0 0x7f1edc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:51.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.967+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ee8083ac0 con 0x7f1ef00d0610 2023-07-21T19:08:51.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.967+0000 7f1eef7fe700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1edc0662f0 0x7f1edc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:51.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.967+0000 7f1eef7fe700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1edc0662f0 0x7f1edc0687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00090b0 tx=0x7f1ee0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:51.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:51.971+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1ee8050cb0 con 0x7f1ef00d0610 2023-07-21T19:08:52.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.143+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ef00cd4e0 con 0x7f1ef00d0610 2023-07-21T19:08:52.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.143+0000 7f1ed7fff700 1 -- 172.21.15.123:0/3892636183 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ef00cd4e0 con 0x7f1ef00d0610 2023-07-21T19:08:52.157 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:52.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1edc0662f0 msgr2=0x7f1edc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1edc0662f0 0x7f1edc0687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00090b0 tx=0x7f1ee0008030 comp rx=0 tx=0).stop 2023-07-21T19:08:52.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 msgr2=0x7f1ef01f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 0x7f1ef01f4f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800cbd0 tx=0x7f1ee800cee0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 shutdown_connections 2023-07-21T19:08:52.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1edc0662f0 0x7f1edc0687a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ef00cd090 0x7f1ef01f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef00d0610 0x7f1ef01f4f20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 --2- 172.21.15.123:0/3892636183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ef00b0ee0 0x7f1ef014bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 >> 172.21.15.123:0/3892636183 conn(0x7f1ef0060c40 msgr2=0x7f1ef015ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 shutdown_connections 2023-07-21T19:08:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.147+0000 7f1ef4a53700 1 -- 172.21.15.123:0/3892636183 wait complete. 2023-07-21T19:08:52.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:52.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 Processor -- start 2023-07-21T19:08:52.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 -- start start 2023-07-21T19:08:52.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95f80b0490 0x7f95f80cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f8160610 0x7f95f80ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f8163fe0 con 0x7f95f8160240 2023-07-21T19:08:52.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80c8c30 con 0x7f95f80b0490 2023-07-21T19:08:52.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f96003ae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80ca9e0 con 0x7f95f8160610 2023-07-21T19:08:52.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fd949700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95f80b0490 0x7f95f80cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fe14a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f95f8160240 0x7f95f80afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52192/0 (socket says 172.21.15.123:52192) 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fe14a700 1 -- 172.21.15.123:0/3961479360 learned_addr learned my addr 172.21.15.123:0/3961479360 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fe94b700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f8160610 0x7f95f80ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fd949700 1 -- 172.21.15.123:0/3961479360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f8160610 msgr2=0x7f95f80ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fd949700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f8160610 0x7f95f80ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fd949700 1 -- 172.21.15.123:0/3961479360 >> v1:172.21.15.123:6789/0 conn(0x7f95f8160240 legacy=0x7f95f80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fd949700 1 -- 172.21.15.123:0/3961479360 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f8164230 con 0x7f95f80b0490 2023-07-21T19:08:52.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.355+0000 7f95fd148700 1 -- 172.21.15.123:0/3961479360 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988243744 0 0) 0x7f95f8163fe0 con 0x7f95f8160240 2023-07-21T19:08:52.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f95fe94b700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f8160610 0x7f95f80ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:52.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f95fd949700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f80b0490 0x7f95f80cdc20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009850 tx=0x7f95e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d09a100b2365ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:52.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f95fd148700 1 -- 172.21.15.123:0/3961479360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011830 con 0x7f95f80b0490 2023-07-21T19:08:52.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f95fd148700 1 -- 172.21.15.123:0/3961479360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8011990 con 0x7f95f80b0490 2023-07-21T19:08:52.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f95fd148700 1 -- 172.21.15.123:0/3961479360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011d20 con 0x7f95f80b0490 2023-07-21T19:08:52.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 -- 172.21.15.123:0/3961479360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f80b0490 msgr2=0x7f95f80cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f80b0490 0x7f95f80cdc20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009850 tx=0x7f95e8009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:52.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 -- 172.21.15.123:0/3961479360 shutdown_connections 2023-07-21T19:08:52.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f8160610 0x7f95f80ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 --2- 172.21.15.123:0/3961479360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f80b0490 0x7f95f80cdc20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 -- 172.21.15.123:0/3961479360 >> 172.21.15.123:0/3961479360 conn(0x7f95f80cad80 msgr2=0x7f95f80cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:52.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 -- 172.21.15.123:0/3961479360 shutdown_connections 2023-07-21T19:08:52.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.359+0000 7f96003ae700 1 -- 172.21.15.123:0/3961479360 wait complete. 2023-07-21T19:08:52.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 Processor -- start 2023-07-21T19:08:52.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 -- start start 2023-07-21T19:08:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f80b0490 0x7f95f80b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 0x7f95f80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95f8160610 0x7f95f80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b3620 con 0x7f95f8160240 2023-07-21T19:08:52.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b3e60 con 0x7f95f8160610 2023-07-21T19:08:52.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.363+0000 7f96003ae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b3060 con 0x7f95f80b0490 2023-07-21T19:08:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 0x7f95f80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 0x7f95f80b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36720/0 (socket says 172.21.15.123:36720) 2023-07-21T19:08:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 -- 172.21.15.123:0/2489691055 learned_addr learned my addr 172.21.15.123:0/2489691055 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fe94b700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95f8160610 0x7f95f80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fe14a700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f80b0490 0x7f95f80b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 -- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f80b0490 msgr2=0x7f95f80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f80b0490 0x7f95f80b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 -- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95f8160610 msgr2=0x7f95f80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95f8160610 0x7f95f80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 -- 172.21.15.123:0/2489691055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e80094b0 con 0x7f95f8160240 2023-07-21T19:08:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fe94b700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95f8160610 0x7f95f80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95fd949700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 0x7f95f80b2a80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000c00 tx=0x7f95e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80036c0 con 0x7f95f8160240 2023-07-21T19:08:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e801f070 con 0x7f95f8160240 2023-07-21T19:08:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8003a60 con 0x7f95f8160240 2023-07-21T19:08:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80b3340 con 0x7f95f8160240 2023-07-21T19:08:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f80b39a0 con 0x7f95f8160240 2023-07-21T19:08:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.367+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f804dcb0 con 0x7f95f8160240 2023-07-21T19:08:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.371+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95e8003bc0 con 0x7f95f8160240 2023-07-21T19:08:52.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.371+0000 7f95eeffd700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f95dc0662f0 0x7f95dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.371+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f95e8021070 con 0x7f95f8160240 2023-07-21T19:08:52.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.371+0000 7f95fe14a700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f95dc0662f0 0x7f95dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.371+0000 7f95fe14a700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f95dc0662f0 0x7f95dc0687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f95f4000f60 tx=0x7f95f4007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.379+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f95e8052c70 con 0x7f95f8160240 2023-07-21T19:08:52.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f95f80b0bc0 con 0x7f95f8160240 2023-07-21T19:08:52.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f95eeffd700 1 -- 172.21.15.123:0/2489691055 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f95e8015020 con 0x7f95f8160240 2023-07-21T19:08:52.568 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:52.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f95dc0662f0 msgr2=0x7f95dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f95dc0662f0 0x7f95dc0687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f95f4000f60 tx=0x7f95f4007c40 comp rx=0 tx=0).stop 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 msgr2=0x7f95f80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 0x7f95f80b2a80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000c00 tx=0x7f95e8004770 comp rx=0 tx=0).stop 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 shutdown_connections 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f95dc0662f0 0x7f95dc0687a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95f8160610 0x7f95f80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8160240 0x7f95f80b2a80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 --2- 172.21.15.123:0/2489691055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95f80b0490 0x7f95f80b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 >> 172.21.15.123:0/2489691055 conn(0x7f95f80cad80 msgr2=0x7f95f8070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.555+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 shutdown_connections 2023-07-21T19:08:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.559+0000 7f96003ae700 1 -- 172.21.15.123:0/2489691055 wait complete. 2023-07-21T19:08:52.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:08:52.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 Processor -- start 2023-07-21T19:08:52.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 -- start start 2023-07-21T19:08:52.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f39f815ffa0 0x7f39f806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f80ca8a0 con 0x7f39f8160370 2023-07-21T19:08:52.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f80cbcd0 con 0x7f39f815ffa0 2023-07-21T19:08:52.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.751+0000 7f39ff500700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80cbf70 con 0x7f39f806dc50 2023-07-21T19:08:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fecff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f39f8160370 0x7f39f80ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58738/0 (socket says 172.21.15.123:58738) 2023-07-21T19:08:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fecff700 1 -- 172.21.15.123:0/905799707 learned_addr learned my addr 172.21.15.123:0/905799707 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fdcfd700 1 --2- 172.21.15.123:0/905799707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fe4fe700 1 --2- 172.21.15.123:0/905799707 >> v2:172.21.15.145:3300/0 conn(0x7f39f815ffa0 0x7f39f806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fd4fc700 1 -- 172.21.15.123:0/905799707 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771882564 0 0) 0x7f39f0001490 con 0x7f39f8160370 2023-07-21T19:08:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fd4fc700 1 -- 172.21.15.123:0/905799707 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e40035d0 con 0x7f39f8160370 2023-07-21T19:08:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fdcfd700 1 -- 172.21.15.123:0/905799707 >> v2:172.21.15.145:3300/0 conn(0x7f39f815ffa0 msgr2=0x7f39f806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fdcfd700 1 --2- 172.21.15.123:0/905799707 >> v2:172.21.15.145:3300/0 conn(0x7f39f815ffa0 0x7f39f806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fdcfd700 1 -- 172.21.15.123:0/905799707 >> v1:172.21.15.123:6789/0 conn(0x7f39f8160370 legacy=0x7f39f80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fdcfd700 1 -- 172.21.15.123:0/905799707 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f80cc250 con 0x7f39f806dc50 2023-07-21T19:08:52.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fdcfd700 1 --2- 172.21.15.123:0/905799707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80caa70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009850 tx=0x7f39e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c8df247a404a8d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:52.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fd4fc700 1 -- 172.21.15.123:0/905799707 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011830 con 0x7f39f806dc50 2023-07-21T19:08:52.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fd4fc700 1 -- 172.21.15.123:0/905799707 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8011990 con 0x7f39f806dc50 2023-07-21T19:08:52.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39fd4fc700 1 -- 172.21.15.123:0/905799707 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011d40 con 0x7f39f806dc50 2023-07-21T19:08:52.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39ff500700 1 -- 172.21.15.123:0/905799707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 msgr2=0x7f39f80caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39ff500700 1 --2- 172.21.15.123:0/905799707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80caa70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009850 tx=0x7f39e8009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:52.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39ff500700 1 -- 172.21.15.123:0/905799707 shutdown_connections 2023-07-21T19:08:52.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39ff500700 1 --2- 172.21.15.123:0/905799707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80caa70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39ff500700 1 --2- 172.21.15.123:0/905799707 >> v2:172.21.15.145:3300/0 conn(0x7f39f815ffa0 0x7f39f806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.755+0000 7f39ff500700 1 -- 172.21.15.123:0/905799707 >> 172.21.15.123:0/905799707 conn(0x7f39f806e960 msgr2=0x7f39f806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.759+0000 7f39ff500700 1 -- 172.21.15.123:0/905799707 shutdown_connections 2023-07-21T19:08:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.759+0000 7f39ff500700 1 -- 172.21.15.123:0/905799707 wait complete. 2023-07-21T19:08:52.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.759+0000 7f39ff500700 1 Processor -- start 2023-07-21T19:08:52.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.759+0000 7f39ff500700 1 -- start start 2023-07-21T19:08:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39f815ffa0 0x7f39f8158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 0x7f39f80c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80c5830 con 0x7f39f8160370 2023-07-21T19:08:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81597c0 con 0x7f39f815ffa0 2023-07-21T19:08:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80addd0 con 0x7f39f806dc50 2023-07-21T19:08:52.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 0x7f39f80c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 0x7f39f80c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45946/0 (socket says 172.21.15.123:45946) 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 -- 172.21.15.123:0/3642768734 learned_addr learned my addr 172.21.15.123:0/3642768734 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fe4fe700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fdcfd700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39f815ffa0 0x7f39f8158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 -- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 msgr2=0x7f39f80c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 -- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39f815ffa0 msgr2=0x7f39f8158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39f815ffa0 0x7f39f8158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 -- 172.21.15.123:0/3642768734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80094b0 con 0x7f39f8160370 2023-07-21T19:08:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fdcfd700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39f815ffa0 0x7f39f8158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39fecff700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 0x7f39f80c2990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f39f000cae0 tx=0x7f39f000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0007480 con 0x7f39f8160370 2023-07-21T19:08:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f00075e0 con 0x7f39f8160370 2023-07-21T19:08:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f80ae0b0 con 0x7f39f8160370 2023-07-21T19:08:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0007970 con 0x7f39f8160370 2023-07-21T19:08:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.763+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f80ae670 con 0x7f39f8160370 2023-07-21T19:08:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.767+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f80ae860 con 0x7f39f8160370 2023-07-21T19:08:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.767+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39f001b3b0 con 0x7f39f8160370 2023-07-21T19:08:52.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.767+0000 7f39eeffd700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39dc066320 0x7f39dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:52.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.767+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39f00838d0 con 0x7f39f8160370 2023-07-21T19:08:52.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.767+0000 7f39fe4fe700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39dc066320 0x7f39dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.767+0000 7f39fe4fe700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39dc066320 0x7f39dc0687d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009b50 tx=0x7f39f4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.771+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f39f0050980 con 0x7f39f8160370 2023-07-21T19:08:52.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.955+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f39f80ca8a0 con 0x7f39f8160370 2023-07-21T19:08:52.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.955+0000 7f39eeffd700 1 -- 172.21.15.123:0/3642768734 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f39f80ca8a0 con 0x7f39f8160370 2023-07-21T19:08:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39dc066320 msgr2=0x7f39dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39dc066320 0x7f39dc0687d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009b50 tx=0x7f39f4009240 comp rx=0 tx=0).stop 2023-07-21T19:08:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 msgr2=0x7f39f80c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 0x7f39f80c2990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f39f000cae0 tx=0x7f39f000cb10 comp rx=0 tx=0).stop 2023-07-21T19:08:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 shutdown_connections 2023-07-21T19:08:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39dc066320 0x7f39dc0687d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39f815ffa0 0x7f39f8158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f8160370 0x7f39f80c2990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 --2- 172.21.15.123:0/3642768734 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39f806dc50 0x7f39f80c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 >> 172.21.15.123:0/3642768734 conn(0x7f39f806e960 msgr2=0x7f39f80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 shutdown_connections 2023-07-21T19:08:52.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:52.959+0000 7f39ff500700 1 -- 172.21.15.123:0/3642768734 wait complete. 2023-07-21T19:08:52.974 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:08:52.992 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2023-07-21T19:08:52.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:52.993 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-21T19:08:53.027 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:08:53.028 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:08:53.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:53.029 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T19:08:53.096 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:08:53.096 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:53.115 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:08:53.115 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:53.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 Processor -- start 2023-07-21T19:08:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 -- start start 2023-07-21T19:08:53.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feba4159f20 0x7feba40caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40b0ef0 con 0x7feba40caf70 2023-07-21T19:08:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40ce9c0 con 0x7feba4159f20 2023-07-21T19:08:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7febaad64700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40cee50 con 0x7feba40c9d90 2023-07-21T19:08:53.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feba4159f20 0x7feba40caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feba4159f20 0x7feba40caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45960/0 (socket says 172.21.15.123:45960) 2023-07-21T19:08:53.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 -- 172.21.15.123:0/3051713678 learned_addr learned my addr 172.21.15.123:0/3051713678 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:53.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 -- 172.21.15.123:0/3051713678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 msgr2=0x7feba40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9d62700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 -- 172.21.15.123:0/3051713678 >> v1:172.21.15.123:6789/0 conn(0x7feba40caf70 legacy=0x7feba40c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9561700 1 -- 172.21.15.123:0/3051713678 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40ca6a0 con 0x7feba4159f20 2023-07-21T19:08:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.347+0000 7feba9d62700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7feba9561700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4159f20 0x7feba40caa30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feb94009910 tx=0x7feb94009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de5e12446a9225f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:53.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7feba8d60700 1 -- 172.21.15.123:0/3051713678 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400ba60 con 0x7feba4159f20 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7feba8d60700 1 -- 172.21.15.123:0/3051713678 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400bbc0 con 0x7feba4159f20 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7feba8d60700 1 -- 172.21.15.123:0/3051713678 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94009e60 con 0x7feba4159f20 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 -- 172.21.15.123:0/3051713678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4159f20 msgr2=0x7feba40caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4159f20 0x7feba40caa30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feb94009910 tx=0x7feb94009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 -- 172.21.15.123:0/3051713678 shutdown_connections 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4159f20 0x7feba40caa30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 --2- 172.21.15.123:0/3051713678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 -- 172.21.15.123:0/3051713678 >> 172.21.15.123:0/3051713678 conn(0x7feba406e960 msgr2=0x7feba406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:53.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 -- 172.21.15.123:0/3051713678 shutdown_connections 2023-07-21T19:08:53.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.351+0000 7febaad64700 1 -- 172.21.15.123:0/3051713678 wait complete. 2023-07-21T19:08:53.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 Processor -- start 2023-07-21T19:08:53.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 -- start start 2023-07-21T19:08:53.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 0x7feba414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba4159f20 0x7feba414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba414f6a0 con 0x7feba40caf70 2023-07-21T19:08:53.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba414fb30 con 0x7feba4159f20 2023-07-21T19:08:53.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaad64700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba41507d0 con 0x7feba40c9d90 2023-07-21T19:08:53.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 0x7feba414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 0x7feba414ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45970/0 (socket says 172.21.15.123:45970) 2023-07-21T19:08:53.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 -- 172.21.15.123:0/1241460406 learned_addr learned my addr 172.21.15.123:0/1241460406 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:53.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9d62700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaa563700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba4159f20 0x7feba414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 -- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 msgr2=0x7feba40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 -- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba4159f20 msgr2=0x7feba414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba4159f20 0x7feba414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7feba9561700 1 -- 172.21.15.123:0/1241460406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94009570 con 0x7feba40caf70 2023-07-21T19:08:53.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.355+0000 7febaa563700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba4159f20 0x7feba414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:53.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7feba9561700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 0x7feba414ec20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feba406a6f0 tx=0x7feb94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:53.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94004610 con 0x7feba40caf70 2023-07-21T19:08:53.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9401f070 con 0x7feba40caf70 2023-07-21T19:08:53.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4150a70 con 0x7feba40caf70 2023-07-21T19:08:53.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94003900 con 0x7feba40caf70 2023-07-21T19:08:53.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4150e00 con 0x7feba40caf70 2023-07-21T19:08:53.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.359+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba404e500 con 0x7feba40caf70 2023-07-21T19:08:53.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.363+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb94003a60 con 0x7feba40caf70 2023-07-21T19:08:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.363+0000 7feb9a7fc700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.363+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb94021070 con 0x7feba40caf70 2023-07-21T19:08:53.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.363+0000 7feba9d62700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.363+0000 7feba9d62700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feb880662f0 0x7feb880687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feba000ab60 tx=0x7feba0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:53.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.367+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7feb94052ab0 con 0x7feba40caf70 2023-07-21T19:08:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.543+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba4070c90 con 0x7feba40caf70 2023-07-21T19:08:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.547+0000 7feb9a7fc700 1 -- 172.21.15.123:0/1241460406 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7feb940560d0 con 0x7feba40caf70 2023-07-21T19:08:53.560 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:53.560 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feb880662f0 msgr2=0x7feb880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feb880662f0 0x7feb880687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feba000ab60 tx=0x7feba0008040 comp rx=0 tx=0).stop 2023-07-21T19:08:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 msgr2=0x7feba414ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 0x7feba414ec20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feba406a6f0 tx=0x7feb94004770 comp rx=0 tx=0).stop 2023-07-21T19:08:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 shutdown_connections 2023-07-21T19:08:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba4159f20 0x7feba414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba40caf70 0x7feba414ec20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 --2- 172.21.15.123:0/1241460406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba40c9d90 0x7feba40b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 >> 172.21.15.123:0/1241460406 conn(0x7feba406e960 msgr2=0x7feba415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:53.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 shutdown_connections 2023-07-21T19:08:53.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.551+0000 7febaad64700 1 -- 172.21.15.123:0/1241460406 wait complete. 2023-07-21T19:08:53.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:53.588 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:53.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf4d634700 1 Processor -- start 2023-07-21T19:08:53.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf4d634700 1 -- start start 2023-07-21T19:08:53.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf4d634700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf480cd7f0 0x7faf4806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf4d634700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480cdfb0 con 0x7faf481603d0 2023-07-21T19:08:53.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf4d634700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480cdcd0 con 0x7faf48160000 2023-07-21T19:08:53.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf4d634700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf48070e40 con 0x7faf480cd7f0 2023-07-21T19:08:53.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf467fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faf481603d0 0x7faf480c0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58766/0 (socket says 172.21.15.123:58766) 2023-07-21T19:08:53.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.759+0000 7faf467fc700 1 -- 172.21.15.123:0/1950218489 learned_addr learned my addr 172.21.15.123:0/1950218489 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:53.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf477fe700 1 --2- 172.21.15.123:0/1950218489 >> v2:172.21.15.145:3300/0 conn(0x7faf480cd7f0 0x7faf4806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf45ffb700 1 -- 172.21.15.123:0/1950218489 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785392250 0 0) 0x7faf3c001110 con 0x7faf481603d0 2023-07-21T19:08:53.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf45ffb700 1 -- 172.21.15.123:0/1950218489 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf300035d0 con 0x7faf481603d0 2023-07-21T19:08:53.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf477fe700 1 -- 172.21.15.123:0/1950218489 >> v1:172.21.15.145:6789/0 conn(0x7faf48160000 legacy=0x7faf480c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf45ffb700 1 -- 172.21.15.123:0/1950218489 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352979126 0 0) 0x7faf480cdcd0 con 0x7faf48160000 2023-07-21T19:08:53.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf477fe700 1 -- 172.21.15.123:0/1950218489 >> v1:172.21.15.123:6789/0 conn(0x7faf481603d0 legacy=0x7faf480c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf477fe700 1 -- 172.21.15.123:0/1950218489 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48070780 con 0x7faf480cd7f0 2023-07-21T19:08:53.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf477fe700 1 --2- 172.21.15.123:0/1950218489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf480cd7f0 0x7faf4806dd10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf40009d90 tx=0x7faf4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b111a849b83b0490 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:53.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf45ffb700 1 -- 172.21.15.123:0/1950218489 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000e070 con 0x7faf480cd7f0 2023-07-21T19:08:53.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf45ffb700 1 -- 172.21.15.123:0/1950218489 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4000bb20 con 0x7faf480cd7f0 2023-07-21T19:08:53.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf45ffb700 1 -- 172.21.15.123:0/1950218489 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000bed0 con 0x7faf480cd7f0 2023-07-21T19:08:53.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 -- 172.21.15.123:0/1950218489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf480cd7f0 msgr2=0x7faf4806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 --2- 172.21.15.123:0/1950218489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf480cd7f0 0x7faf4806dd10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf40009d90 tx=0x7faf4000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:53.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 -- 172.21.15.123:0/1950218489 shutdown_connections 2023-07-21T19:08:53.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 --2- 172.21.15.123:0/1950218489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf480cd7f0 0x7faf4806dd10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 -- 172.21.15.123:0/1950218489 >> 172.21.15.123:0/1950218489 conn(0x7faf480afc60 msgr2=0x7faf480b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:53.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 -- 172.21.15.123:0/1950218489 shutdown_connections 2023-07-21T19:08:53.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.763+0000 7faf4d634700 1 -- 172.21.15.123:0/1950218489 wait complete. 2023-07-21T19:08:53.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.767+0000 7faf4d634700 1 Processor -- start 2023-07-21T19:08:53.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.767+0000 7faf4d634700 1 -- start start 2023-07-21T19:08:53.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf4d634700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf480cd7f0 0x7faf48153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf4d634700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf48160000 0x7faf480b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf4d634700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 0x7faf4815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf4d634700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48153110 con 0x7faf481603d0 2023-07-21T19:08:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf4d634700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48153eb0 con 0x7faf48160000 2023-07-21T19:08:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf4d634700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf48152590 con 0x7faf480cd7f0 2023-07-21T19:08:53.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 0x7faf4815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 0x7faf4815c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45986/0 (socket says 172.21.15.123:45986) 2023-07-21T19:08:53.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 -- 172.21.15.123:0/2524372702 learned_addr learned my addr 172.21.15.123:0/2524372702 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:53.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf467fc700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf48160000 0x7faf480b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf46ffd700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf480cd7f0 0x7faf48153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 -- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf480cd7f0 msgr2=0x7faf48153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf480cd7f0 0x7faf48153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 -- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf48160000 msgr2=0x7faf480b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf48160000 0x7faf480b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 -- 172.21.15.123:0/2524372702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009a70 con 0x7faf481603d0 2023-07-21T19:08:53.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf467fc700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf48160000 0x7faf480b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:53.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf477fe700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 0x7faf4815c950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf40014040 tx=0x7faf40004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:53.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.771+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4001b810 con 0x7faf481603d0 2023-07-21T19:08:53.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.775+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf40020070 con 0x7faf481603d0 2023-07-21T19:08:53.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.775+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4001bbb0 con 0x7faf481603d0 2023-07-21T19:08:53.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.775+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf48152870 con 0x7faf481603d0 2023-07-21T19:08:53.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.775+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf48152e30 con 0x7faf481603d0 2023-07-21T19:08:53.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.775+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4804e500 con 0x7faf481603d0 2023-07-21T19:08:53.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.775+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf4001bd10 con 0x7faf481603d0 2023-07-21T19:08:53.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.779+0000 7faf2f7fe700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf340662f0 0x7faf340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:53.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.779+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf40022070 con 0x7faf481603d0 2023-07-21T19:08:53.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.779+0000 7faf46ffd700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf340662f0 0x7faf340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:53.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.779+0000 7faf46ffd700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf340662f0 0x7faf340687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faf38000f60 tx=0x7faf38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:53.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.783+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faf40056d40 con 0x7faf481603d0 2023-07-21T19:08:53.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.955+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf480b40d0 con 0x7faf481603d0 2023-07-21T19:08:53.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.955+0000 7faf2f7fe700 1 -- 172.21.15.123:0/2524372702 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf4002c020 con 0x7faf481603d0 2023-07-21T19:08:53.969 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:53.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf340662f0 msgr2=0x7faf340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf340662f0 0x7faf340687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faf38000f60 tx=0x7faf38009040 comp rx=0 tx=0).stop 2023-07-21T19:08:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 msgr2=0x7faf4815c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 0x7faf4815c950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf40014040 tx=0x7faf40004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 shutdown_connections 2023-07-21T19:08:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf340662f0 0x7faf340687a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf48160000 0x7faf480b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf481603d0 0x7faf4815c950 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 --2- 172.21.15.123:0/2524372702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf480cd7f0 0x7faf48153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 >> 172.21.15.123:0/2524372702 conn(0x7faf480afc60 msgr2=0x7faf48163c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 shutdown_connections 2023-07-21T19:08:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:53.959+0000 7faf4d634700 1 -- 172.21.15.123:0/2524372702 wait complete. 2023-07-21T19:08:53.995 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:54.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 Processor -- start 2023-07-21T19:08:54.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 -- start start 2023-07-21T19:08:54.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76b8160000 0x7f76b806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b80cd7f0 0x7f76b80c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80cdfb0 con 0x7f76b81603d0 2023-07-21T19:08:54.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b8070e40 con 0x7f76b8160000 2023-07-21T19:08:54.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76beae4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80cdcd0 con 0x7f76b80cd7f0 2023-07-21T19:08:54.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76b8160000 0x7f76b806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76b8160000 0x7f76b806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45992/0 (socket says 172.21.15.123:45992) 2023-07-21T19:08:54.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 -- 172.21.15.123:0/127894942 learned_addr learned my addr 172.21.15.123:0/127894942 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:54.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76be2e3700 1 --2- 172.21.15.123:0/127894942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b80cd7f0 0x7f76b80c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 -- 172.21.15.123:0/127894942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b80cd7f0 msgr2=0x7f76b80c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:54.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 --2- 172.21.15.123:0/127894942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b80cd7f0 0x7f76b80c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 -- 172.21.15.123:0/127894942 >> v1:172.21.15.123:6789/0 conn(0x7f76b81603d0 legacy=0x7f76b80c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bdae2700 1 -- 172.21.15.123:0/127894942 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8070780 con 0x7f76b8160000 2023-07-21T19:08:54.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.163+0000 7f76bcae0700 1 -- 172.21.15.123:0/127894942 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051830345 0 0) 0x7f76a8001110 con 0x7f76b81603d0 2023-07-21T19:08:54.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76bdae2700 1 --2- 172.21.15.123:0/127894942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b8160000 0x7f76b806dd10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009910 tx=0x7f76b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43f7b7116884e56 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76bcae0700 1 -- 172.21.15.123:0/127894942 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4011830 con 0x7f76b8160000 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76bcae0700 1 -- 172.21.15.123:0/127894942 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4011990 con 0x7f76b8160000 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76bcae0700 1 -- 172.21.15.123:0/127894942 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4011d40 con 0x7f76b8160000 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 -- 172.21.15.123:0/127894942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b8160000 msgr2=0x7f76b806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 --2- 172.21.15.123:0/127894942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b8160000 0x7f76b806dd10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009910 tx=0x7f76b4009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 -- 172.21.15.123:0/127894942 shutdown_connections 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 --2- 172.21.15.123:0/127894942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b80cd7f0 0x7f76b80c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 --2- 172.21.15.123:0/127894942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b8160000 0x7f76b806dd10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 -- 172.21.15.123:0/127894942 >> 172.21.15.123:0/127894942 conn(0x7f76b80afc60 msgr2=0x7f76b80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:54.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 -- 172.21.15.123:0/127894942 shutdown_connections 2023-07-21T19:08:54.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 -- 172.21.15.123:0/127894942 wait complete. 2023-07-21T19:08:54.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.167+0000 7f76beae4700 1 Processor -- start 2023-07-21T19:08:54.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 -- start start 2023-07-21T19:08:54.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cd7f0 0x7f76b8153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b8160000 0x7f76b81607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 0x7f76b8160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80c6f10 con 0x7f76b81603d0 2023-07-21T19:08:54.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8154380 con 0x7f76b80cd7f0 2023-07-21T19:08:54.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8161340 con 0x7f76b8160000 2023-07-21T19:08:54.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 0x7f76b8160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 0x7f76b8160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45998/0 (socket says 172.21.15.123:45998) 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 -- 172.21.15.123:0/646332161 learned_addr learned my addr 172.21.15.123:0/646332161 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76bdae2700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cd7f0 0x7f76b8153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76bd2e1700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b8160000 0x7f76b81607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 -- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b8160000 msgr2=0x7f76b81607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b8160000 0x7f76b81607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 -- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cd7f0 msgr2=0x7f76b8153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cd7f0 0x7f76b8153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 -- 172.21.15.123:0/646332161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009570 con 0x7f76b81603d0 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76bdae2700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cd7f0 0x7f76b8153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76be2e3700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 0x7f76b8160d00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f76b000efc0 tx=0x7f76b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000cd40 con 0x7f76b81603d0 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b000f040 con 0x7f76b81603d0 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8161620 con 0x7f76b81603d0 2023-07-21T19:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00146c0 con 0x7f76b81603d0 2023-07-21T19:08:54.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.171+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8161be0 con 0x7f76b81603d0 2023-07-21T19:08:54.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.175+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b8071240 con 0x7f76b81603d0 2023-07-21T19:08:54.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.175+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76b0014820 con 0x7f76b81603d0 2023-07-21T19:08:54.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.179+0000 7f76ae7fc700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f769c0662f0 0x7f769c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.179+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76b0084960 con 0x7f76b81603d0 2023-07-21T19:08:54.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.179+0000 7f76bdae2700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f769c0662f0 0x7f769c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.179+0000 7f76bdae2700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f769c0662f0 0x7f769c0687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009c60 tx=0x7f76b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.183+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f76b8071240 con 0x7f76b81603d0 2023-07-21T19:08:54.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.351+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76b8071240 con 0x7f76b81603d0 2023-07-21T19:08:54.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76ae7fc700 1 -- 172.21.15.123:0/646332161 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76b8071240 con 0x7f76b81603d0 2023-07-21T19:08:54.367 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:54.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f769c0662f0 msgr2=0x7f769c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f769c0662f0 0x7f769c0687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009c60 tx=0x7f76b4008030 comp rx=0 tx=0).stop 2023-07-21T19:08:54.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 msgr2=0x7f76b8160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 0x7f76b8160d00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f76b000efc0 tx=0x7f76b000c3a0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 shutdown_connections 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f769c0662f0 0x7f769c0687a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76b81603d0 0x7f76b8160d00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b8160000 0x7f76b81607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 --2- 172.21.15.123:0/646332161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cd7f0 0x7f76b8153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 >> 172.21.15.123:0/646332161 conn(0x7f76b80afc60 msgr2=0x7f76b80c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 shutdown_connections 2023-07-21T19:08:54.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.355+0000 7f76beae4700 1 -- 172.21.15.123:0/646332161 wait complete. 2023-07-21T19:08:54.390 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.551+0000 7f9cbc980700 1 Processor -- start 2023-07-21T19:08:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 -- start start 2023-07-21T19:08:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cb8159c60 0x7f9cb806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb8070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9cb80cab00 0x7f9cb80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb80cb4c0 con 0x7f9cb8159c60 2023-07-21T19:08:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb806da00 con 0x7f9cb80cab00 2023-07-21T19:08:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cbc980700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb806dce0 con 0x7f9cb80b0770 2023-07-21T19:08:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cb8159c60 0x7f9cb806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cb8159c60 0x7f9cb806d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46004/0 (socket says 172.21.15.123:46004) 2023-07-21T19:08:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 -- 172.21.15.123:0/3563409281 learned_addr learned my addr 172.21.15.123:0/3563409281 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9caffff700 1 --2- 172.21.15.123:0/3563409281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb8070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb759e700 1 --2- 172.21.15.123:0/3563409281 >> v2:172.21.15.145:3300/0 conn(0x7f9cb80cab00 0x7f9cb80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 -- 172.21.15.123:0/3563409281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 msgr2=0x7f9cb8070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 --2- 172.21.15.123:0/3563409281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb8070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 -- 172.21.15.123:0/3563409281 >> v2:172.21.15.145:3300/0 conn(0x7f9cb80cab00 msgr2=0x7f9cb80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 --2- 172.21.15.123:0/3563409281 >> v2:172.21.15.145:3300/0 conn(0x7f9cb80cab00 0x7f9cb80caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 -- 172.21.15.123:0/3563409281 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb806dfc0 con 0x7f9cb8159c60 2023-07-21T19:08:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb6d9d700 1 --2- 172.21.15.123:0/3563409281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb806d3b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80c8730 tx=0x7f9ca8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2e01a71a517ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb659c700 1 -- 172.21.15.123:0/3563409281 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8011830 con 0x7f9cb8159c60 2023-07-21T19:08:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb659c700 1 -- 172.21.15.123:0/3563409281 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca8011990 con 0x7f9cb8159c60 2023-07-21T19:08:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.555+0000 7f9cb659c700 1 -- 172.21.15.123:0/3563409281 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8011d20 con 0x7f9cb8159c60 2023-07-21T19:08:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 -- 172.21.15.123:0/3563409281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 msgr2=0x7f9cb806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 --2- 172.21.15.123:0/3563409281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb806d3b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80c8730 tx=0x7f9ca8009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 -- 172.21.15.123:0/3563409281 shutdown_connections 2023-07-21T19:08:54.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 --2- 172.21.15.123:0/3563409281 >> v2:172.21.15.145:3300/0 conn(0x7f9cb80cab00 0x7f9cb80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 --2- 172.21.15.123:0/3563409281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb8070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 --2- 172.21.15.123:0/3563409281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb806d3b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 -- 172.21.15.123:0/3563409281 >> 172.21.15.123:0/3563409281 conn(0x7f9cb80afc60 msgr2=0x7f9cb80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 -- 172.21.15.123:0/3563409281 shutdown_connections 2023-07-21T19:08:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 -- 172.21.15.123:0/3563409281 wait complete. 2023-07-21T19:08:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 Processor -- start 2023-07-21T19:08:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.559+0000 7f9cbc980700 1 -- start start 2023-07-21T19:08:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb80c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cb80cab00 0x7f9cb8149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b1360 con 0x7f9cb8159c60 2023-07-21T19:08:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80cdd00 con 0x7f9cb80cab00 2023-07-21T19:08:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814aa00 con 0x7f9cb80b0770 2023-07-21T19:08:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb814a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46012/0 (socket says 172.21.15.123:46012) 2023-07-21T19:08:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 -- 172.21.15.123:0/1751300476 learned_addr learned my addr 172.21.15.123:0/1751300476 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9caffff700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cb80cab00 0x7f9cb8149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb6d9d700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb80c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 -- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 msgr2=0x7f9cb80c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb80c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 -- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cb80cab00 msgr2=0x7f9cb8149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cb80cab00 0x7f9cb8149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 -- 172.21.15.123:0/1751300476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8009570 con 0x7f9cb8159c60 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9caffff700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cb80cab00 0x7f9cb8149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cb759e700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb814a4c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000efc0 tx=0x7f9cb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0009ea0 con 0x7f9cb8159c60 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb000f040 con 0x7f9cb8159c60 2023-07-21T19:08:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb80cd740 con 0x7f9cb8159c60 2023-07-21T19:08:54.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0014480 con 0x7f9cb8159c60 2023-07-21T19:08:54.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.563+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb80b1590 con 0x7f9cb8159c60 2023-07-21T19:08:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.567+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb804e500 con 0x7f9cb8159c60 2023-07-21T19:08:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.567+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9cb00145e0 con 0x7f9cb8159c60 2023-07-21T19:08:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.567+0000 7f9caf7fe700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9c980662f0 0x7f9c980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.567+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9cb0084970 con 0x7f9cb8159c60 2023-07-21T19:08:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.567+0000 7f9cb6d9d700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9c980662f0 0x7f9c980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.571+0000 7f9cb6d9d700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9c980662f0 0x7f9c980687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000c00 tx=0x7f9ca8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.575+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9cb0051a20 con 0x7f9cb8159c60 2023-07-21T19:08:54.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.751+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cb806c380 con 0x7f9cb8159c60 2023-07-21T19:08:54.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.751+0000 7f9caf7fe700 1 -- 172.21.15.123:0/1751300476 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cb0055040 con 0x7f9cb8159c60 2023-07-21T19:08:54.765 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:54.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9c980662f0 msgr2=0x7f9c980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9c980662f0 0x7f9c980687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000c00 tx=0x7f9ca8008030 comp rx=0 tx=0).stop 2023-07-21T19:08:54.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 msgr2=0x7f9cb814a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb814a4c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000efc0 tx=0x7f9cb000c3a0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 shutdown_connections 2023-07-21T19:08:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9c980662f0 0x7f9c980687a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cb80cab00 0x7f9cb8149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cb8159c60 0x7f9cb814a4c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 --2- 172.21.15.123:0/1751300476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9cb80b0770 0x7f9cb80c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 >> 172.21.15.123:0/1751300476 conn(0x7f9cb80afc60 msgr2=0x7f9cb80adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:54.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 shutdown_connections 2023-07-21T19:08:54.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.755+0000 7f9cbc980700 1 -- 172.21.15.123:0/1751300476 wait complete. 2023-07-21T19:08:54.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.959+0000 7f7e991c3700 1 Processor -- start 2023-07-21T19:08:54.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.959+0000 7f7e991c3700 1 -- start start 2023-07-21T19:08:54.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e991c3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e940d07e0 0x7f7e941669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e991c3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940d1a60 con 0x7f7e940cd260 2023-07-21T19:08:54.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e991c3700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940d1ef0 con 0x7f7e940b0ee0 2023-07-21T19:08:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e991c3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940d0c60 con 0x7f7e940d07e0 2023-07-21T19:08:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e937fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7e940cd260 0x7f7e940d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58780/0 (socket says 172.21.15.123:58780) 2023-07-21T19:08:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e937fe700 1 -- 172.21.15.123:0/2693944101 learned_addr learned my addr 172.21.15.123:0/2693944101 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:54.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e989c2700 1 --2- 172.21.15.123:0/2693944101 >> v2:172.21.15.123:3300/0 conn(0x7f7e940d07e0 0x7f7e941669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290645872 0 0) 0x7f7e940d1a60 con 0x7f7e940cd260 2023-07-21T19:08:54.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e7c0035d0 con 0x7f7e940cd260 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565167185 0 0) 0x7f7e940d1ef0 con 0x7f7e940b0ee0 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e940d1a60 con 0x7f7e940b0ee0 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e989c2700 1 -- 172.21.15.123:0/2693944101 >> v1:172.21.15.145:6789/0 conn(0x7f7e940b0ee0 legacy=0x7f7e940ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728972970 0 0) 0x7f7e7c0035d0 con 0x7f7e940cd260 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e989c2700 1 -- 172.21.15.123:0/2693944101 >> v1:172.21.15.123:6789/0 conn(0x7f7e940cd260 legacy=0x7f7e940d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e989c2700 1 -- 172.21.15.123:0/2693944101 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940d0e50 con 0x7f7e940d07e0 2023-07-21T19:08:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e989c2700 1 --2- 172.21.15.123:0/2693944101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940d07e0 0x7f7e941669b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009d90 tx=0x7f7e8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fb63e30acbc49b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00e070 con 0x7f7e940d07e0 2023-07-21T19:08:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c003a40 con 0x7f7e940d07e0 2023-07-21T19:08:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.963+0000 7f7e92ffd700 1 -- 172.21.15.123:0/2693944101 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88001670 con 0x7f7e940d07e0 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 -- 172.21.15.123:0/2693944101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940d07e0 msgr2=0x7f7e941669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2693944101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940d07e0 0x7f7e941669b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009d90 tx=0x7f7e8c00b330 comp rx=0 tx=0).stop 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 -- 172.21.15.123:0/2693944101 shutdown_connections 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2693944101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940d07e0 0x7f7e941669b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 -- 172.21.15.123:0/2693944101 >> 172.21.15.123:0/2693944101 conn(0x7f7e94060c40 msgr2=0x7f7e9409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 -- 172.21.15.123:0/2693944101 shutdown_connections 2023-07-21T19:08:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 -- 172.21.15.123:0/2693944101 wait complete. 2023-07-21T19:08:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 Processor -- start 2023-07-21T19:08:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 -- start start 2023-07-21T19:08:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940b0ee0 0x7f7e941585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 0x7f7e940c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.967+0000 7f7e991c3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e940d07e0 0x7f7e941f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e991c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e941f1fc0 con 0x7f7e940cd260 2023-07-21T19:08:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e991c3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94158af0 con 0x7f7e940b0ee0 2023-07-21T19:08:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e991c3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940b3580 con 0x7f7e940d07e0 2023-07-21T19:08:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 0x7f7e940c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 0x7f7e940c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46028/0 (socket says 172.21.15.123:46028) 2023-07-21T19:08:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 -- 172.21.15.123:0/2934904826 learned_addr learned my addr 172.21.15.123:0/2934904826 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e93fff700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940b0ee0 0x7f7e941585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e989c2700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e940d07e0 0x7f7e941f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 -- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e940d07e0 msgr2=0x7f7e941f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e940d07e0 0x7f7e941f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 -- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940b0ee0 msgr2=0x7f7e941585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940b0ee0 0x7f7e941585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 -- 172.21.15.123:0/2934904826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009a70 con 0x7f7e940cd260 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e937fe700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 0x7f7e940c8930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e880011e0 tx=0x7f7e8800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88004ca0 con 0x7f7e940cd260 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e88004e00 con 0x7f7e940cd260 2023-07-21T19:08:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880072d0 con 0x7f7e940cd260 2023-07-21T19:08:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940b3860 con 0x7f7e940cd260 2023-07-21T19:08:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.971+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940b3e20 con 0x7f7e940cd260 2023-07-21T19:08:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.975+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e940cee80 con 0x7f7e940cd260 2023-07-21T19:08:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.975+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e88007430 con 0x7f7e940cd260 2023-07-21T19:08:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.975+0000 7f7e90ff9700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800662f0 0x7f7e800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.975+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e88083d00 con 0x7f7e940cd260 2023-07-21T19:08:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.975+0000 7f7e93fff700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800662f0 0x7f7e800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.979+0000 7f7e93fff700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800662f0 0x7f7e800687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e840011e0 tx=0x7f7e84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:54.983+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7e880548d0 con 0x7f7e940cd260 2023-07-21T19:08:55.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.155+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e9404e500 con 0x7f7e940cd260 2023-07-21T19:08:55.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e90ff9700 1 -- 172.21.15.123:0/2934904826 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e88007db0 con 0x7f7e940cd260 2023-07-21T19:08:55.171 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800662f0 msgr2=0x7f7e800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800662f0 0x7f7e800687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e840011e0 tx=0x7f7e84009040 comp rx=0 tx=0).stop 2023-07-21T19:08:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 msgr2=0x7f7e940c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 0x7f7e940c8930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e880011e0 tx=0x7f7e8800c800 comp rx=0 tx=0).stop 2023-07-21T19:08:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 shutdown_connections 2023-07-21T19:08:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7e800662f0 0x7f7e800687a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e940d07e0 0x7f7e941f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e940cd260 0x7f7e940c8930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 --2- 172.21.15.123:0/2934904826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e940b0ee0 0x7f7e941585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 >> 172.21.15.123:0/2934904826 conn(0x7f7e94060c40 msgr2=0x7f7e940b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 shutdown_connections 2023-07-21T19:08:55.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.159+0000 7f7e991c3700 1 -- 172.21.15.123:0/2934904826 wait complete. 2023-07-21T19:08:55.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.359+0000 7f0f0359e700 1 Processor -- start 2023-07-21T19:08:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.359+0000 7f0f0359e700 1 -- start start 2023-07-21T19:08:55.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0f040b0ee0 0x7f0f040ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040d07e0 0x7f0f040af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0359e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040cd4e0 con 0x7f0f040cd090 2023-07-21T19:08:55.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040d0c60 con 0x7f0f040b0ee0 2023-07-21T19:08:55.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040d1a60 con 0x7f0f040d07e0 2023-07-21T19:08:55.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0f040b0ee0 0x7f0f040ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f02d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040d07e0 0x7f0f040af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0f040b0ee0 0x7f0f040ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46034/0 (socket says 172.21.15.123:46034) 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 -- 172.21.15.123:0/2408312022 learned_addr learned my addr 172.21.15.123:0/2408312022 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 -- 172.21.15.123:0/2408312022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040d07e0 msgr2=0x7f0f040af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 --2- 172.21.15.123:0/2408312022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040d07e0 0x7f0f040af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 -- 172.21.15.123:0/2408312022 >> v1:172.21.15.145:6789/0 conn(0x7f0f040cd090 legacy=0x7f0f040d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.363+0000 7f0f0259c700 1 -- 172.21.15.123:0/2408312022 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040d1ef0 con 0x7f0f040b0ee0 2023-07-21T19:08:55.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0259c700 1 --2- 172.21.15.123:0/2408312022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040ccb50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009910 tx=0x7f0ef4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dfdeb85fb07ea7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:55.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0159a700 1 -- 172.21.15.123:0/2408312022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4011830 con 0x7f0f040b0ee0 2023-07-21T19:08:55.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0159a700 1 -- 172.21.15.123:0/2408312022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef4011990 con 0x7f0f040b0ee0 2023-07-21T19:08:55.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0159a700 1 -- 172.21.15.123:0/2408312022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4011d40 con 0x7f0f040b0ee0 2023-07-21T19:08:55.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 -- 172.21.15.123:0/2408312022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 msgr2=0x7f0f040ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 --2- 172.21.15.123:0/2408312022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040ccb50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009910 tx=0x7f0ef4009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:55.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 -- 172.21.15.123:0/2408312022 shutdown_connections 2023-07-21T19:08:55.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 --2- 172.21.15.123:0/2408312022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040d07e0 0x7f0f040af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 --2- 172.21.15.123:0/2408312022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040ccb50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 -- 172.21.15.123:0/2408312022 >> 172.21.15.123:0/2408312022 conn(0x7f0f04060c40 msgr2=0x7f0f0409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:55.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 -- 172.21.15.123:0/2408312022 shutdown_connections 2023-07-21T19:08:55.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.367+0000 7f0f0359e700 1 -- 172.21.15.123:0/2408312022 wait complete. 2023-07-21T19:08:55.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 Processor -- start 2023-07-21T19:08:55.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 -- start start 2023-07-21T19:08:55.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040cd090 0x7f0f0415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f040d07e0 0x7f0f0415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415f350 con 0x7f0f040b0ee0 2023-07-21T19:08:55.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415e2b0 con 0x7f0f040d07e0 2023-07-21T19:08:55.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415e590 con 0x7f0f040cd090 2023-07-21T19:08:55.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46040/0 (socket says 172.21.15.123:46040) 2023-07-21T19:08:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 -- 172.21.15.123:0/3856766274 learned_addr learned my addr 172.21.15.123:0/3856766274 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f02d9d700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f040d07e0 0x7f0f0415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f01d9b700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040cd090 0x7f0f0415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 -- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040cd090 msgr2=0x7f0f0415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040cd090 0x7f0f0415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 -- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f040d07e0 msgr2=0x7f0f0415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f040d07e0 0x7f0f0415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 -- 172.21.15.123:0/3856766274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009570 con 0x7f0f040b0ee0 2023-07-21T19:08:55.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f01d9b700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040cd090 0x7f0f0415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:55.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0259c700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040c8980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4000c00 tx=0x7f0ef4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:55.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4004610 con 0x7f0f040b0ee0 2023-07-21T19:08:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0415e870 con 0x7f0f040b0ee0 2023-07-21T19:08:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef40036c0 con 0x7f0f040b0ee0 2023-07-21T19:08:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.371+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4003a50 con 0x7f0f040b0ee0 2023-07-21T19:08:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.375+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0415ee30 con 0x7f0f040b0ee0 2023-07-21T19:08:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.375+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f040c7190 con 0x7f0f040b0ee0 2023-07-21T19:08:55.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.375+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ef4003bb0 con 0x7f0f040b0ee0 2023-07-21T19:08:55.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.379+0000 7f0ef2ffd700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0ee40662f0 0x7f0ee40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.379+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0ef4021030 con 0x7f0f040b0ee0 2023-07-21T19:08:55.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.379+0000 7f0f01d9b700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0ee40662f0 0x7f0ee40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.379+0000 7f0f01d9b700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0ee40662f0 0x7f0ee40687a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f040b81d0 tx=0x7f0ef8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:55.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.383+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0ef4052920 con 0x7f0f040b0ee0 2023-07-21T19:08:55.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.555+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0f0415f050 con 0x7f0f040b0ee0 2023-07-21T19:08:55.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.555+0000 7f0ef2ffd700 1 -- 172.21.15.123:0/3856766274 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0ef4074070 con 0x7f0f040b0ee0 2023-07-21T19:08:55.569 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:55.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0ee40662f0 msgr2=0x7f0ee40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0ee40662f0 0x7f0ee40687a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f040b81d0 tx=0x7f0ef8009040 comp rx=0 tx=0).stop 2023-07-21T19:08:55.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 msgr2=0x7f0f040c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040c8980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4000c00 tx=0x7f0ef4004770 comp rx=0 tx=0).stop 2023-07-21T19:08:55.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 shutdown_connections 2023-07-21T19:08:55.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0ee40662f0 0x7f0ee40687a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f040d07e0 0x7f0f0415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f040cd090 0x7f0f0415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 --2- 172.21.15.123:0/3856766274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f040b0ee0 0x7f0f040c8980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 >> 172.21.15.123:0/3856766274 conn(0x7f0f04060c40 msgr2=0x7f0f040af950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:55.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 shutdown_connections 2023-07-21T19:08:55.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.559+0000 7f0f0359e700 1 -- 172.21.15.123:0/3856766274 wait complete. 2023-07-21T19:08:55.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:08:55.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.747+0000 7fa6225be700 1 Processor -- start 2023-07-21T19:08:55.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.747+0000 7fa6225be700 1 -- start start 2023-07-21T19:08:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.747+0000 7fa6225be700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa61c15bff0 0x7fa61c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa61c0cf1c0 0x7fa61c0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0af0a0 con 0x7fa61c0cd070 2023-07-21T19:08:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0cd4f0 con 0x7fa61c0cf1c0 2023-07-21T19:08:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0cf720 con 0x7fa61c15bff0 2023-07-21T19:08:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa621dbd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa61c0cf1c0 0x7fa61c0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa620dbb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa61c0cd070 0x7fa61c0ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58784/0 (socket says 172.21.15.123:58784) 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa620dbb700 1 -- 172.21.15.123:0/3884369379 learned_addr learned my addr 172.21.15.123:0/3884369379 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6215bc700 1 --2- 172.21.15.123:0/3884369379 >> v2:172.21.15.145:3300/0 conn(0x7fa61c15bff0 0x7fa61c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa621dbd700 1 -- 172.21.15.123:0/3884369379 >> v2:172.21.15.145:3300/0 conn(0x7fa61c15bff0 msgr2=0x7fa61c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa621dbd700 1 --2- 172.21.15.123:0/3884369379 >> v2:172.21.15.145:3300/0 conn(0x7fa61c15bff0 0x7fa61c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa621dbd700 1 -- 172.21.15.123:0/3884369379 >> v1:172.21.15.123:6789/0 conn(0x7fa61c0cd070 legacy=0x7fa61c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa621dbd700 1 -- 172.21.15.123:0/3884369379 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0af2f0 con 0x7fa61c0cf1c0 2023-07-21T19:08:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa613fff700 1 -- 172.21.15.123:0/3884369379 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836420198 0 0) 0x7fa61c0af0a0 con 0x7fa61c0cd070 2023-07-21T19:08:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa621dbd700 1 --2- 172.21.15.123:0/3884369379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c0afdd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa61c08ac70 tx=0x7fa61400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ef584a2f5f06dc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa613fff700 1 -- 172.21.15.123:0/3884369379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400e070 con 0x7fa61c0cf1c0 2023-07-21T19:08:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa613fff700 1 -- 172.21.15.123:0/3884369379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61400bb20 con 0x7fa61c0cf1c0 2023-07-21T19:08:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa613fff700 1 -- 172.21.15.123:0/3884369379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614012430 con 0x7fa61c0cf1c0 2023-07-21T19:08:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 -- 172.21.15.123:0/3884369379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c0cf1c0 msgr2=0x7fa61c0afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 --2- 172.21.15.123:0/3884369379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c0afdd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa61c08ac70 tx=0x7fa61400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 -- 172.21.15.123:0/3884369379 shutdown_connections 2023-07-21T19:08:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 --2- 172.21.15.123:0/3884369379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c0afdd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.751+0000 7fa6225be700 1 --2- 172.21.15.123:0/3884369379 >> v2:172.21.15.145:3300/0 conn(0x7fa61c15bff0 0x7fa61c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.755+0000 7fa6225be700 1 -- 172.21.15.123:0/3884369379 >> 172.21.15.123:0/3884369379 conn(0x7fa61c060c40 msgr2=0x7fa61c09b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.755+0000 7fa6225be700 1 -- 172.21.15.123:0/3884369379 shutdown_connections 2023-07-21T19:08:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.755+0000 7fa6225be700 1 -- 172.21.15.123:0/3884369379 wait complete. 2023-07-21T19:08:55.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 Processor -- start 2023-07-21T19:08:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 -- start start 2023-07-21T19:08:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa61c0cd070 0x7fa61c15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 0x7fa61c156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c15dea0 con 0x7fa61c15bff0 2023-07-21T19:08:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c15e180 con 0x7fa61c0cf1c0 2023-07-21T19:08:55.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c15e460 con 0x7fa61c0cd070 2023-07-21T19:08:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 0x7fa61c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 0x7fa61c156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46056/0 (socket says 172.21.15.123:46056) 2023-07-21T19:08:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 -- 172.21.15.123:0/3934528469 learned_addr learned my addr 172.21.15.123:0/3934528469 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa620dbb700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 -- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa61c0cd070 msgr2=0x7fa61c15d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa61c0cd070 0x7fa61c15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 -- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa61c0cf1c0 msgr2=0x7fa61c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 -- 172.21.15.123:0/3934528469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614009a70 con 0x7fa61c15bff0 2023-07-21T19:08:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa620dbb700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa621dbd700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 0x7fa61c156500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0b50d0 tx=0x7fa614004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614012430 con 0x7fa61c15bff0 2023-07-21T19:08:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614020070 con 0x7fa61c15bff0 2023-07-21T19:08:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614004280 con 0x7fa61c15bff0 2023-07-21T19:08:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c15e740 con 0x7fa61c15bff0 2023-07-21T19:08:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.759+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c15dae0 con 0x7fa61c15bff0 2023-07-21T19:08:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.763+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c15ec60 con 0x7fa61c15bff0 2023-07-21T19:08:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.763+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6140043e0 con 0x7fa61c15bff0 2023-07-21T19:08:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.763+0000 7fa611ffb700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6000662f0 0x7fa6000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.767+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa614022070 con 0x7fa61c15bff0 2023-07-21T19:08:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.767+0000 7fa6215bc700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6000662f0 0x7fa6000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.767+0000 7fa6215bc700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6000662f0 0x7fa6000687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa618006b40 tx=0x7fa618006ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.771+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa614052eb0 con 0x7fa61c15bff0 2023-07-21T19:08:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.955+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa61c15dc70 con 0x7fa61c15bff0 2023-07-21T19:08:55.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.955+0000 7fa611ffb700 1 -- 172.21.15.123:0/3934528469 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6140564d0 con 0x7fa61c15bff0 2023-07-21T19:08:55.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6000662f0 msgr2=0x7fa6000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6000662f0 0x7fa6000687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa618006b40 tx=0x7fa618006ad0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 msgr2=0x7fa61c156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:55.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 0x7fa61c156500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0b50d0 tx=0x7fa614004af0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 shutdown_connections 2023-07-21T19:08:55.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa6000662f0 0x7fa6000687a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa61c0cf1c0 0x7fa61c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa61c15bff0 0x7fa61c156500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 --2- 172.21.15.123:0/3934528469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa61c0cd070 0x7fa61c15d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:55.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 >> 172.21.15.123:0/3934528469 conn(0x7fa61c060c40 msgr2=0x7fa61c0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:55.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 shutdown_connections 2023-07-21T19:08:55.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:55.959+0000 7fa6225be700 1 -- 172.21.15.123:0/3934528469 wait complete. 2023-07-21T19:08:55.974 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:08:55.995 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:08:55.995 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:56.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:56.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.167+0000 7f0a8e52b700 1 Processor -- start 2023-07-21T19:08:56.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.167+0000 7f0a8e52b700 1 -- start start 2023-07-21T19:08:56.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a880cfe00 0x7f0a880ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a880ad930 con 0x7f0a88159cc0 2023-07-21T19:08:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a88099b90 con 0x7f0a880ce520 2023-07-21T19:08:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880cbc60 con 0x7f0a880cfe00 2023-07-21T19:08:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a880cfe00 0x7f0a880ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a880cfe00 0x7f0a880ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46070/0 (socket says 172.21.15.123:46070) 2023-07-21T19:08:56.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 -- 172.21.15.123:0/1738985785 learned_addr learned my addr 172.21.15.123:0/1738985785 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:56.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 -- 172.21.15.123:0/1738985785 >> v1:172.21.15.145:6789/0 conn(0x7f0a880ce520 legacy=0x7f0a880addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 -- 172.21.15.123:0/1738985785 >> v1:172.21.15.123:6789/0 conn(0x7f0a88159cc0 legacy=0x7f0a880cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 -- 172.21.15.123:0/1738985785 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8815a090 con 0x7f0a880cfe00 2023-07-21T19:08:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8dd2a700 1 --2- 172.21.15.123:0/1738985785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880cfe00 0x7f0a880ae4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009e50 tx=0x7f0a8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab145b91dec0eae1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a7ffff700 1 -- 172.21.15.123:0/1738985785 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000e070 con 0x7f0a880cfe00 2023-07-21T19:08:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a7ffff700 1 -- 172.21.15.123:0/1738985785 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8000b9c0 con 0x7f0a880cfe00 2023-07-21T19:08:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a7ffff700 1 -- 172.21.15.123:0/1738985785 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000bd70 con 0x7f0a880cfe00 2023-07-21T19:08:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1738985785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880cfe00 msgr2=0x7f0a880ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1738985785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880cfe00 0x7f0a880ae4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009e50 tx=0x7f0a8000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.171+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1738985785 shutdown_connections 2023-07-21T19:08:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.175+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1738985785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880cfe00 0x7f0a880ae4d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.175+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1738985785 >> 172.21.15.123:0/1738985785 conn(0x7f0a88099600 msgr2=0x7f0a880d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.175+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1738985785 shutdown_connections 2023-07-21T19:08:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.175+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1738985785 wait complete. 2023-07-21T19:08:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.175+0000 7f0a8e52b700 1 Processor -- start 2023-07-21T19:08:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.175+0000 7f0a8e52b700 1 -- start start 2023-07-21T19:08:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 0x7f0a880b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a880cfe00 0x7f0a880c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a88159cc0 0x7f0a880c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8814d070 con 0x7f0a880ce520 2023-07-21T19:08:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880b4b90 con 0x7f0a880cfe00 2023-07-21T19:08:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880b3f80 con 0x7f0a88159cc0 2023-07-21T19:08:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 0x7f0a880b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 0x7f0a880b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46072/0 (socket says 172.21.15.123:46072) 2023-07-21T19:08:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 -- 172.21.15.123:0/1742585403 learned_addr learned my addr 172.21.15.123:0/1742585403 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8cd28700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a880cfe00 0x7f0a880c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8dd2a700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a88159cc0 0x7f0a880c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 -- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a88159cc0 msgr2=0x7f0a880c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a88159cc0 0x7f0a880c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 -- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a880cfe00 msgr2=0x7f0a880c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a880cfe00 0x7f0a880c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 -- 172.21.15.123:0/1742585403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80009b30 con 0x7f0a880ce520 2023-07-21T19:08:56.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8dd2a700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a88159cc0 0x7f0a880c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:08:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8d529700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 0x7f0a880b5560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c450 tx=0x7f0a8400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011790 con 0x7f0a880ce520 2023-07-21T19:08:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a840118f0 con 0x7f0a880ce520 2023-07-21T19:08:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a880b4260 con 0x7f0a880ce520 2023-07-21T19:08:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011ca0 con 0x7f0a880ce520 2023-07-21T19:08:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.179+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a880b4820 con 0x7f0a880ce520 2023-07-21T19:08:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.183+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8804e500 con 0x7f0a880ce520 2023-07-21T19:08:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.183+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a8401c460 con 0x7f0a880ce520 2023-07-21T19:08:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.183+0000 7f0a7dffb700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0a6c0662f0 0x7f0a6c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.183+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a84083e10 con 0x7f0a880ce520 2023-07-21T19:08:56.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.183+0000 7f0a8cd28700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0a6c0662f0 0x7f0a6c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.187+0000 7f0a8cd28700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0a6c0662f0 0x7f0a6c0687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a881f2300 tx=0x7f0a78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:56.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.191+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0a84050ed0 con 0x7f0a880ce520 2023-07-21T19:08:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.363+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a880ce020 con 0x7f0a880ce520 2023-07-21T19:08:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.363+0000 7f0a7dffb700 1 -- 172.21.15.123:0/1742585403 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f0a840544f0 con 0x7f0a880ce520 2023-07-21T19:08:56.379 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:56.379 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0a6c0662f0 msgr2=0x7f0a6c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0a6c0662f0 0x7f0a6c0687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a881f2300 tx=0x7f0a78009040 comp rx=0 tx=0).stop 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 msgr2=0x7f0a880b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 0x7f0a880b5560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c450 tx=0x7f0a8400c810 comp rx=0 tx=0).stop 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 shutdown_connections 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0a6c0662f0 0x7f0a6c0687a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a880cfe00 0x7f0a880c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a88159cc0 0x7f0a880c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 --2- 172.21.15.123:0/1742585403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a880ce520 0x7f0a880b5560 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 >> 172.21.15.123:0/1742585403 conn(0x7f0a88099600 msgr2=0x7f0a880ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 shutdown_connections 2023-07-21T19:08:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.367+0000 7f0a8e52b700 1 -- 172.21.15.123:0/1742585403 wait complete. 2023-07-21T19:08:56.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:56.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.571+0000 7f20256a2700 1 Processor -- start 2023-07-21T19:08:56.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.571+0000 7f20256a2700 1 -- start start 2023-07-21T19:08:56.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f20256a2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f20200b0770 0x7f202006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f20256a2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200cab00 0x7f20200caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f20256a2700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20200cb4c0 con 0x7f2020159c60 2023-07-21T19:08:56.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f20256a2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20200714f0 con 0x7f20200b0770 2023-07-21T19:08:56.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f20256a2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202006da00 con 0x7f20200cab00 2023-07-21T19:08:56.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201e7fc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f20200b0770 0x7f202006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201e7fc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f20200b0770 0x7f202006d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:53994/0 (socket says 172.21.15.123:53994) 2023-07-21T19:08:56.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201e7fc700 1 -- 172.21.15.123:0/193682355 learned_addr learned my addr 172.21.15.123:0/193682355 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:56.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201f7fe700 1 --2- 172.21.15.123:0/193682355 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200cab00 0x7f20200caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201f7fe700 1 -- 172.21.15.123:0/193682355 >> v2:172.21.15.145:3300/0 conn(0x7f20200b0770 msgr2=0x7f202006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:56.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201f7fe700 1 --2- 172.21.15.123:0/193682355 >> v2:172.21.15.145:3300/0 conn(0x7f20200b0770 0x7f202006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201f7fe700 1 -- 172.21.15.123:0/193682355 >> v1:172.21.15.145:6789/0 conn(0x7f2020159c60 legacy=0x7f2020070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201f7fe700 1 -- 172.21.15.123:0/193682355 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202006dce0 con 0x7f20200cab00 2023-07-21T19:08:56.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201f7fe700 1 --2- 172.21.15.123:0/193682355 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200cab00 0x7f20200caf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f201800f370 tx=0x7f201800f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ec07776a0f66da server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:56.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201dffb700 1 -- 172.21.15.123:0/193682355 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018012070 con 0x7f20200cab00 2023-07-21T19:08:56.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201dffb700 1 -- 172.21.15.123:0/193682355 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201800fe70 con 0x7f20200cab00 2023-07-21T19:08:56.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.575+0000 7f201dffb700 1 -- 172.21.15.123:0/193682355 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800d2f0 con 0x7f20200cab00 2023-07-21T19:08:56.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 -- 172.21.15.123:0/193682355 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200cab00 msgr2=0x7f20200caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 --2- 172.21.15.123:0/193682355 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200cab00 0x7f20200caf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f201800f370 tx=0x7f201800f680 comp rx=0 tx=0).stop 2023-07-21T19:08:56.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 -- 172.21.15.123:0/193682355 shutdown_connections 2023-07-21T19:08:56.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 --2- 172.21.15.123:0/193682355 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200cab00 0x7f20200caf80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 --2- 172.21.15.123:0/193682355 >> v2:172.21.15.145:3300/0 conn(0x7f20200b0770 0x7f202006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 -- 172.21.15.123:0/193682355 >> 172.21.15.123:0/193682355 conn(0x7f20200afc60 msgr2=0x7f20200b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:56.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 -- 172.21.15.123:0/193682355 shutdown_connections 2023-07-21T19:08:56.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.579+0000 7f20256a2700 1 -- 172.21.15.123:0/193682355 wait complete. 2023-07-21T19:08:56.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 Processor -- start 2023-07-21T19:08:56.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 -- start start 2023-07-21T19:08:56.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200b0770 0x7f20201f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 0x7f20200c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2020159c60 0x7f20201f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20200c4750 con 0x7f20200cab00 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20200c5dd0 con 0x7f2020159c60 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f20256a2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20201f8780 con 0x7f20200b0770 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 0x7f20200c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 0x7f20200c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46082/0 (socket says 172.21.15.123:46082) 2023-07-21T19:08:56.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 -- 172.21.15.123:0/3071757644 learned_addr learned my addr 172.21.15.123:0/3071757644 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:56.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201f7fe700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2020159c60 0x7f20201f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201effd700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200b0770 0x7f20201f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 -- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200b0770 msgr2=0x7f20201f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200b0770 0x7f20201f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 -- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2020159c60 msgr2=0x7f20201f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2020159c60 0x7f20201f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.583+0000 7f201e7fc700 1 -- 172.21.15.123:0/3071757644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201800f050 con 0x7f20200cab00 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f201e7fc700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 0x7f20200c4210 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f201400e890 tx=0x7f201400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014009620 con 0x7f20200cab00 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014013680 con 0x7f20200cab00 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20200c6070 con 0x7f20200cab00 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014013a30 con 0x7f20200cab00 2023-07-21T19:08:56.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20200c6630 con 0x7f20200cab00 2023-07-21T19:08:56.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.587+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202004e500 con 0x7f20200cab00 2023-07-21T19:08:56.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.591+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2014013b90 con 0x7f20200cab00 2023-07-21T19:08:56.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.591+0000 7f20077fe700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f200c0662f0 0x7f200c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.591+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2014083f10 con 0x7f20200cab00 2023-07-21T19:08:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.591+0000 7f201effd700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f200c0662f0 0x7f200c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:56.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.595+0000 7f201effd700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f200c0662f0 0x7f200c0687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20200ca7f0 tx=0x7f2010009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:56.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.599+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2014054a50 con 0x7f20200cab00 2023-07-21T19:08:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.775+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20200afa40 con 0x7f20200cab00 2023-07-21T19:08:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.775+0000 7f20077fe700 1 -- 172.21.15.123:0/3071757644 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20140545e0 con 0x7f20200cab00 2023-07-21T19:08:56.790 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f200c0662f0 msgr2=0x7f200c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f200c0662f0 0x7f200c0687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20200ca7f0 tx=0x7f2010009040 comp rx=0 tx=0).stop 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 msgr2=0x7f20200c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 0x7f20200c4210 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f201400e890 tx=0x7f201400eba0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 shutdown_connections 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f200c0662f0 0x7f200c0687a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2020159c60 0x7f20201f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20200cab00 0x7f20200c4210 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 --2- 172.21.15.123:0/3071757644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20200b0770 0x7f20201f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 >> 172.21.15.123:0/3071757644 conn(0x7f20200afc60 msgr2=0x7f20200b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 shutdown_connections 2023-07-21T19:08:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.779+0000 7f20256a2700 1 -- 172.21.15.123:0/3071757644 wait complete. 2023-07-21T19:08:56.813 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:08:56.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.978+0000 7fa36d889700 1 Processor -- start 2023-07-21T19:08:56.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.978+0000 7fa36d889700 1 -- start start 2023-07-21T19:08:56.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680b1c50 0x7fa368071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3680cf710 0x7fa3680d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:56.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36815c420 con 0x7fa3680d0210 2023-07-21T19:08:56.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa368070840 con 0x7fa3680cf710 2023-07-21T19:08:56.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa368070b20 con 0x7fa3680b1c50 2023-07-21T19:08:56.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3680cf710 0x7fa3680d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa366ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680b1c50 0x7fa368071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3680cf710 0x7fa3680d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46086/0 (socket says 172.21.15.123:46086) 2023-07-21T19:08:57.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 -- 172.21.15.123:0/3808253107 learned_addr learned my addr 172.21.15.123:0/3808253107 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:57.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 -- 172.21.15.123:0/3808253107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680b1c50 msgr2=0x7fa368071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:57.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 --2- 172.21.15.123:0/3808253107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680b1c50 0x7fa368071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 -- 172.21.15.123:0/3808253107 >> v1:172.21.15.145:6789/0 conn(0x7fa3680d0210 legacy=0x7fa3680cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 -- 172.21.15.123:0/3808253107 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368070e00 con 0x7fa3680cf710 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa3677fe700 1 --2- 172.21.15.123:0/3808253107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680cf710 0x7fa3680d0640 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa36000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19128151b786b313 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa365ffb700 1 -- 172.21.15.123:0/3808253107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000e070 con 0x7fa3680cf710 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa365ffb700 1 -- 172.21.15.123:0/3808253107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36000b910 con 0x7fa3680cf710 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa365ffb700 1 -- 172.21.15.123:0/3808253107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000bcc0 con 0x7fa3680cf710 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 -- 172.21.15.123:0/3808253107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680cf710 msgr2=0x7fa3680d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.982+0000 7fa36d889700 1 --2- 172.21.15.123:0/3808253107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680cf710 0x7fa3680d0640 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa36000b330 comp rx=0 tx=0).stop 2023-07-21T19:08:57.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 -- 172.21.15.123:0/3808253107 shutdown_connections 2023-07-21T19:08:57.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 --2- 172.21.15.123:0/3808253107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680cf710 0x7fa3680d0640 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 --2- 172.21.15.123:0/3808253107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680b1c50 0x7fa368071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 -- 172.21.15.123:0/3808253107 >> 172.21.15.123:0/3808253107 conn(0x7fa36809b9c0 msgr2=0x7fa3680d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:57.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 -- 172.21.15.123:0/3808253107 shutdown_connections 2023-07-21T19:08:57.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 -- 172.21.15.123:0/3808253107 wait complete. 2023-07-21T19:08:57.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 Processor -- start 2023-07-21T19:08:57.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.986+0000 7fa36d889700 1 -- start start 2023-07-21T19:08:57.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 0x7fa36815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680cf710 0x7fa3681f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3680d0210 0x7fa3680b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680c6f00 con 0x7fa3680b1c50 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680c71e0 con 0x7fa3680d0210 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680c74c0 con 0x7fa3680cf710 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 0x7fa36815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 0x7fa36815bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46096/0 (socket says 172.21.15.123:46096) 2023-07-21T19:08:57.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 -- 172.21.15.123:0/1343753733 learned_addr learned my addr 172.21.15.123:0/1343753733 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:57.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa3677fe700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3680d0210 0x7fa3680b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa3667fc700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680cf710 0x7fa3681f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 -- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680cf710 msgr2=0x7fa3681f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680cf710 0x7fa3681f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 -- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3680d0210 msgr2=0x7fa3680b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3680d0210 0x7fa3680b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 -- 172.21.15.123:0/1343753733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009b30 con 0x7fa3680b1c50 2023-07-21T19:08:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa366ffd700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 0x7fa36815bb50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e9d0 tx=0x7fa35800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358009720 con 0x7fa3680b1c50 2023-07-21T19:08:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35800c850 con 0x7fa3680b1c50 2023-07-21T19:08:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3680c77a0 con 0x7fa3680b1c50 2023-07-21T19:08:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800cbc0 con 0x7fa3680b1c50 2023-07-21T19:08:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36815c090 con 0x7fa3680b1c50 2023-07-21T19:08:57.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.990+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36804dcb0 con 0x7fa3680b1c50 2023-07-21T19:08:57.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.994+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa35800cd20 con 0x7fa3680b1c50 2023-07-21T19:08:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.994+0000 7fa34ffff700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3540662f0 0x7fa3540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.994+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa358084210 con 0x7fa3680b1c50 2023-07-21T19:08:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.994+0000 7fa3667fc700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3540662f0 0x7fa3540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.998+0000 7fa3667fc700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3540662f0 0x7fa3540687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3680b78c0 tx=0x7fa35c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:56.998+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa358054d50 con 0x7fa3680b1c50 2023-07-21T19:08:57.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.170+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3680d08e0 con 0x7fa3680b1c50 2023-07-21T19:08:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.170+0000 7fa34ffff700 1 -- 172.21.15.123:0/1343753733 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3580548e0 con 0x7fa3680b1c50 2023-07-21T19:08:57.186 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:08:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3540662f0 msgr2=0x7fa3540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3540662f0 0x7fa3540687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3680b78c0 tx=0x7fa35c009040 comp rx=0 tx=0).stop 2023-07-21T19:08:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 msgr2=0x7fa36815bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 0x7fa36815bb50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e9d0 tx=0x7fa35800ed90 comp rx=0 tx=0).stop 2023-07-21T19:08:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 shutdown_connections 2023-07-21T19:08:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa3540662f0 0x7fa3540687a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3680d0210 0x7fa3680b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3680cf710 0x7fa3681f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 --2- 172.21.15.123:0/1343753733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b1c50 0x7fa36815bb50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 >> 172.21.15.123:0/1343753733 conn(0x7fa36809b9c0 msgr2=0x7fa3680b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 shutdown_connections 2023-07-21T19:08:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.174+0000 7fa36d889700 1 -- 172.21.15.123:0/1343753733 wait complete. 2023-07-21T19:08:57.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:08:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.370+0000 7f3c589f7700 1 Processor -- start 2023-07-21T19:08:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.370+0000 7f3c589f7700 1 -- start start 2023-07-21T19:08:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c589f7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c5406fa70 0x7f3c5406fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c589f7700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3c540d0050 0x7f3c540cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c589f7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540cea60 con 0x7f3c540cfb20 2023-07-21T19:08:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c589f7700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540cf930 con 0x7f3c540d0050 2023-07-21T19:08:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c589f7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54070380 con 0x7f3c5406fa70 2023-07-21T19:08:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c51d9b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3c540d0050 0x7f3c540cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c52d9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c540cfb20 0x7f3c540cd3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58810/0 (socket says 172.21.15.123:58810) 2023-07-21T19:08:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c52d9d700 1 -- 172.21.15.123:0/1964918245 learned_addr learned my addr 172.21.15.123:0/1964918245 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c5259c700 1 --2- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c5406fa70 0x7f3c5406fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c51d9b700 1 -- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c5406fa70 msgr2=0x7f3c5406fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c51d9b700 1 --2- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c5406fa70 0x7f3c5406fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c51d9b700 1 -- 172.21.15.123:0/1964918245 >> v1:172.21.15.123:6789/0 conn(0x7f3c540cfb20 legacy=0x7f3c540cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.374+0000 7f3c51d9b700 1 -- 172.21.15.123:0/1964918245 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540cecb0 con 0x7f3c540d0050 2023-07-21T19:08:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c51d9b700 1 --2- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540d0050 0x7f3c540cce60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009850 tx=0x7f3c48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbab7384fbb047bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c5159a700 1 -- 172.21.15.123:0/1964918245 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011830 con 0x7f3c540d0050 2023-07-21T19:08:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c5159a700 1 -- 172.21.15.123:0/1964918245 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48011990 con 0x7f3c540d0050 2023-07-21T19:08:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c5159a700 1 -- 172.21.15.123:0/1964918245 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011d40 con 0x7f3c540d0050 2023-07-21T19:08:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 -- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540d0050 msgr2=0x7f3c540cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 --2- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540d0050 0x7f3c540cce60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009850 tx=0x7f3c48009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 -- 172.21.15.123:0/1964918245 shutdown_connections 2023-07-21T19:08:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 --2- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540d0050 0x7f3c540cce60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 --2- 172.21.15.123:0/1964918245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c5406fa70 0x7f3c5406fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 -- 172.21.15.123:0/1964918245 >> 172.21.15.123:0/1964918245 conn(0x7f3c5408a000 msgr2=0x7f3c540d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 -- 172.21.15.123:0/1964918245 shutdown_connections 2023-07-21T19:08:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.378+0000 7f3c589f7700 1 -- 172.21.15.123:0/1964918245 wait complete. 2023-07-21T19:08:57.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.382+0000 7f3c589f7700 1 Processor -- start 2023-07-21T19:08:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.382+0000 7f3c589f7700 1 -- start start 2023-07-21T19:08:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 0x7f3c54151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540cfb20 0x7f3c540c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c540d0050 0x7f3c541f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541549f0 con 0x7f3c5406fa70 2023-07-21T19:08:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54153d70 con 0x7f3c540cfb20 2023-07-21T19:08:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54154050 con 0x7f3c540d0050 2023-07-21T19:08:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 0x7f3c54151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 0x7f3c54151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46108/0 (socket says 172.21.15.123:46108) 2023-07-21T19:08:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 -- 172.21.15.123:0/3864775507 learned_addr learned my addr 172.21.15.123:0/3864775507 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c52d9d700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c540d0050 0x7f3c541f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c51d9b700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540cfb20 0x7f3c540c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 -- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c540d0050 msgr2=0x7f3c541f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c540d0050 0x7f3c541f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 -- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540cfb20 msgr2=0x7f3c540c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540cfb20 0x7f3c540c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 -- 172.21.15.123:0/3864775507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480094b0 con 0x7f3c5406fa70 2023-07-21T19:08:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c5259c700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 0x7f3c54151290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400e9b0 tx=0x7f3c4400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44009710 con 0x7f3c5406fa70 2023-07-21T19:08:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400c850 con 0x7f3c5406fa70 2023-07-21T19:08:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c54154330 con 0x7f3c5406fa70 2023-07-21T19:08:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400cbc0 con 0x7f3c5406fa70 2023-07-21T19:08:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.386+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c541517d0 con 0x7f3c5406fa70 2023-07-21T19:08:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.390+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5404dcb0 con 0x7f3c5406fa70 2023-07-21T19:08:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.390+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c4400cd20 con 0x7f3c5406fa70 2023-07-21T19:08:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.394+0000 7f3c42ffd700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3c340662f0 0x7f3c340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.394+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c440844f0 con 0x7f3c5406fa70 2023-07-21T19:08:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.394+0000 7f3c51d9b700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3c340662f0 0x7f3c340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.394+0000 7f3c51d9b700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3c340662f0 0x7f3c340687a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000c00 tx=0x7f3c4801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.398+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3c440515c0 con 0x7f3c5406fa70 2023-07-21T19:08:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.570+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c540cf240 con 0x7f3c5406fa70 2023-07-21T19:08:57.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.570+0000 7f3c42ffd700 1 -- 172.21.15.123:0/3864775507 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c44054be0 con 0x7f3c5406fa70 2023-07-21T19:08:57.586 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3c340662f0 msgr2=0x7f3c340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3c340662f0 0x7f3c340687a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000c00 tx=0x7f3c4801c040 comp rx=0 tx=0).stop 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 msgr2=0x7f3c54151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 0x7f3c54151290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400e9b0 tx=0x7f3c4400ecc0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 shutdown_connections 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3c340662f0 0x7f3c340687a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c540cfb20 0x7f3c540c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3c540d0050 0x7f3c541f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 --2- 172.21.15.123:0/3864775507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5406fa70 0x7f3c54151290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 >> 172.21.15.123:0/3864775507 conn(0x7f3c5408a000 msgr2=0x7f3c540ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 shutdown_connections 2023-07-21T19:08:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.574+0000 7f3c589f7700 1 -- 172.21.15.123:0/3864775507 wait complete. 2023-07-21T19:08:57.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:08:57.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.782+0000 7f1b21986700 1 Processor -- start 2023-07-21T19:08:57.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.782+0000 7f1b21986700 1 -- start start 2023-07-21T19:08:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b21986700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b21986700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b1c0cd7f0 0x7f1b1c0c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b21986700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c0cdfb0 con 0x7f1b1c1603d0 2023-07-21T19:08:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b21986700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c070e40 con 0x7f1b1c0cd7f0 2023-07-21T19:08:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b21986700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0cdcd0 con 0x7f1b1c160000 2023-07-21T19:08:57.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1affd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1a7fc700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1b1c1603d0 0x7f1b1c0c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:56782/0 (socket says 172.21.15.123:56782) 2023-07-21T19:08:57.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1a7fc700 1 -- 172.21.15.123:0/961581229 learned_addr learned my addr 172.21.15.123:0/961581229 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:08:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1b7fe700 1 --2- 172.21.15.123:0/961581229 >> v2:172.21.15.145:3300/0 conn(0x7f1b1c0cd7f0 0x7f1b1c0c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1affd700 1 -- 172.21.15.123:0/961581229 >> v2:172.21.15.145:3300/0 conn(0x7f1b1c0cd7f0 msgr2=0x7f1b1c0c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1affd700 1 --2- 172.21.15.123:0/961581229 >> v2:172.21.15.145:3300/0 conn(0x7f1b1c0cd7f0 0x7f1b1c0c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1affd700 1 -- 172.21.15.123:0/961581229 >> v1:172.21.15.145:6789/0 conn(0x7f1b1c1603d0 legacy=0x7f1b1c0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1affd700 1 -- 172.21.15.123:0/961581229 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c070780 con 0x7f1b1c160000 2023-07-21T19:08:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b1affd700 1 --2- 172.21.15.123:0/961581229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c06dd10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009850 tx=0x7f1b0c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e659a97c795c5e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b19ffb700 1 -- 172.21.15.123:0/961581229 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011830 con 0x7f1b1c160000 2023-07-21T19:08:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b19ffb700 1 -- 172.21.15.123:0/961581229 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c011990 con 0x7f1b1c160000 2023-07-21T19:08:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.786+0000 7f1b19ffb700 1 -- 172.21.15.123:0/961581229 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011d40 con 0x7f1b1c160000 2023-07-21T19:08:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 -- 172.21.15.123:0/961581229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 msgr2=0x7f1b1c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 --2- 172.21.15.123:0/961581229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c06dd10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009850 tx=0x7f1b0c009b60 comp rx=0 tx=0).stop 2023-07-21T19:08:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 -- 172.21.15.123:0/961581229 shutdown_connections 2023-07-21T19:08:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 --2- 172.21.15.123:0/961581229 >> v2:172.21.15.145:3300/0 conn(0x7f1b1c0cd7f0 0x7f1b1c0c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 --2- 172.21.15.123:0/961581229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c06dd10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 -- 172.21.15.123:0/961581229 >> 172.21.15.123:0/961581229 conn(0x7f1b1c0afc60 msgr2=0x7f1b1c0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 -- 172.21.15.123:0/961581229 shutdown_connections 2023-07-21T19:08:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 -- 172.21.15.123:0/961581229 wait complete. 2023-07-21T19:08:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 Processor -- start 2023-07-21T19:08:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.790+0000 7f1b21986700 1 -- start start 2023-07-21T19:08:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c0cd7f0 0x7f1b1c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 0x7f1b1c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c151f60 con 0x7f1b1c1603d0 2023-07-21T19:08:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c1f8c40 con 0x7f1b1c0cd7f0 2023-07-21T19:08:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0b39f0 con 0x7f1b1c160000 2023-07-21T19:08:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 0x7f1b1c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 0x7f1b1c0aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46118/0 (socket says 172.21.15.123:46118) 2023-07-21T19:08:57.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 -- 172.21.15.123:0/1812541461 learned_addr learned my addr 172.21.15.123:0/1812541461 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:57.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1a7fc700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1affd700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c0cd7f0 0x7f1b1c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 -- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 msgr2=0x7f1b1c153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 -- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c0cd7f0 msgr2=0x7f1b1c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c0cd7f0 0x7f1b1c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:57.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 -- 172.21.15.123:0/1812541461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0094b0 con 0x7f1b1c1603d0 2023-07-21T19:08:57.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b1b7fe700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 0x7f1b1c0aeb60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400efc0 tx=0x7f1b1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400cc90 con 0x7f1b1c1603d0 2023-07-21T19:08:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1400f040 con 0x7f1b1c1603d0 2023-07-21T19:08:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c0c7fe0 con 0x7f1b1c1603d0 2023-07-21T19:08:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b140146c0 con 0x7f1b1c1603d0 2023-07-21T19:08:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.794+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c1f9450 con 0x7f1b1c1603d0 2023-07-21T19:08:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.798+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c071240 con 0x7f1b1c1603d0 2023-07-21T19:08:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.798+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b14014820 con 0x7f1b1c1603d0 2023-07-21T19:08:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.798+0000 7f1b03fff700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1b080662f0 0x7f1b080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.798+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b14084b00 con 0x7f1b1c1603d0 2023-07-21T19:08:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.802+0000 7f1b1affd700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1b080662f0 0x7f1b080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.802+0000 7f1b1affd700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1b080662f0 0x7f1b080687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0090b0 tx=0x7f1b0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:57.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.806+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1b1c071240 con 0x7f1b1c1603d0 2023-07-21T19:08:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.978+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b1c071240 con 0x7f1b1c1603d0 2023-07-21T19:08:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b03fff700 1 -- 172.21.15.123:0/1812541461 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b1c071240 con 0x7f1b1c1603d0 2023-07-21T19:08:57.995 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:08:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1b080662f0 msgr2=0x7f1b080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1b080662f0 0x7f1b080687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0090b0 tx=0x7f1b0c008030 comp rx=0 tx=0).stop 2023-07-21T19:08:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 msgr2=0x7f1b1c0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 0x7f1b1c0aeb60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400efc0 tx=0x7f1b1400c3a0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 shutdown_connections 2023-07-21T19:08:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1b080662f0 0x7f1b080687a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b1c1603d0 0x7f1b1c0aeb60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b1c160000 0x7f1b1c153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 --2- 172.21.15.123:0/1812541461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c0cd7f0 0x7f1b1c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 >> 172.21.15.123:0/1812541461 conn(0x7f1b1c0afc60 msgr2=0x7f1b1c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 shutdown_connections 2023-07-21T19:08:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:57.982+0000 7f1b21986700 1 -- 172.21.15.123:0/1812541461 wait complete. 2023-07-21T19:08:58.018 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:08:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.178+0000 7f8849a00700 1 Processor -- start 2023-07-21T19:08:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.178+0000 7f8849a00700 1 -- start start 2023-07-21T19:08:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8849a00700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88440b0ee0 0x7f88440ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8849a00700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f88440cd090 0x7f88440d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8849a00700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440d0610 0x7f884415f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8849a00700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440cd4e0 con 0x7f88440b0ee0 2023-07-21T19:08:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8849a00700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440d1a60 con 0x7f88440cd090 2023-07-21T19:08:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8849a00700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440d1ef0 con 0x7f88440d0610 2023-07-21T19:08:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88440b0ee0 0x7f88440ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88440b0ee0 0x7f88440ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46130/0 (socket says 172.21.15.123:46130) 2023-07-21T19:08:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 -- 172.21.15.123:0/2905589494 learned_addr learned my addr 172.21.15.123:0/2905589494 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f88437fe700 1 --2- 172.21.15.123:0/2905589494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440d0610 0x7f884415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f88427fc700 1 --2- 172.21.15.123:0/2905589494 >> v2:172.21.15.145:3300/0 conn(0x7f88440cd090 0x7f88440d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 -- 172.21.15.123:0/2905589494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440d0610 msgr2=0x7f884415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 --2- 172.21.15.123:0/2905589494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440d0610 0x7f884415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 -- 172.21.15.123:0/2905589494 >> v2:172.21.15.145:3300/0 conn(0x7f88440cd090 msgr2=0x7f88440d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 --2- 172.21.15.123:0/2905589494 >> v2:172.21.15.145:3300/0 conn(0x7f88440cd090 0x7f88440d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 -- 172.21.15.123:0/2905589494 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440d0e50 con 0x7f88440b0ee0 2023-07-21T19:08:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f88427fc700 1 --2- 172.21.15.123:0/2905589494 >> v2:172.21.15.145:3300/0 conn(0x7f88440cd090 0x7f88440d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:58.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8842ffd700 1 --2- 172.21.15.123:0/2905589494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440b0ee0 0x7f88440ccb50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f88440b5090 tx=0x7f8834009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f6995f2bc654c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:58.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.182+0000 7f8841ffb700 1 -- 172.21.15.123:0/2905589494 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834011830 con 0x7f88440b0ee0 2023-07-21T19:08:58.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8841ffb700 1 -- 172.21.15.123:0/2905589494 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834011990 con 0x7f88440b0ee0 2023-07-21T19:08:58.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8841ffb700 1 -- 172.21.15.123:0/2905589494 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834011d20 con 0x7f88440b0ee0 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 -- 172.21.15.123:0/2905589494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440b0ee0 msgr2=0x7f88440ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 --2- 172.21.15.123:0/2905589494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440b0ee0 0x7f88440ccb50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f88440b5090 tx=0x7f8834009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 -- 172.21.15.123:0/2905589494 shutdown_connections 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 --2- 172.21.15.123:0/2905589494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440d0610 0x7f884415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 --2- 172.21.15.123:0/2905589494 >> v2:172.21.15.145:3300/0 conn(0x7f88440cd090 0x7f88440d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 --2- 172.21.15.123:0/2905589494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440b0ee0 0x7f88440ccb50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 -- 172.21.15.123:0/2905589494 >> 172.21.15.123:0/2905589494 conn(0x7f8844060c40 msgr2=0x7f884409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:58.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 -- 172.21.15.123:0/2905589494 shutdown_connections 2023-07-21T19:08:58.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.186+0000 7f8849a00700 1 -- 172.21.15.123:0/2905589494 wait complete. 2023-07-21T19:08:58.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 Processor -- start 2023-07-21T19:08:58.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 -- start start 2023-07-21T19:08:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88440b0ee0 0x7f884414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440cd090 0x7f88440cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 0x7f884414e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884415d400 con 0x7f88440d0610 2023-07-21T19:08:58.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884415c7f0 con 0x7f88440b0ee0 2023-07-21T19:08:58.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8849a00700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884415cad0 con 0x7f88440cd090 2023-07-21T19:08:58.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 0x7f884414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 0x7f884414e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46136/0 (socket says 172.21.15.123:46136) 2023-07-21T19:08:58.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 -- 172.21.15.123:0/3202190841 learned_addr learned my addr 172.21.15.123:0/3202190841 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:58.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88427fc700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440cd090 0x7f88440cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f8842ffd700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88440b0ee0 0x7f884414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 -- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440cd090 msgr2=0x7f88440cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440cd090 0x7f88440cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 -- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88440b0ee0 msgr2=0x7f884414d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88440b0ee0 0x7f884414d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.190+0000 7f88437fe700 1 -- 172.21.15.123:0/3202190841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834009570 con 0x7f88440d0610 2023-07-21T19:08:58.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f88437fe700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 0x7f884414e430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f883c00efc0 tx=0x7f883c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:58.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c009ea0 con 0x7f88440d0610 2023-07-21T19:08:58.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00f040 con 0x7f88440d0610 2023-07-21T19:08:58.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884415cdb0 con 0x7f88440d0610 2023-07-21T19:08:58.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00ced0 con 0x7f88440d0610 2023-07-21T19:08:58.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884414de90 con 0x7f88440d0610 2023-07-21T19:08:58.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.194+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884415d5b0 con 0x7f88440d0610 2023-07-21T19:08:58.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.198+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f883c014480 con 0x7f88440d0610 2023-07-21T19:08:58.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.198+0000 7f882bfff700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8830066320 0x7f88300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.198+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f883c084b10 con 0x7f88440d0610 2023-07-21T19:08:58.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.198+0000 7f8842ffd700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8830066320 0x7f88300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.198+0000 7f8842ffd700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8830066320 0x7f88300687d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8834000c00 tx=0x7f8834008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.206+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f884415d5b0 con 0x7f88440d0610 2023-07-21T19:08:58.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f884404e500 con 0x7f88440d0610 2023-07-21T19:08:58.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f882bfff700 1 -- 172.21.15.123:0/3202190841 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f883c051bc0 con 0x7f88440d0610 2023-07-21T19:08:58.396 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:08:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8830066320 msgr2=0x7f88300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8830066320 0x7f88300687d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8834000c00 tx=0x7f8834008030 comp rx=0 tx=0).stop 2023-07-21T19:08:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 msgr2=0x7f884414e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 0x7f884414e430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f883c00efc0 tx=0x7f883c00c3a0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 shutdown_connections 2023-07-21T19:08:58.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8830066320 0x7f88300687d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88440d0610 0x7f884414e430 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88440cd090 0x7f88440cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 --2- 172.21.15.123:0/3202190841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88440b0ee0 0x7f884414d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.382+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 >> 172.21.15.123:0/3202190841 conn(0x7f8844060c40 msgr2=0x7f8844070760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.386+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 shutdown_connections 2023-07-21T19:08:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.386+0000 7f8849a00700 1 -- 172.21.15.123:0/3202190841 wait complete. 2023-07-21T19:08:58.420 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:08:58.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.582+0000 7f03a14b1700 1 Processor -- start 2023-07-21T19:08:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f03a14b1700 1 -- start start 2023-07-21T19:08:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f03a14b1700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f039c0c9d90 0x7f039c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f03a14b1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c159f20 0x7f039c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f03a14b1700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c0b0ef0 con 0x7f039c0caf70 2023-07-21T19:08:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f03a14b1700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0ce9c0 con 0x7f039c0c9d90 2023-07-21T19:08:58.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f03a14b1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0cee50 con 0x7f039c159f20 2023-07-21T19:08:58.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f039affd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f039c0c9d90 0x7f039c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f039affd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f039c0c9d90 0x7f039c0ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:54086/0 (socket says 172.21.15.123:54086) 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f039affd700 1 -- 172.21.15.123:0/2779604793 learned_addr learned my addr 172.21.15.123:0/2779604793 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f0393fff700 1 --2- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c159f20 0x7f039c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f039affd700 1 -- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c159f20 msgr2=0x7f039c0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.586+0000 7f039affd700 1 --2- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c159f20 0x7f039c0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f039affd700 1 -- 172.21.15.123:0/2779604793 >> v1:172.21.15.145:6789/0 conn(0x7f039c0caf70 legacy=0x7f039c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f039affd700 1 -- 172.21.15.123:0/2779604793 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0ca6a0 con 0x7f039c0c9d90 2023-07-21T19:08:58.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f039affd700 1 --2- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c0ca160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f038c009910 tx=0x7f038c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7569af530545e7ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:58.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f039a7fc700 1 -- 172.21.15.123:0/2779604793 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011830 con 0x7f039c0c9d90 2023-07-21T19:08:58.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f039a7fc700 1 -- 172.21.15.123:0/2779604793 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c011990 con 0x7f039c0c9d90 2023-07-21T19:08:58.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f039a7fc700 1 -- 172.21.15.123:0/2779604793 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011d40 con 0x7f039c0c9d90 2023-07-21T19:08:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 -- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 msgr2=0x7f039c0ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 --2- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c0ca160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f038c009910 tx=0x7f038c009c20 comp rx=0 tx=0).stop 2023-07-21T19:08:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 -- 172.21.15.123:0/2779604793 shutdown_connections 2023-07-21T19:08:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 --2- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c159f20 0x7f039c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 --2- 172.21.15.123:0/2779604793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c0ca160 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 -- 172.21.15.123:0/2779604793 >> 172.21.15.123:0/2779604793 conn(0x7f039c06e960 msgr2=0x7f039c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:58.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 -- 172.21.15.123:0/2779604793 shutdown_connections 2023-07-21T19:08:58.607 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.590+0000 7f03a14b1700 1 -- 172.21.15.123:0/2779604793 wait complete. 2023-07-21T19:08:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 Processor -- start 2023-07-21T19:08:58.609 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 -- start start 2023-07-21T19:08:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c0caf70 0x7f039c0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 0x7f039c0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0c2660 con 0x7f039c159f20 2023-07-21T19:08:58.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c14f5e0 con 0x7f039c0c9d90 2023-07-21T19:08:58.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.594+0000 7f03a14b1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0c1cc0 con 0x7f039c0caf70 2023-07-21T19:08:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 0x7f039c0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 0x7f039c0c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46138/0 (socket says 172.21.15.123:46138) 2023-07-21T19:08:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 -- 172.21.15.123:0/4032899338 learned_addr learned my addr 172.21.15.123:0/4032899338 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f0393fff700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c0caf70 0x7f039c0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039affd700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 -- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c0caf70 msgr2=0x7f039c0c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c0caf70 0x7f039c0c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 -- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 msgr2=0x7f039c14f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c14f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 -- 172.21.15.123:0/4032899338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c009570 con 0x7f039c159f20 2023-07-21T19:08:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f039b7fe700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 0x7f039c0c33b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f039400cc50 tx=0x7f039400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394003c20 con 0x7f039c159f20 2023-07-21T19:08:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394003d80 con 0x7f039c159f20 2023-07-21T19:08:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400aab0 con 0x7f039c159f20 2023-07-21T19:08:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c0c1fa0 con 0x7f039c159f20 2023-07-21T19:08:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c15c580 con 0x7f039c159f20 2023-07-21T19:08:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.598+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c0c27a0 con 0x7f039c159f20 2023-07-21T19:08:58.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.602+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f039400ac10 con 0x7f039c159f20 2023-07-21T19:08:58.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.602+0000 7f03937fe700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f037c0662f0 0x7f037c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:58.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.602+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f03940840d0 con 0x7f039c159f20 2023-07-21T19:08:58.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.602+0000 7f039affd700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f037c0662f0 0x7f037c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:58.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.606+0000 7f039affd700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f037c0662f0 0x7f037c0687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f038c000c00 tx=0x7f038c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:58.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.610+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f039c0c27a0 con 0x7f039c159f20 2023-07-21T19:08:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.794+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f039c0c27a0 con 0x7f039c159f20 2023-07-21T19:08:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.794+0000 7f03937fe700 1 -- 172.21.15.123:0/4032899338 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f039c0c27a0 con 0x7f039c159f20 2023-07-21T19:08:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f037c0662f0 msgr2=0x7f037c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f037c0662f0 0x7f037c0687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f038c000c00 tx=0x7f038c008030 comp rx=0 tx=0).stop 2023-07-21T19:08:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 msgr2=0x7f039c0c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 0x7f039c0c33b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f039400cc50 tx=0x7f039400cf60 comp rx=0 tx=0).stop 2023-07-21T19:08:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 shutdown_connections 2023-07-21T19:08:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f037c0662f0 0x7f037c0687a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039c159f20 0x7f039c0c33b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f039c0caf70 0x7f039c0c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 --2- 172.21.15.123:0/4032899338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f039c0c9d90 0x7f039c14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 >> 172.21.15.123:0/4032899338 conn(0x7f039c06e960 msgr2=0x7f039c0afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 shutdown_connections 2023-07-21T19:08:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:58.798+0000 7f03a14b1700 1 -- 172.21.15.123:0/4032899338 wait complete. 2023-07-21T19:08:58.816 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:08:58.838 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi145.front.sepia.ceph.com... 2023-07-21T19:08:58.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:58.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-21T19:08:58.887 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:08:58.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:08:58.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:08:58.889 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T19:08:58.962 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:58.962 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:58.979 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:08:58.979 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:08:59.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:08:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.242+0000 7fd140dae700 1 Processor -- start 2023-07-21T19:08:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd140dae700 1 -- start start 2023-07-21T19:08:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd140dae700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd13c15bf20 0x7fd13c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd140dae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd13c0d1430 0x7fd13c0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd140dae700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c15c2f0 con 0x7fd13c0b1530 2023-07-21T19:08:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd140dae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0d1830 con 0x7fd13c0d1430 2023-07-21T19:08:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd140dae700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c070830 con 0x7fd13c15bf20 2023-07-21T19:08:59.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd13c0d1430 0x7fd13c0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13a59c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd13c15bf20 0x7fd13c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd13c0d1430 0x7fd13c0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46140/0 (socket says 172.21.15.123:46140) 2023-07-21T19:08:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13a59c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd13c15bf20 0x7fd13c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:54102/0 (socket says 172.21.15.123:54102) 2023-07-21T19:08:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 -- 172.21.15.123:0/3208668220 learned_addr learned my addr 172.21.15.123:0/3208668220 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 -- 172.21.15.123:0/3208668220 >> v2:172.21.15.145:3300/0 conn(0x7fd13c15bf20 msgr2=0x7fd13c0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 --2- 172.21.15.123:0/3208668220 >> v2:172.21.15.145:3300/0 conn(0x7fd13c15bf20 0x7fd13c0b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 -- 172.21.15.123:0/3208668220 >> v1:172.21.15.145:6789/0 conn(0x7fd13c0b1530 legacy=0x7fd13c0d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.246+0000 7fd13ad9d700 1 -- 172.21.15.123:0/3208668220 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c070b10 con 0x7fd13c0d1430 2023-07-21T19:08:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd13ad9d700 1 --2- 172.21.15.123:0/3208668220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c0b4050 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd13c072eb0 tx=0x7fd13400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa80a3033c9dbc9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd139d9b700 1 -- 172.21.15.123:0/3208668220 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400e070 con 0x7fd13c0d1430 2023-07-21T19:08:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd139d9b700 1 -- 172.21.15.123:0/3208668220 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13400b910 con 0x7fd13c0d1430 2023-07-21T19:08:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd139d9b700 1 -- 172.21.15.123:0/3208668220 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400bcc0 con 0x7fd13c0d1430 2023-07-21T19:08:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 -- 172.21.15.123:0/3208668220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 msgr2=0x7fd13c0b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 --2- 172.21.15.123:0/3208668220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c0b4050 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd13c072eb0 tx=0x7fd13400b330 comp rx=0 tx=0).stop 2023-07-21T19:08:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 -- 172.21.15.123:0/3208668220 shutdown_connections 2023-07-21T19:08:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 --2- 172.21.15.123:0/3208668220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c0b4050 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 --2- 172.21.15.123:0/3208668220 >> v2:172.21.15.145:3300/0 conn(0x7fd13c15bf20 0x7fd13c0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 -- 172.21.15.123:0/3208668220 >> 172.21.15.123:0/3208668220 conn(0x7fd13c06fc80 msgr2=0x7fd13c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 -- 172.21.15.123:0/3208668220 shutdown_connections 2023-07-21T19:08:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.250+0000 7fd140dae700 1 -- 172.21.15.123:0/3208668220 wait complete. 2023-07-21T19:08:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 Processor -- start 2023-07-21T19:08:59.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 -- start start 2023-07-21T19:08:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd13c0b1530 0x7fd13c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd13c15bf20 0x7fd13c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0b2860 con 0x7fd13c0d1430 2023-07-21T19:08:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c15f2b0 con 0x7fd13c15bf20 2023-07-21T19:08:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd140dae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0b1f30 con 0x7fd13c0b1530 2023-07-21T19:08:59.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd133fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd133fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46152/0 (socket says 172.21.15.123:46152) 2023-07-21T19:08:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd133fff700 1 -- 172.21.15.123:0/627884632 learned_addr learned my addr 172.21.15.123:0/627884632 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd13a59c700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd13c0b1530 0x7fd13c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.254+0000 7fd13ad9d700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd13c15bf20 0x7fd13c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd133fff700 1 -- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd13c0b1530 msgr2=0x7fd13c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd133fff700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd13c0b1530 0x7fd13c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd133fff700 1 -- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd13c15bf20 msgr2=0x7fd13c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd133fff700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd13c15bf20 0x7fd13c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd133fff700 1 -- 172.21.15.123:0/627884632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009b30 con 0x7fd13c0d1430 2023-07-21T19:08:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd133fff700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c14f5f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd12400c500 tx=0x7fd12400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240052d0 con 0x7fd13c0d1430 2023-07-21T19:08:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124005430 con 0x7fd13c0d1430 2023-07-21T19:08:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c0b2210 con 0x7fd13c0d1430 2023-07-21T19:08:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240055a0 con 0x7fd13c0d1430 2023-07-21T19:08:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c0c9be0 con 0x7fd13c0d1430 2023-07-21T19:08:59.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.258+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c0b29d0 con 0x7fd13c0d1430 2023-07-21T19:08:59.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.262+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1240038e0 con 0x7fd13c0d1430 2023-07-21T19:08:59.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.262+0000 7fd132ffd700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd11c0662f0 0x7fd11c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.262+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd1240834c0 con 0x7fd13c0d1430 2023-07-21T19:08:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.262+0000 7fd13a59c700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd11c0662f0 0x7fd11c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.262+0000 7fd13a59c700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd11c0662f0 0x7fd11c0687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd13c15d9f0 tx=0x7fd12c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.266+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd124050600 con 0x7fd13c0d1430 2023-07-21T19:08:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.446+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd13c0ccf70 con 0x7fd13c0d1430 2023-07-21T19:08:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd132ffd700 1 -- 172.21.15.123:0/627884632 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7fd124053c20 con 0x7fd13c0d1430 2023-07-21T19:08:59.463 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:08:59.464 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:08:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd11c0662f0 msgr2=0x7fd11c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd11c0662f0 0x7fd11c0687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd13c15d9f0 tx=0x7fd12c008040 comp rx=0 tx=0).stop 2023-07-21T19:08:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 msgr2=0x7fd13c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c14f5f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd12400c500 tx=0x7fd12400c8c0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 shutdown_connections 2023-07-21T19:08:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd11c0662f0 0x7fd11c0687a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd13c15bf20 0x7fd13c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13c0d1430 0x7fd13c14f5f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 --2- 172.21.15.123:0/627884632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd13c0b1530 0x7fd13c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 >> 172.21.15.123:0/627884632 conn(0x7fd13c06fc80 msgr2=0x7fd13c15adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 shutdown_connections 2023-07-21T19:08:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.450+0000 7fd140dae700 1 -- 172.21.15.123:0/627884632 wait complete. 2023-07-21T19:08:59.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:08:59.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:08:59.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.650+0000 7f8b7b59e700 1 Processor -- start 2023-07-21T19:08:59.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.650+0000 7f8b7b59e700 1 -- start start 2023-07-21T19:08:59.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7b59e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8b74069ca0 0x7f8b740ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b7406a680 0x7f8b74160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7b59e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7415fd90 con 0x7f8b7406aaf0 2023-07-21T19:08:59.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b74159eb0 con 0x7f8b7406a680 2023-07-21T19:08:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7b59e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7415fa90 con 0x7f8b74069ca0 2023-07-21T19:08:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b7406a680 0x7f8b74160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b7406a680 0x7f8b74160220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46162/0 (socket says 172.21.15.123:46162) 2023-07-21T19:08:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 -- 172.21.15.123:0/1960399449 learned_addr learned my addr 172.21.15.123:0/1960399449 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7a59c700 1 --2- 172.21.15.123:0/1960399449 >> v2:172.21.15.145:3300/0 conn(0x7f8b74069ca0 0x7f8b740ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 -- 172.21.15.123:0/1960399449 >> v2:172.21.15.145:3300/0 conn(0x7f8b74069ca0 msgr2=0x7f8b740ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:08:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 --2- 172.21.15.123:0/1960399449 >> v2:172.21.15.145:3300/0 conn(0x7f8b74069ca0 0x7f8b740ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 -- 172.21.15.123:0/1960399449 >> v1:172.21.15.145:6789/0 conn(0x7f8b7406aaf0 legacy=0x7f8b7406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 -- 172.21.15.123:0/1960399449 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740ce8b0 con 0x7f8b7406a680 2023-07-21T19:08:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7a59c700 1 --2- 172.21.15.123:0/1960399449 >> v2:172.21.15.145:3300/0 conn(0x7f8b74069ca0 0x7f8b740ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:08:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b79d9b700 1 --2- 172.21.15.123:0/1960399449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7406a680 0x7f8b74160220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b74070710 tx=0x7f8b6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59dbf7738964687 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7959a700 1 -- 172.21.15.123:0/1960399449 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00b8a0 con 0x7f8b7406a680 2023-07-21T19:08:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7959a700 1 -- 172.21.15.123:0/1960399449 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00ba00 con 0x7f8b7406a680 2023-07-21T19:08:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.654+0000 7f8b7959a700 1 -- 172.21.15.123:0/1960399449 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00bd90 con 0x7f8b7406a680 2023-07-21T19:08:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 -- 172.21.15.123:0/1960399449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7406a680 msgr2=0x7f8b74160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/1960399449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7406a680 0x7f8b74160220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b74070710 tx=0x7f8b6c009bf0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 -- 172.21.15.123:0/1960399449 shutdown_connections 2023-07-21T19:08:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/1960399449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b7406a680 0x7f8b74160220 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/1960399449 >> v2:172.21.15.145:3300/0 conn(0x7f8b74069ca0 0x7f8b740ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 -- 172.21.15.123:0/1960399449 >> 172.21.15.123:0/1960399449 conn(0x7f8b7406fa70 msgr2=0x7f8b7406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:59.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 -- 172.21.15.123:0/1960399449 shutdown_connections 2023-07-21T19:08:59.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 -- 172.21.15.123:0/1960399449 wait complete. 2023-07-21T19:08:59.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 Processor -- start 2023-07-21T19:08:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.658+0000 7f8b7b59e700 1 -- start start 2023-07-21T19:08:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 0x7f8b740c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b7406a680 0x7f8b741f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b7406aaf0 0x7f8b740ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740c71b0 con 0x7f8b74069ca0 2023-07-21T19:08:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740c77e0 con 0x7f8b7406aaf0 2023-07-21T19:08:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740c7ac0 con 0x7f8b7406a680 2023-07-21T19:08:59.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 0x7f8b740c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 0x7f8b740c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46164/0 (socket says 172.21.15.123:46164) 2023-07-21T19:08:59.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 -- 172.21.15.123:0/4205912830 learned_addr learned my addr 172.21.15.123:0/4205912830 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:08:59.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7ad9d700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b7406aaf0 0x7f8b740ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b79d9b700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b7406a680 0x7f8b741f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 -- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b7406a680 msgr2=0x7f8b741f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b7406a680 0x7f8b741f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 -- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b7406aaf0 msgr2=0x7f8b740ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b7406aaf0 0x7f8b740ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 -- 172.21.15.123:0/4205912830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c009570 con 0x7f8b74069ca0 2023-07-21T19:08:59.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7a59c700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 0x7f8b740c6c70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800e760 tx=0x7f8b6800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:59.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800c070 con 0x7f8b74069ca0 2023-07-21T19:08:59.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68004250 con 0x7f8b74069ca0 2023-07-21T19:08:59.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b740c7da0 con 0x7f8b74069ca0 2023-07-21T19:08:59.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680036c0 con 0x7f8b74069ca0 2023-07-21T19:08:59.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.662+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b740c8360 con 0x7f8b74069ca0 2023-07-21T19:08:59.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.666+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7404e500 con 0x7f8b74069ca0 2023-07-21T19:08:59.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.666+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b68003820 con 0x7f8b74069ca0 2023-07-21T19:08:59.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.666+0000 7f8b66ffd700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8b580662f0 0x7f8b580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:08:59.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.666+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8b68083d00 con 0x7f8b74069ca0 2023-07-21T19:08:59.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.670+0000 7f8b79d9b700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8b580662f0 0x7f8b580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:08:59.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.670+0000 7f8b79d9b700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8b580662f0 0x7f8b580687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c000c00 tx=0x7f8b6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:08:59.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.674+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8b68050e50 con 0x7f8b74069ca0 2023-07-21T19:08:59.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.846+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b740b1890 con 0x7f8b74069ca0 2023-07-21T19:08:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.846+0000 7f8b66ffd700 1 -- 172.21.15.123:0/4205912830 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b680094e0 con 0x7f8b74069ca0 2023-07-21T19:08:59.861 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:08:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8b580662f0 msgr2=0x7f8b580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8b580662f0 0x7f8b580687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c000c00 tx=0x7f8b6c008030 comp rx=0 tx=0).stop 2023-07-21T19:08:59.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 msgr2=0x7f8b740c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:08:59.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 0x7f8b740c6c70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800e760 tx=0x7f8b6800ea70 comp rx=0 tx=0).stop 2023-07-21T19:08:59.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 shutdown_connections 2023-07-21T19:08:59.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8b580662f0 0x7f8b580687a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b7406aaf0 0x7f8b740ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b7406a680 0x7f8b741f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 --2- 172.21.15.123:0/4205912830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b74069ca0 0x7f8b740c6c70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:08:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 >> 172.21.15.123:0/4205912830 conn(0x7f8b7406fa70 msgr2=0x7f8b7406dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:08:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 shutdown_connections 2023-07-21T19:08:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:08:59.850+0000 7f8b7b59e700 1 -- 172.21.15.123:0/4205912830 wait complete. 2023-07-21T19:08:59.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:09:00.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.046+0000 7f3805324700 1 Processor -- start 2023-07-21T19:09:00.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.046+0000 7f3805324700 1 -- start start 2023-07-21T19:09:00.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3800159c60 0x7f380006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38000b0770 0x7f3800070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f38000cab00 0x7f38000caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000cb4c0 con 0x7f38000b0770 2023-07-21T19:09:00.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380006da00 con 0x7f38000cab00 2023-07-21T19:09:00.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380006dce0 con 0x7f3800159c60 2023-07-21T19:09:00.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38000b0770 0x7f3800070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38000b0770 0x7f3800070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46176/0 (socket says 172.21.15.123:46176) 2023-07-21T19:09:00.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 -- 172.21.15.123:0/1244864397 learned_addr learned my addr 172.21.15.123:0/1244864397 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:00.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37fffff700 1 --2- 172.21.15.123:0/1244864397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3800159c60 0x7f380006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3804b23700 1 --2- 172.21.15.123:0/1244864397 >> v2:172.21.15.145:3300/0 conn(0x7f38000cab00 0x7f38000caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 -- 172.21.15.123:0/1244864397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3800159c60 msgr2=0x7f380006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 --2- 172.21.15.123:0/1244864397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3800159c60 0x7f380006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 -- 172.21.15.123:0/1244864397 >> v2:172.21.15.145:3300/0 conn(0x7f38000cab00 msgr2=0x7f38000caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 --2- 172.21.15.123:0/1244864397 >> v2:172.21.15.145:3300/0 conn(0x7f38000cab00 0x7f38000caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 -- 172.21.15.123:0/1244864397 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380006dfc0 con 0x7f38000b0770 2023-07-21T19:09:00.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37f7fff700 1 --2- 172.21.15.123:0/1244864397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38000b0770 0x7f3800070de0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f38000c8730 tx=0x7f37e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5c01cfbd89ca18 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37ff7fe700 1 -- 172.21.15.123:0/1244864397 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800b8a0 con 0x7f38000b0770 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37ff7fe700 1 -- 172.21.15.123:0/1244864397 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800ba00 con 0x7f38000b0770 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f37ff7fe700 1 -- 172.21.15.123:0/1244864397 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800bd90 con 0x7f38000b0770 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 -- 172.21.15.123:0/1244864397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38000b0770 msgr2=0x7f3800070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.050+0000 7f3805324700 1 --2- 172.21.15.123:0/1244864397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38000b0770 0x7f3800070de0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f38000c8730 tx=0x7f37e8009bf0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 -- 172.21.15.123:0/1244864397 shutdown_connections 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 --2- 172.21.15.123:0/1244864397 >> v2:172.21.15.145:3300/0 conn(0x7f38000cab00 0x7f38000caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 --2- 172.21.15.123:0/1244864397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38000b0770 0x7f3800070de0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 --2- 172.21.15.123:0/1244864397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3800159c60 0x7f380006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 -- 172.21.15.123:0/1244864397 >> 172.21.15.123:0/1244864397 conn(0x7f38000afc60 msgr2=0x7f38000b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 -- 172.21.15.123:0/1244864397 shutdown_connections 2023-07-21T19:09:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 -- 172.21.15.123:0/1244864397 wait complete. 2023-07-21T19:09:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 Processor -- start 2023-07-21T19:09:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.054+0000 7f3805324700 1 -- start start 2023-07-21T19:09:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38000b0770 0x7f3800151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38000cab00 0x7f38000c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 0x7f38000c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000c6980 con 0x7f3800159c60 2023-07-21T19:09:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800151a60 con 0x7f38000b0770 2023-07-21T19:09:00.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b2c20 con 0x7f38000cab00 2023-07-21T19:09:00.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 0x7f38000c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 0x7f38000c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46192/0 (socket says 172.21.15.123:46192) 2023-07-21T19:09:00.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 -- 172.21.15.123:0/3162496555 learned_addr learned my addr 172.21.15.123:0/3162496555 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:00.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f37fffff700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38000b0770 0x7f3800151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f37f7fff700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38000cab00 0x7f38000c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 -- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38000cab00 msgr2=0x7f38000c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38000cab00 0x7f38000c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 -- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38000b0770 msgr2=0x7f3800151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38000b0770 0x7f3800151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 -- 172.21.15.123:0/3162496555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8009570 con 0x7f3800159c60 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3804b23700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 0x7f38000c5760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007e60 tx=0x7f37f800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800ede0 con 0x7f3800159c60 2023-07-21T19:09:00.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f8014420 con 0x7f3800159c60 2023-07-21T19:09:00.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38000c5d70 con 0x7f3800159c60 2023-07-21T19:09:00.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80147d0 con 0x7f3800159c60 2023-07-21T19:09:00.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.058+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38000c6330 con 0x7f3800159c60 2023-07-21T19:09:00.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.062+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380004e500 con 0x7f3800159c60 2023-07-21T19:09:00.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.062+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37f8014930 con 0x7f3800159c60 2023-07-21T19:09:00.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.062+0000 7f37fd7fa700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f37e00662f0 0x7f37e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.062+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37f8084870 con 0x7f3800159c60 2023-07-21T19:09:00.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.062+0000 7f37fffff700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f37e00662f0 0x7f37e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.066+0000 7f37fffff700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f37e00662f0 0x7f37e00687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009a00 tx=0x7f37f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.066+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f37f80518a0 con 0x7f3800159c60 2023-07-21T19:09:00.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.238+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f38000c6ac0 con 0x7f3800159c60 2023-07-21T19:09:00.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f37fd7fa700 1 -- 172.21.15.123:0/3162496555 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37f8054ec0 con 0x7f3800159c60 2023-07-21T19:09:00.255 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:09:00.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f37e00662f0 msgr2=0x7f37e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f37e00662f0 0x7f37e00687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009a00 tx=0x7f37f0008040 comp rx=0 tx=0).stop 2023-07-21T19:09:00.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 msgr2=0x7f38000c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 0x7f38000c5760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007e60 tx=0x7f37f800e3c0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 shutdown_connections 2023-07-21T19:09:00.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f37e00662f0 0x7f37e00687a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3800159c60 0x7f38000c5760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38000cab00 0x7f38000c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 --2- 172.21.15.123:0/3162496555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38000b0770 0x7f3800151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 >> 172.21.15.123:0/3162496555 conn(0x7f38000afc60 msgr2=0x7f38000c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 shutdown_connections 2023-07-21T19:09:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.242+0000 7f3805324700 1 -- 172.21.15.123:0/3162496555 wait complete. 2023-07-21T19:09:00.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:09:00.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.442+0000 7fb033545700 1 Processor -- start 2023-07-21T19:09:00.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.442+0000 7fb033545700 1 -- start start 2023-07-21T19:09:00.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb033545700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb02c0cd260 0x7fb02c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb033545700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb02c0d0610 0x7fb02c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb033545700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0d1a60 con 0x7fb02c0b0ee0 2023-07-21T19:09:00.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb033545700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0d1ef0 con 0x7fb02c0cd260 2023-07-21T19:09:00.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb033545700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0d0e50 con 0x7fb02c0d0610 2023-07-21T19:09:00.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb02c0cd260 0x7fb02c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb02c0cd260 0x7fb02c0d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46200/0 (socket says 172.21.15.123:46200) 2023-07-21T19:09:00.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 -- 172.21.15.123:0/2620104468 learned_addr learned my addr 172.21.15.123:0/2620104468 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:00.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb032d44700 1 --2- 172.21.15.123:0/2620104468 >> v2:172.21.15.145:3300/0 conn(0x7fb02c0d0610 0x7fb02c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 -- 172.21.15.123:0/2620104468 >> v2:172.21.15.145:3300/0 conn(0x7fb02c0d0610 msgr2=0x7fb02c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 --2- 172.21.15.123:0/2620104468 >> v2:172.21.15.145:3300/0 conn(0x7fb02c0d0610 0x7fb02c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 -- 172.21.15.123:0/2620104468 >> v1:172.21.15.145:6789/0 conn(0x7fb02c0b0ee0 legacy=0x7fb02c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 -- 172.21.15.123:0/2620104468 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0d1130 con 0x7fb02c0cd260 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031d42700 1 --2- 172.21.15.123:0/2620104468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0cd260 0x7fb02c0d00d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb02c08c990 tx=0x7fb01c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea1f90e1d478c7d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031541700 1 -- 172.21.15.123:0/2620104468 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00b8a0 con 0x7fb02c0cd260 2023-07-21T19:09:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031541700 1 -- 172.21.15.123:0/2620104468 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00ba00 con 0x7fb02c0cd260 2023-07-21T19:09:00.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.446+0000 7fb031541700 1 -- 172.21.15.123:0/2620104468 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00bd90 con 0x7fb02c0cd260 2023-07-21T19:09:00.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 -- 172.21.15.123:0/2620104468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0cd260 msgr2=0x7fb02c0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 --2- 172.21.15.123:0/2620104468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0cd260 0x7fb02c0d00d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb02c08c990 tx=0x7fb01c009bf0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 -- 172.21.15.123:0/2620104468 shutdown_connections 2023-07-21T19:09:00.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 --2- 172.21.15.123:0/2620104468 >> v2:172.21.15.145:3300/0 conn(0x7fb02c0d0610 0x7fb02c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 --2- 172.21.15.123:0/2620104468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0cd260 0x7fb02c0d00d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 -- 172.21.15.123:0/2620104468 >> 172.21.15.123:0/2620104468 conn(0x7fb02c060c40 msgr2=0x7fb02c09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:00.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 -- 172.21.15.123:0/2620104468 shutdown_connections 2023-07-21T19:09:00.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.450+0000 7fb033545700 1 -- 172.21.15.123:0/2620104468 wait complete. 2023-07-21T19:09:00.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 Processor -- start 2023-07-21T19:09:00.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 -- start start 2023-07-21T19:09:00.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb02c0b0ee0 0x7fb02c1f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb02c0cd260 0x7fb02c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 0x7fb02c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0cb5d0 con 0x7fb02c0d0610 2023-07-21T19:09:00.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0ca950 con 0x7fb02c0cd260 2023-07-21T19:09:00.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb033545700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0cac30 con 0x7fb02c0b0ee0 2023-07-21T19:09:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 0x7fb02c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 0x7fb02c0b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46208/0 (socket says 172.21.15.123:46208) 2023-07-21T19:09:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 -- 172.21.15.123:0/2516277260 learned_addr learned my addr 172.21.15.123:0/2516277260 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb031d42700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb02c0cd260 0x7fb02c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032543700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb02c0b0ee0 0x7fb02c1f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 -- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb02c0b0ee0 msgr2=0x7fb02c1f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb02c0b0ee0 0x7fb02c1f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 -- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb02c0cd260 msgr2=0x7fb02c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb02c0cd260 0x7fb02c06fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.454+0000 7fb032d44700 1 -- 172.21.15.123:0/2516277260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009570 con 0x7fb02c0d0610 2023-07-21T19:09:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb032d44700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 0x7fb02c0b4570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb024007e40 tx=0x7fb02400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400ed30 con 0x7fb02c0d0610 2023-07-21T19:09:00.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024014420 con 0x7fb02c0d0610 2023-07-21T19:09:00.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0caf10 con 0x7fb02c0d0610 2023-07-21T19:09:00.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240147d0 con 0x7fb02c0d0610 2023-07-21T19:09:00.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1f1a50 con 0x7fb02c0d0610 2023-07-21T19:09:00.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.458+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0cb710 con 0x7fb02c0d0610 2023-07-21T19:09:00.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.462+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb024014930 con 0x7fb02c0d0610 2023-07-21T19:09:00.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.462+0000 7fb022ffd700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb0100662f0 0x7fb0100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.462+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb024084730 con 0x7fb02c0d0610 2023-07-21T19:09:00.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.462+0000 7fb032543700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb0100662f0 0x7fb0100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.462+0000 7fb032543700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb0100662f0 0x7fb0100687a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb028000f60 tx=0x7fb028009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.466+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb02c0cb710 con 0x7fb02c0d0610 2023-07-21T19:09:00.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.638+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb02c0cb710 con 0x7fb02c0d0610 2023-07-21T19:09:00.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.638+0000 7fb022ffd700 1 -- 172.21.15.123:0/2516277260 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb02c0cb710 con 0x7fb02c0d0610 2023-07-21T19:09:00.653 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:00.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb0100662f0 msgr2=0x7fb0100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb0100662f0 0x7fb0100687a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb028000f60 tx=0x7fb028009040 comp rx=0 tx=0).stop 2023-07-21T19:09:00.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 msgr2=0x7fb02c0b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 0x7fb02c0b4570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb024007e40 tx=0x7fb02400e3c0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 shutdown_connections 2023-07-21T19:09:00.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb0100662f0 0x7fb0100687a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb02c0cd260 0x7fb02c06fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c0d0610 0x7fb02c0b4570 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 --2- 172.21.15.123:0/2516277260 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb02c0b0ee0 0x7fb02c1f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 >> 172.21.15.123:0/2516277260 conn(0x7fb02c060c40 msgr2=0x7fb02c15adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 shutdown_connections 2023-07-21T19:09:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.642+0000 7fb033545700 1 -- 172.21.15.123:0/2516277260 wait complete. 2023-07-21T19:09:00.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:09:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.838+0000 7f4508c40700 1 Processor -- start 2023-07-21T19:09:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.838+0000 7f4508c40700 1 -- start start 2023-07-21T19:09:00.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4508c40700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f45040b0ee0 0x7f45040ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4508c40700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 0x7f45040af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4508c40700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040cd4e0 con 0x7f45040cd090 2023-07-21T19:09:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4508c40700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45040d0c60 con 0x7f45040b0ee0 2023-07-21T19:09:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4508c40700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040d1a60 con 0x7f45040d07e0 2023-07-21T19:09:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4502ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f45040cd090 0x7f45040d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58822/0 (socket says 172.21.15.123:58822) 2023-07-21T19:09:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4502ffd700 1 -- 172.21.15.123:0/3787557398 learned_addr learned my addr 172.21.15.123:0/3787557398 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45037fe700 1 --2- 172.21.15.123:0/3787557398 >> v2:172.21.15.145:3300/0 conn(0x7f45040b0ee0 0x7f45040ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f4503fff700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 0x7f45040af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708468321 0 0) 0x7f44f8001110 con 0x7f45040cd090 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec0035d0 con 0x7f45040cd090 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 554408943 0 0) 0x7f44ec0035d0 con 0x7f45040cd090 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 msgr2=0x7f45040af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 0x7f45040af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 >> v2:172.21.15.145:3300/0 conn(0x7f45040b0ee0 msgr2=0x7f45040ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 --2- 172.21.15.123:0/3787557398 >> v2:172.21.15.145:3300/0 conn(0x7f45040b0ee0 0x7f45040ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040d1ef0 con 0x7f45040cd090 2023-07-21T19:09:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f44f8001800 con 0x7f45040cd090 2023-07-21T19:09:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 >> v1:172.21.15.123:6789/0 conn(0x7f45040cd090 legacy=0x7f45040d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44ec003a20 0x7f44ec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f44ec004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 0x7f44ec004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040d1a60 con 0x7f44ec004450 2023-07-21T19:09:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec00ba30 con 0x7f44ec003a20 2023-07-21T19:09:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.842+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec00bb70 con 0x7f45040d07e0 2023-07-21T19:09:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f44ec004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f45037fe700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44ec003a20 0x7f44ec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4503fff700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 0x7f44ec004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 -- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 msgr2=0x7f44ec004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040d07e0 0x7f44ec004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 -- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44ec003a20 msgr2=0x7f44ec003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44ec003a20 0x7f44ec003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 -- 172.21.15.123:0/3787557398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec0035d0 con 0x7f44ec004450 2023-07-21T19:09:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4502ffd700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f44ec004910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c2f0 tx=0x7f44ec0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5fda4b5e6d9469 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800ce30 con 0x7f44ec004450 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8005980 con 0x7f44ec004450 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f45027fc700 1 -- 172.21.15.123:0/3787557398 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8005d30 con 0x7f44ec004450 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4508c40700 1 -- 172.21.15.123:0/3787557398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 msgr2=0x7f44ec004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4508c40700 1 --2- 172.21.15.123:0/3787557398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f44ec004910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c2f0 tx=0x7f44ec0058a0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4503fff700 1 -- 172.21.15.123:0/3787557398 reap_dead start 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4508c40700 1 -- 172.21.15.123:0/3787557398 shutdown_connections 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4508c40700 1 -- 172.21.15.123:0/3787557398 >> 172.21.15.123:0/3787557398 conn(0x7f4504060c40 msgr2=0x7f450409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4508c40700 1 -- 172.21.15.123:0/3787557398 shutdown_connections 2023-07-21T19:09:00.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.846+0000 7f4508c40700 1 -- 172.21.15.123:0/3787557398 wait complete. 2023-07-21T19:09:00.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.850+0000 7f4508c40700 1 Processor -- start 2023-07-21T19:09:00.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.850+0000 7f4508c40700 1 -- start start 2023-07-21T19:09:00.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f4504158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45040b1ba0 0x7f45041f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040b2010 0x7f45041f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45041f9b70 con 0x7f44ec004450 2023-07-21T19:09:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040cb960 con 0x7f45040b1ba0 2023-07-21T19:09:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040cad50 con 0x7f45040b2010 2023-07-21T19:09:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f4504158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f4504158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46228/0 (socket says 172.21.15.123:46228) 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 -- 172.21.15.123:0/4253537686 learned_addr learned my addr 172.21.15.123:0/4253537686 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4502ffd700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45040b1ba0 0x7f45041f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4503fff700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040b2010 0x7f45041f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 -- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040b2010 msgr2=0x7f45041f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040b2010 0x7f45041f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 -- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45040b1ba0 msgr2=0x7f45041f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:00.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45040b1ba0 0x7f45041f8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 -- 172.21.15.123:0/4253537686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040cb030 con 0x7f44ec004450 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f45037fe700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f4504158b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f44f40119b0 tx=0x7f44f4011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4011e50 con 0x7f44ec004450 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400f940 con 0x7f44ec004450 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400fcd0 con 0x7f44ec004450 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45040cb310 con 0x7f44ec004450 2023-07-21T19:09:00.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.854+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45040cbdf0 con 0x7f44ec004450 2023-07-21T19:09:00.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.858+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45040d1bd0 con 0x7f44ec004450 2023-07-21T19:09:00.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.858+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44f4014440 con 0x7f44ec004450 2023-07-21T19:09:00.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.858+0000 7f44ebfff700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f44f00662f0 0x7f44f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:00.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.858+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44f4084690 con 0x7f44ec004450 2023-07-21T19:09:00.874 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.858+0000 7f4502ffd700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f44f00662f0 0x7f44f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:00.875 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.862+0000 7f4502ffd700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f44f00662f0 0x7f44f00687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f45040a0410 tx=0x7f44f800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:00.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:00.866+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f44f40551f0 con 0x7f44ec004450 2023-07-21T19:09:01.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.038+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f450404e500 con 0x7f44ec004450 2023-07-21T19:09:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f44ebfff700 1 -- 172.21.15.123:0/4253537686 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44f4054d80 con 0x7f44ec004450 2023-07-21T19:09:01.056 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:09:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f44f00662f0 msgr2=0x7f44f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f44f00662f0 0x7f44f00687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f45040a0410 tx=0x7f44f800a000 comp rx=0 tx=0).stop 2023-07-21T19:09:01.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 msgr2=0x7f4504158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f4504158b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f44f40119b0 tx=0x7f44f4011cc0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 shutdown_connections 2023-07-21T19:09:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f44f00662f0 0x7f44f00687a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45040b1ba0 0x7f45041f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45040b2010 0x7f45041f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 --2- 172.21.15.123:0/4253537686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44ec004450 0x7f4504158b90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 >> 172.21.15.123:0/4253537686 conn(0x7f4504060c40 msgr2=0x7f45040b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.042+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 shutdown_connections 2023-07-21T19:09:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.046+0000 7f4508c40700 1 -- 172.21.15.123:0/4253537686 wait complete. 2023-07-21T19:09:01.080 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:09:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.242+0000 7faf366b7700 1 Processor -- start 2023-07-21T19:09:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.242+0000 7faf366b7700 1 -- start start 2023-07-21T19:09:01.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf366b7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300b0ee0 0x7faf300ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf366b7700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf300cd090 0x7faf300d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf366b7700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300cd4e0 con 0x7faf300d0610 2023-07-21T19:09:01.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf366b7700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300d1a60 con 0x7faf300cd090 2023-07-21T19:09:01.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf366b7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300d1ef0 con 0x7faf300b0ee0 2023-07-21T19:09:01.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf34eb4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf300cd090 0x7faf300d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf356b5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300b0ee0 0x7faf300ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf34eb4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf300cd090 0x7faf300d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:54190/0 (socket says 172.21.15.123:54190) 2023-07-21T19:09:01.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf35eb6700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7faf300d0610 0x7faf3015f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:56838/0 (socket says 172.21.15.123:56838) 2023-07-21T19:09:01.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf34eb4700 1 -- 172.21.15.123:0/2404031822 learned_addr learned my addr 172.21.15.123:0/2404031822 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf27fff700 1 -- 172.21.15.123:0/2404031822 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485696475 0 0) 0x7faf28001490 con 0x7faf300d0610 2023-07-21T19:09:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf356b5700 1 -- 172.21.15.123:0/2404031822 >> v2:172.21.15.145:3300/0 conn(0x7faf300cd090 msgr2=0x7faf300d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf356b5700 1 --2- 172.21.15.123:0/2404031822 >> v2:172.21.15.145:3300/0 conn(0x7faf300cd090 0x7faf300d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf356b5700 1 -- 172.21.15.123:0/2404031822 >> v1:172.21.15.145:6789/0 conn(0x7faf300d0610 legacy=0x7faf3015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf356b5700 1 -- 172.21.15.123:0/2404031822 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300d0e50 con 0x7faf300b0ee0 2023-07-21T19:09:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf356b5700 1 --2- 172.21.15.123:0/2404031822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300b0ee0 0x7faf300ccb50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009880 tx=0x7faf2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b45126bda6546e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf27fff700 1 -- 172.21.15.123:0/2404031822 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011830 con 0x7faf300b0ee0 2023-07-21T19:09:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf27fff700 1 -- 172.21.15.123:0/2404031822 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c011990 con 0x7faf300b0ee0 2023-07-21T19:09:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.246+0000 7faf27fff700 1 -- 172.21.15.123:0/2404031822 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011d20 con 0x7faf300b0ee0 2023-07-21T19:09:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 -- 172.21.15.123:0/2404031822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300b0ee0 msgr2=0x7faf300ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 --2- 172.21.15.123:0/2404031822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300b0ee0 0x7faf300ccb50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009880 tx=0x7faf2c009b90 comp rx=0 tx=0).stop 2023-07-21T19:09:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 -- 172.21.15.123:0/2404031822 shutdown_connections 2023-07-21T19:09:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 --2- 172.21.15.123:0/2404031822 >> v2:172.21.15.145:3300/0 conn(0x7faf300cd090 0x7faf300d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 --2- 172.21.15.123:0/2404031822 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300b0ee0 0x7faf300ccb50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 -- 172.21.15.123:0/2404031822 >> 172.21.15.123:0/2404031822 conn(0x7faf30060c40 msgr2=0x7faf3009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 -- 172.21.15.123:0/2404031822 shutdown_connections 2023-07-21T19:09:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.250+0000 7faf366b7700 1 -- 172.21.15.123:0/2404031822 wait complete. 2023-07-21T19:09:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 Processor -- start 2023-07-21T19:09:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 -- start start 2023-07-21T19:09:01.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 0x7faf301f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf300cd090 0x7faf300af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300d0610 0x7faf300af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf301f5620 con 0x7faf300b0ee0 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300caef0 con 0x7faf300cd090 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf366b7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300cb120 con 0x7faf300d0610 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 0x7faf301f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 0x7faf301f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46232/0 (socket says 172.21.15.123:46232) 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 -- 172.21.15.123:0/1827397473 learned_addr learned my addr 172.21.15.123:0/1827397473 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf34eb4700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf300cd090 0x7faf300af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf35eb6700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300d0610 0x7faf300af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 -- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300d0610 msgr2=0x7faf300af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300d0610 0x7faf300af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 -- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf300cd090 msgr2=0x7faf300af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf300cd090 0x7faf300af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 -- 172.21.15.123:0/1827397473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094b0 con 0x7faf300b0ee0 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.254+0000 7faf356b5700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 0x7faf301f50e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009bd0 tx=0x7faf2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.258+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0036c0 con 0x7faf300b0ee0 2023-07-21T19:09:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.258+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c01e070 con 0x7faf300b0ee0 2023-07-21T19:09:01.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.258+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf300cb400 con 0x7faf300b0ee0 2023-07-21T19:09:01.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.258+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c003a20 con 0x7faf300b0ee0 2023-07-21T19:09:01.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.258+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf300cb9c0 con 0x7faf300b0ee0 2023-07-21T19:09:01.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.258+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3004e500 con 0x7faf300b0ee0 2023-07-21T19:09:01.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.262+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf2c003b80 con 0x7faf300b0ee0 2023-07-21T19:09:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.262+0000 7faf25ffb700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf14066320 0x7faf140687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.262+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf2c084f50 con 0x7faf300b0ee0 2023-07-21T19:09:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.262+0000 7faf34eb4700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf14066320 0x7faf140687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.262+0000 7faf34eb4700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf14066320 0x7faf140687d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf301f8bc0 tx=0x7faf20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.266+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faf2c052130 con 0x7faf300b0ee0 2023-07-21T19:09:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faf300b18d0 con 0x7faf300b0ee0 2023-07-21T19:09:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf25ffb700 1 -- 172.21.15.123:0/1827397473 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7faf2c0150a0 con 0x7faf300b0ee0 2023-07-21T19:09:01.456 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:01.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf14066320 msgr2=0x7faf140687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf14066320 0x7faf140687d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf301f8bc0 tx=0x7faf20008040 comp rx=0 tx=0).stop 2023-07-21T19:09:01.458 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 msgr2=0x7faf301f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 0x7faf301f50e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009bd0 tx=0x7faf2c004770 comp rx=0 tx=0).stop 2023-07-21T19:09:01.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 shutdown_connections 2023-07-21T19:09:01.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7faf14066320 0x7faf140687d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf300cd090 0x7faf300af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf300d0610 0x7faf300af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.442+0000 7faf366b7700 1 --2- 172.21.15.123:0/1827397473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf300b0ee0 0x7faf301f50e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.446+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 >> 172.21.15.123:0/1827397473 conn(0x7faf30060c40 msgr2=0x7faf3006fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.446+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 shutdown_connections 2023-07-21T19:09:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.446+0000 7faf366b7700 1 -- 172.21.15.123:0/1827397473 wait complete. 2023-07-21T19:09:01.480 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:09:01.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.642+0000 7fa3327cb700 1 Processor -- start 2023-07-21T19:09:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.642+0000 7fa3327cb700 1 -- start start 2023-07-21T19:09:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa3327cb700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa32c15c070 0x7fa32c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa3327cb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c0cd530 con 0x7fa32c0ad8b0 2023-07-21T19:09:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa3327cb700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c15c440 con 0x7fa32c0b0440 2023-07-21T19:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa3327cb700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0cc1b0 con 0x7fa32c15c070 2023-07-21T19:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa323fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa32c0ad8b0 0x7fa32c0afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58824/0 (socket says 172.21.15.123:58824) 2023-07-21T19:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa323fff700 1 -- 172.21.15.123:0/4127986890 learned_addr learned my addr 172.21.15.123:0/4127986890 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32bfff700 1 --2- 172.21.15.123:0/4127986890 >> v2:172.21.15.145:3300/0 conn(0x7fa32c15c070 0x7fa32c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32b7fe700 1 -- 172.21.15.123:0/4127986890 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487714924 0 0) 0x7fa32c0cd530 con 0x7fa32c0ad8b0 2023-07-21T19:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32b7fe700 1 -- 172.21.15.123:0/4127986890 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3180035d0 con 0x7fa32c0ad8b0 2023-07-21T19:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32bfff700 1 -- 172.21.15.123:0/4127986890 >> v1:172.21.15.145:6789/0 conn(0x7fa32c0b0440 legacy=0x7fa32c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32bfff700 1 -- 172.21.15.123:0/4127986890 >> v1:172.21.15.123:6789/0 conn(0x7fa32c0ad8b0 legacy=0x7fa32c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32b7fe700 1 -- 172.21.15.123:0/4127986890 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816384691 0 0) 0x7fa32c15c440 con 0x7fa32c0b0440 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32bfff700 1 -- 172.21.15.123:0/4127986890 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0cc490 con 0x7fa32c15c070 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32bfff700 1 --2- 172.21.15.123:0/4127986890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c15c070 0x7fa32c0ad370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009850 tx=0x7fa31c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe3300bd944669b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32b7fe700 1 -- 172.21.15.123:0/4127986890 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c004230 con 0x7fa32c15c070 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32b7fe700 1 -- 172.21.15.123:0/4127986890 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c004390 con 0x7fa32c15c070 2023-07-21T19:09:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.646+0000 7fa32b7fe700 1 -- 172.21.15.123:0/4127986890 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0036c0 con 0x7fa32c15c070 2023-07-21T19:09:01.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 -- 172.21.15.123:0/4127986890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c15c070 msgr2=0x7fa32c0ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 --2- 172.21.15.123:0/4127986890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c15c070 0x7fa32c0ad370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009850 tx=0x7fa31c009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:01.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 -- 172.21.15.123:0/4127986890 shutdown_connections 2023-07-21T19:09:01.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 --2- 172.21.15.123:0/4127986890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c15c070 0x7fa32c0ad370 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 -- 172.21.15.123:0/4127986890 >> 172.21.15.123:0/4127986890 conn(0x7fa32c0cad30 msgr2=0x7fa32c0cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:01.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 -- 172.21.15.123:0/4127986890 shutdown_connections 2023-07-21T19:09:01.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 -- 172.21.15.123:0/4127986890 wait complete. 2023-07-21T19:09:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 Processor -- start 2023-07-21T19:09:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.650+0000 7fa3327cb700 1 -- start start 2023-07-21T19:09:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa32c0ad8b0 0x7fa32c0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c0b0440 0x7fa32c14f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 0x7fa32c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c4d20 con 0x7fa32c15c070 2023-07-21T19:09:01.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c4a40 con 0x7fa32c0b0440 2023-07-21T19:09:01.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0b2990 con 0x7fa32c0ad8b0 2023-07-21T19:09:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 0x7fa32c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 0x7fa32c1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46236/0 (socket says 172.21.15.123:46236) 2023-07-21T19:09:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 -- 172.21.15.123:0/27706620 learned_addr learned my addr 172.21.15.123:0/27706620 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa323fff700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c0b0440 0x7fa32c14f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa32bfff700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa32c0ad8b0 0x7fa32c0c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 -- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa32c0ad8b0 msgr2=0x7fa32c0c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa32c0ad8b0 0x7fa32c0c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 -- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c0b0440 msgr2=0x7fa32c14f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c0b0440 0x7fa32c14f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 -- 172.21.15.123:0/27706620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0094b0 con 0x7fa32c15c070 2023-07-21T19:09:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa330d68700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 0x7fa32c1584c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa32400cbf0 tx=0x7fa32400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324003e50 con 0x7fa32c15c070 2023-07-21T19:09:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32400a810 con 0x7fa32c15c070 2023-07-21T19:09:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c0b2c70 con 0x7fa32c15c070 2023-07-21T19:09:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400abc0 con 0x7fa32c15c070 2023-07-21T19:09:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c158a00 con 0x7fa32c15c070 2023-07-21T19:09:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.654+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c0b3190 con 0x7fa32c15c070 2023-07-21T19:09:01.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.658+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa32400ad20 con 0x7fa32c15c070 2023-07-21T19:09:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.658+0000 7fa3297fa700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa30c0662f0 0x7fa30c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.658+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa3240841f0 con 0x7fa32c15c070 2023-07-21T19:09:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.658+0000 7fa32bfff700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa30c0662f0 0x7fa30c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.662+0000 7fa32bfff700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa30c0662f0 0x7fa30c0687a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009850 tx=0x7fa31c013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:01.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.662+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa32c0b3190 con 0x7fa32c15c070 2023-07-21T19:09:01.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.846+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa32c0b3190 con 0x7fa32c15c070 2023-07-21T19:09:01.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.850+0000 7fa3297fa700 1 -- 172.21.15.123:0/27706620 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa32c0b3190 con 0x7fa32c15c070 2023-07-21T19:09:01.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa30c0662f0 msgr2=0x7fa30c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa30c0662f0 0x7fa30c0687a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009850 tx=0x7fa31c013040 comp rx=0 tx=0).stop 2023-07-21T19:09:01.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 msgr2=0x7fa32c1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:01.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 0x7fa32c1584c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa32400cbf0 tx=0x7fa32400a060 comp rx=0 tx=0).stop 2023-07-21T19:09:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 shutdown_connections 2023-07-21T19:09:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa30c0662f0 0x7fa30c0687a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa32c0b0440 0x7fa32c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa32c15c070 0x7fa32c1584c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 --2- 172.21.15.123:0/27706620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa32c0ad8b0 0x7fa32c0c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:01.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 >> 172.21.15.123:0/27706620 conn(0x7fa32c0cad30 msgr2=0x7fa32c0abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:01.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 shutdown_connections 2023-07-21T19:09:01.871 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:01.854+0000 7fa3327cb700 1 -- 172.21.15.123:0/27706620 wait complete. 2023-07-21T19:09:01.871 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:09:01.889 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:09:01.889 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:09:01.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:02.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 Processor -- start 2023-07-21T19:09:02.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 -- start start 2023-07-21T19:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53e8159f20 0x7f53e80caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e80caf70 0x7f53e815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80b0ef0 con 0x7f53e80c9d90 2023-07-21T19:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80ce9c0 con 0x7f53e8159f20 2023-07-21T19:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.110+0000 7f53ed04f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80cee50 con 0x7f53e80caf70 2023-07-21T19:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53e7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53e80c9d90 0x7f53e80ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58832/0 (socket says 172.21.15.123:58832) 2023-07-21T19:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53e7fff700 1 -- 172.21.15.123:0/881667656 learned_addr learned my addr 172.21.15.123:0/881667656 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53df7fe700 1 --2- 172.21.15.123:0/881667656 >> v2:172.21.15.123:3300/0 conn(0x7f53e8159f20 0x7f53e80caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ec84e700 1 --2- 172.21.15.123:0/881667656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e80caf70 0x7f53e815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53df7fe700 1 -- 172.21.15.123:0/881667656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e80caf70 msgr2=0x7f53e815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53df7fe700 1 --2- 172.21.15.123:0/881667656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e80caf70 0x7f53e815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53df7fe700 1 -- 172.21.15.123:0/881667656 >> v1:172.21.15.123:6789/0 conn(0x7f53e80c9d90 legacy=0x7f53e80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53df7fe700 1 -- 172.21.15.123:0/881667656 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80cb4f0 con 0x7f53e8159f20 2023-07-21T19:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53e77fe700 1 -- 172.21.15.123:0/881667656 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988125017 0 0) 0x7f53e80b0ef0 con 0x7f53e80c9d90 2023-07-21T19:09:02.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53df7fe700 1 --2- 172.21.15.123:0/881667656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8159f20 0x7f53e80caa30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009850 tx=0x7f53d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5043e39ff4c176 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53e77fe700 1 -- 172.21.15.123:0/881667656 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011830 con 0x7f53e8159f20 2023-07-21T19:09:02.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53e77fe700 1 -- 172.21.15.123:0/881667656 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0011990 con 0x7f53e8159f20 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53e77fe700 1 -- 172.21.15.123:0/881667656 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011d40 con 0x7f53e8159f20 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 -- 172.21.15.123:0/881667656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8159f20 msgr2=0x7f53e80caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 --2- 172.21.15.123:0/881667656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8159f20 0x7f53e80caa30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009850 tx=0x7f53d0009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 -- 172.21.15.123:0/881667656 shutdown_connections 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 --2- 172.21.15.123:0/881667656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e80caf70 0x7f53e815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 --2- 172.21.15.123:0/881667656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8159f20 0x7f53e80caa30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 -- 172.21.15.123:0/881667656 >> 172.21.15.123:0/881667656 conn(0x7f53e806e960 msgr2=0x7f53e806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:02.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 -- 172.21.15.123:0/881667656 shutdown_connections 2023-07-21T19:09:02.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.114+0000 7f53ed04f700 1 -- 172.21.15.123:0/881667656 wait complete. 2023-07-21T19:09:02.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 Processor -- start 2023-07-21T19:09:02.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 -- start start 2023-07-21T19:09:02.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53e80c9d90 0x7f53e81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 0x7f53e80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e8159f20 0x7f53e80af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80c2f60 con 0x7f53e80caf70 2023-07-21T19:09:02.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8155fb0 con 0x7f53e80c9d90 2023-07-21T19:09:02.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ed04f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80c4710 con 0x7f53e8159f20 2023-07-21T19:09:02.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 0x7f53e80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 0x7f53e80aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46258/0 (socket says 172.21.15.123:46258) 2023-07-21T19:09:02.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 -- 172.21.15.123:0/3703907858 learned_addr learned my addr 172.21.15.123:0/3703907858 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:02.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53e7fff700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53e80c9d90 0x7f53e81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53ec84e700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e8159f20 0x7f53e80af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 -- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e8159f20 msgr2=0x7f53e80af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e8159f20 0x7f53e80af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 -- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53e80c9d90 msgr2=0x7f53e81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53e80c9d90 0x7f53e81555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.118+0000 7f53df7fe700 1 -- 172.21.15.123:0/3703907858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00094b0 con 0x7f53e80caf70 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53ec84e700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e8159f20 0x7f53e80af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53df7fe700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 0x7f53e80aece0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d001aac0 con 0x7f53e80caf70 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d001f070 con 0x7f53e80caf70 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d001ae60 con 0x7f53e80caf70 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e80c49f0 con 0x7f53e80caf70 2023-07-21T19:09:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e8156530 con 0x7f53e80caf70 2023-07-21T19:09:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.122+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e8156720 con 0x7f53e80caf70 2023-07-21T19:09:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.126+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53d001b430 con 0x7f53e80caf70 2023-07-21T19:09:02.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.126+0000 7f53e57fa700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53c80662f0 0x7f53c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.126+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f53d0085210 con 0x7f53e80caf70 2023-07-21T19:09:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.126+0000 7f53e7fff700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53c80662f0 0x7f53c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.126+0000 7f53e7fff700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53c80662f0 0x7f53c80687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53d80012e0 tx=0x7f53d80018c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.134+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f53d0052350 con 0x7f53e80caf70 2023-07-21T19:09:02.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.310+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53e804e500 con 0x7f53e80caf70 2023-07-21T19:09:02.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.310+0000 7f53e57fa700 1 -- 172.21.15.123:0/3703907858 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f53d0021090 con 0x7f53e80caf70 2023-07-21T19:09:02.328 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:02.328 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53c80662f0 msgr2=0x7f53c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53c80662f0 0x7f53c80687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53d80012e0 tx=0x7f53d80018c0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 msgr2=0x7f53e80aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 0x7f53e80aece0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0004770 comp rx=0 tx=0).stop 2023-07-21T19:09:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 shutdown_connections 2023-07-21T19:09:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f53c80662f0 0x7f53c80687a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53e8159f20 0x7f53e80af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80caf70 0x7f53e80aece0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 --2- 172.21.15.123:0/3703907858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53e80c9d90 0x7f53e81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 >> 172.21.15.123:0/3703907858 conn(0x7f53e806e960 msgr2=0x7f53e80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 shutdown_connections 2023-07-21T19:09:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.314+0000 7f53ed04f700 1 -- 172.21.15.123:0/3703907858 wait complete. 2023-07-21T19:09:02.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:09:02.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:09:02.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.522+0000 7f6eb4e93700 1 Processor -- start 2023-07-21T19:09:02.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.522+0000 7f6eb4e93700 1 -- start start 2023-07-21T19:09:02.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eb4e93700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 0x7f6eb006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eb4e93700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 0x7f6eb0071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eb4e93700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb00cbdc0 con 0x7f6eb0158360 2023-07-21T19:09:02.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eb4e93700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb00cc0a0 con 0x7f6eb00705e0 2023-07-21T19:09:02.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eb4e93700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb00cc380 con 0x7f6eb00cb460 2023-07-21T19:09:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaf7fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 0x7f6eb006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 0x7f6eb0071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 0x7f6eb0071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46354/0 (socket says 172.21.15.123:46354) 2023-07-21T19:09:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaf7fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 0x7f6eb006bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:51990/0 (socket says 172.21.15.123:51990) 2023-07-21T19:09:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 -- 172.21.15.123:0/3000070467 learned_addr learned my addr 172.21.15.123:0/3000070467 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaeffd700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f6eb0158360 0x7f6eb00709b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:45250/0 (socket says 172.21.15.123:45250) 2023-07-21T19:09:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 -- 172.21.15.123:0/3000070467 >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 msgr2=0x7f6eb006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 --2- 172.21.15.123:0/3000070467 >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 0x7f6eb006bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 -- 172.21.15.123:0/3000070467 >> v1:172.21.15.145:6789/0 conn(0x7f6eb0158360 legacy=0x7f6eb00709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 -- 172.21.15.123:0/3000070467 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00cc660 con 0x7f6eb00cb460 2023-07-21T19:09:02.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaf7fe700 1 --2- 172.21.15.123:0/3000070467 >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 0x7f6eb006bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eaffff700 1 --2- 172.21.15.123:0/3000070467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 0x7f6eb0071320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800d150 tx=0x7f6ea800d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63be1b191cd34ec8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eae7fc700 1 -- 172.21.15.123:0/3000070467 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8010070 con 0x7f6eb00cb460 2023-07-21T19:09:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eae7fc700 1 -- 172.21.15.123:0/3000070467 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea800db00 con 0x7f6eb00cb460 2023-07-21T19:09:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.526+0000 7f6eae7fc700 1 -- 172.21.15.123:0/3000070467 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8016400 con 0x7f6eb00cb460 2023-07-21T19:09:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 -- 172.21.15.123:0/3000070467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 msgr2=0x7f6eb0071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/3000070467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 0x7f6eb0071320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800d150 tx=0x7f6ea800d460 comp rx=0 tx=0).stop 2023-07-21T19:09:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 -- 172.21.15.123:0/3000070467 shutdown_connections 2023-07-21T19:09:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/3000070467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00cb460 0x7f6eb0071320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/3000070467 >> v2:172.21.15.145:3300/0 conn(0x7f6eb00705e0 0x7f6eb006bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 -- 172.21.15.123:0/3000070467 >> 172.21.15.123:0/3000070467 conn(0x7f6eb00afc60 msgr2=0x7f6eb00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 -- 172.21.15.123:0/3000070467 shutdown_connections 2023-07-21T19:09:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.530+0000 7f6eb4e93700 1 -- 172.21.15.123:0/3000070467 wait complete. 2023-07-21T19:09:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 Processor -- start 2023-07-21T19:09:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 -- start start 2023-07-21T19:09:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00705e0 0x7f6eb0146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eb00cb460 0x7f6eb014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 0x7f6eb0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01512e0 con 0x7f6eb0158360 2023-07-21T19:09:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb0150660 con 0x7f6eb00cb460 2023-07-21T19:09:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eb4e93700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb0150940 con 0x7f6eb00705e0 2023-07-21T19:09:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eaffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 0x7f6eb0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eaffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 0x7f6eb0156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40404/0 (socket says 172.21.15.123:40404) 2023-07-21T19:09:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eaffff700 1 -- 172.21.15.123:0/2677620680 learned_addr learned my addr 172.21.15.123:0/2677620680 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eaeffd700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eb00cb460 0x7f6eb014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.534+0000 7f6eaf7fe700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00705e0 0x7f6eb0146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eaffff700 1 -- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00705e0 msgr2=0x7f6eb0146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eaffff700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00705e0 0x7f6eb0146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eaffff700 1 -- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eb00cb460 msgr2=0x7f6eb014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eaffff700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eb00cb460 0x7f6eb014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eaffff700 1 -- 172.21.15.123:0/2677620680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00094b0 con 0x7f6eb0158360 2023-07-21T19:09:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eaffff700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 0x7f6eb0156b60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6eb015bbe0 tx=0x7f6ea8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80041c0 con 0x7f6eb0158360 2023-07-21T19:09:02.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8004360 con 0x7f6eb0158360 2023-07-21T19:09:02.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea800bd40 con 0x7f6eb0158360 2023-07-21T19:09:02.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8004710 con 0x7f6eb0158360 2023-07-21T19:09:02.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb0150f00 con 0x7f6eb0158360 2023-07-21T19:09:02.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.538+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0151420 con 0x7f6eb0158360 2023-07-21T19:09:02.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.542+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ea8029460 con 0x7f6eb0158360 2023-07-21T19:09:02.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.542+0000 7f6e97fff700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6e9c0662f0 0x7f6e9c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.542+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6ea8085760 con 0x7f6eb0158360 2023-07-21T19:09:02.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.542+0000 7f6eaf7fe700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6e9c0662f0 0x7f6e9c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.542+0000 7f6eaf7fe700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6e9c0662f0 0x7f6e9c0687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009d80 tx=0x7f6ea0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.546+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6eb0151420 con 0x7f6eb0158360 2023-07-21T19:09:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.726+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6eb0151420 con 0x7f6eb0158360 2023-07-21T19:09:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.726+0000 7f6e97fff700 1 -- 172.21.15.123:0/2677620680 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6eb0151420 con 0x7f6eb0158360 2023-07-21T19:09:02.742 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:09:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6e9c0662f0 msgr2=0x7f6e9c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6e9c0662f0 0x7f6e9c0687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009d80 tx=0x7f6ea0009240 comp rx=0 tx=0).stop 2023-07-21T19:09:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 msgr2=0x7f6eb0156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 0x7f6eb0156b60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6eb015bbe0 tx=0x7f6ea8004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 shutdown_connections 2023-07-21T19:09:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6e9c0662f0 0x7f6e9c0687a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eb00cb460 0x7f6eb014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6eb0158360 0x7f6eb0156b60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 --2- 172.21.15.123:0/2677620680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6eb00705e0 0x7f6eb0146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 >> 172.21.15.123:0/2677620680 conn(0x7f6eb00afc60 msgr2=0x7f6eb006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 shutdown_connections 2023-07-21T19:09:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.730+0000 7f6eb4e93700 1 -- 172.21.15.123:0/2677620680 wait complete. 2023-07-21T19:09:02.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:09:02.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.926+0000 7f80e62d8700 1 Processor -- start 2023-07-21T19:09:02.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.926+0000 7f80e62d8700 1 -- start start 2023-07-21T19:09:02.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e62d8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e00d07e0 0x7f80e01669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e62d8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e00d1a60 con 0x7f80e00cd260 2023-07-21T19:09:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e62d8700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e00d1ef0 con 0x7f80e00b0ee0 2023-07-21T19:09:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e62d8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e00d0c60 con 0x7f80e00d07e0 2023-07-21T19:09:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e00d07e0 0x7f80e01669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e00d07e0 0x7f80e01669b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40406/0 (socket says 172.21.15.123:40406) 2023-07-21T19:09:02.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 -- 172.21.15.123:0/323653279 learned_addr learned my addr 172.21.15.123:0/323653279 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:02.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 -- 172.21.15.123:0/323653279 >> v1:172.21.15.145:6789/0 conn(0x7f80e00b0ee0 legacy=0x7f80e00ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 -- 172.21.15.123:0/323653279 >> v1:172.21.15.123:6789/0 conn(0x7f80e00cd260 legacy=0x7f80e00d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 -- 172.21.15.123:0/323653279 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00d0e50 con 0x7f80e00d07e0 2023-07-21T19:09:02.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80e5ad7700 1 --2- 172.21.15.123:0/323653279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e01669b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61ccee44235317c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80d7fff700 1 -- 172.21.15.123:0/323653279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800e070 con 0x7f80e00d07e0 2023-07-21T19:09:02.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80d7fff700 1 -- 172.21.15.123:0/323653279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d800b9c0 con 0x7f80e00d07e0 2023-07-21T19:09:02.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.930+0000 7f80d7fff700 1 -- 172.21.15.123:0/323653279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800bd70 con 0x7f80e00d07e0 2023-07-21T19:09:02.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 -- 172.21.15.123:0/323653279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 msgr2=0x7f80e01669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 --2- 172.21.15.123:0/323653279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e01669b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:02.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 -- 172.21.15.123:0/323653279 shutdown_connections 2023-07-21T19:09:02.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 --2- 172.21.15.123:0/323653279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e01669b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 -- 172.21.15.123:0/323653279 >> 172.21.15.123:0/323653279 conn(0x7f80e0060c40 msgr2=0x7f80e009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:02.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 -- 172.21.15.123:0/323653279 shutdown_connections 2023-07-21T19:09:02.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 -- 172.21.15.123:0/323653279 wait complete. 2023-07-21T19:09:02.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 Processor -- start 2023-07-21T19:09:02.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.934+0000 7f80e62d8700 1 -- start start 2023-07-21T19:09:02.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80e00b0ee0 0x7f80e00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80e00cd260 0x7f80e00c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e00c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00c7fd0 con 0x7f80e00d07e0 2023-07-21T19:09:02.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e009c400 con 0x7f80e00cd260 2023-07-21T19:09:02.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00c73c0 con 0x7f80e00b0ee0 2023-07-21T19:09:02.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e00c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e00c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40422/0 (socket says 172.21.15.123:40422) 2023-07-21T19:09:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 -- 172.21.15.123:0/1914391511 learned_addr learned my addr 172.21.15.123:0/1914391511 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e4ad5700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80e00cd260 0x7f80e00c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e52d6700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80e00b0ee0 0x7f80e00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 -- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80e00b0ee0 msgr2=0x7f80e00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80e00b0ee0 0x7f80e00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 -- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80e00cd260 msgr2=0x7f80e00c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80e00cd260 0x7f80e00c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 -- 172.21.15.123:0/1914391511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009b30 con 0x7f80e00d07e0 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e5ad7700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e00c6d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f80e008adc0 tx=0x7f80d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8004840 con 0x7f80e00d07e0 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80099b0 con 0x7f80e00d07e0 2023-07-21T19:09:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e00c76a0 con 0x7f80e00d07e0 2023-07-21T19:09:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.938+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d801c680 con 0x7f80e00d07e0 2023-07-21T19:09:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.942+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e00c7c60 con 0x7f80e00d07e0 2023-07-21T19:09:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.942+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e00c8180 con 0x7f80e00d07e0 2023-07-21T19:09:02.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.942+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80d801c7e0 con 0x7f80e00d07e0 2023-07-21T19:09:02.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.946+0000 7f80d5ffb700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80c40662f0 0x7f80c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:02.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.946+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f80d8085d10 con 0x7f80e00d07e0 2023-07-21T19:09:02.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.946+0000 7f80e52d6700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80c40662f0 0x7f80c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.946+0000 7f80e52d6700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80c40662f0 0x7f80c40687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80e01ef250 tx=0x7f80dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:02.950+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f80d8052ef0 con 0x7f80e00d07e0 2023-07-21T19:09:03.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.122+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80e004e500 con 0x7f80e00d07e0 2023-07-21T19:09:03.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.122+0000 7f80d5ffb700 1 -- 172.21.15.123:0/1914391511 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f80d8056510 con 0x7f80e00d07e0 2023-07-21T19:09:03.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:09:03.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80c40662f0 msgr2=0x7f80c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80c40662f0 0x7f80c40687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80e01ef250 tx=0x7f80dc009040 comp rx=0 tx=0).stop 2023-07-21T19:09:03.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 msgr2=0x7f80e00c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e00c6d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f80e008adc0 tx=0x7f80d8004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 shutdown_connections 2023-07-21T19:09:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f80c40662f0 0x7f80c40687a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80e00cd260 0x7f80e00c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e00d07e0 0x7f80e00c6d90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 --2- 172.21.15.123:0/1914391511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80e00b0ee0 0x7f80e00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 >> 172.21.15.123:0/1914391511 conn(0x7f80e0060c40 msgr2=0x7f80e009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:03.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 shutdown_connections 2023-07-21T19:09:03.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.130+0000 7f80e62d8700 1 -- 172.21.15.123:0/1914391511 wait complete. 2023-07-21T19:09:03.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:09:03.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.330+0000 7f4fa259e700 1 Processor -- start 2023-07-21T19:09:03.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.330+0000 7f4fa259e700 1 -- start start 2023-07-21T19:09:03.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.330+0000 7f4fa259e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4f9c1603d0 0x7f4f9c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.330+0000 7f4fa259e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0cdfb0 con 0x7f4f9c160000 2023-07-21T19:09:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.330+0000 7f4fa259e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0cdcd0 con 0x7f4f9c0cd7f0 2023-07-21T19:09:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.330+0000 7f4fa259e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c070e40 con 0x7f4f9c1603d0 2023-07-21T19:09:03.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa159c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4f9c160000 0x7f4f9c0c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54760/0 (socket says 172.21.15.123:54760) 2023-07-21T19:09:03.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa159c700 1 -- 172.21.15.123:0/2992333917 learned_addr learned my addr 172.21.15.123:0/2992333917 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:03.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa0d9b700 1 --2- 172.21.15.123:0/2992333917 >> v2:172.21.15.145:3300/0 conn(0x7f4f9c1603d0 0x7f4f9c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156892826 0 0) 0x7f4f98001110 con 0x7f4f9c160000 2023-07-21T19:09:03.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f880035d0 con 0x7f4f9c160000 2023-07-21T19:09:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355054829 0 0) 0x7f4f9c0cdcd0 con 0x7f4f9c0cd7f0 2023-07-21T19:09:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f98001110 con 0x7f4f9c0cd7f0 2023-07-21T19:09:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426548169 0 0) 0x7f4f880035d0 con 0x7f4f9c160000 2023-07-21T19:09:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/2992333917 >> v1:172.21.15.145:6789/0 conn(0x7f4f9c0cd7f0 legacy=0x7f4f9c0c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/2992333917 >> v1:172.21.15.123:6789/0 conn(0x7f4f9c160000 legacy=0x7f4f9c0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/2992333917 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c070780 con 0x7f4f9c1603d0 2023-07-21T19:09:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4fa0d9b700 1 --2- 172.21.15.123:0/2992333917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c06dd10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009850 tx=0x7f4f8c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1745a5275e4138 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:03.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98001800 con 0x7f4f9c1603d0 2023-07-21T19:09:03.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c004030 con 0x7f4f9c1603d0 2023-07-21T19:09:03.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.334+0000 7f4f93fff700 1 -- 172.21.15.123:0/2992333917 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0043c0 con 0x7f4f9c1603d0 2023-07-21T19:09:03.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 -- 172.21.15.123:0/2992333917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 msgr2=0x7f4f9c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 --2- 172.21.15.123:0/2992333917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c06dd10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009850 tx=0x7f4f8c009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:03.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 -- 172.21.15.123:0/2992333917 shutdown_connections 2023-07-21T19:09:03.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 --2- 172.21.15.123:0/2992333917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c06dd10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 -- 172.21.15.123:0/2992333917 >> 172.21.15.123:0/2992333917 conn(0x7f4f9c0afc60 msgr2=0x7f4f9c0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 -- 172.21.15.123:0/2992333917 shutdown_connections 2023-07-21T19:09:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 -- 172.21.15.123:0/2992333917 wait complete. 2023-07-21T19:09:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 Processor -- start 2023-07-21T19:09:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.338+0000 7f4fa259e700 1 -- start start 2023-07-21T19:09:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f9c0cd7f0 0x7f4f9c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 0x7f4f9c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1514a0 con 0x7f4f9c160000 2023-07-21T19:09:03.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c153700 con 0x7f4f9c1603d0 2023-07-21T19:09:03.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1541b0 con 0x7f4f9c0cd7f0 2023-07-21T19:09:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 0x7f4f9c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 0x7f4f9c150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40436/0 (socket says 172.21.15.123:40436) 2023-07-21T19:09:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/339844177 learned_addr learned my addr 172.21.15.123:0/339844177 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa159c700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f9c0cd7f0 0x7f4f9c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa1d9d700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f9c0cd7f0 msgr2=0x7f4f9c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f9c0cd7f0 0x7f4f9c153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 msgr2=0x7f4f9c0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c0aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 -- 172.21.15.123:0/339844177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0094b0 con 0x7f4f9c160000 2023-07-21T19:09:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa159c700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f9c0cd7f0 0x7f4f9c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa0d9b700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 0x7f4f9c150f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c06b5d0 tx=0x7f4f8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c003d90 con 0x7f4f9c160000 2023-07-21T19:09:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c01f070 con 0x7f4f9c160000 2023-07-21T19:09:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c0c52c0 con 0x7f4f9c160000 2023-07-21T19:09:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011870 con 0x7f4f9c160000 2023-07-21T19:09:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.342+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c0c5880 con 0x7f4f9c160000 2023-07-21T19:09:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.346+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c071240 con 0x7f4f9c160000 2023-07-21T19:09:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.346+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f8c021030 con 0x7f4f9c160000 2023-07-21T19:09:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.346+0000 7f4f91ffb700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4f800662f0 0x7f4f800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.350+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f8c0853b0 con 0x7f4f9c160000 2023-07-21T19:09:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.350+0000 7f4fa159c700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4f800662f0 0x7f4f800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.350+0000 7f4fa159c700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4f800662f0 0x7f4f800687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f98001eb0 tx=0x7f4f98001ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.354+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4f9c071240 con 0x7f4f9c160000 2023-07-21T19:09:03.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.534+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f9c071240 con 0x7f4f9c160000 2023-07-21T19:09:03.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.534+0000 7f4f91ffb700 1 -- 172.21.15.123:0/339844177 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f9c071240 con 0x7f4f9c160000 2023-07-21T19:09:03.549 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4f800662f0 msgr2=0x7f4f800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4f800662f0 0x7f4f800687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f98001eb0 tx=0x7f4f98001ca0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 msgr2=0x7f4f9c150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 0x7f4f9c150f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c06b5d0 tx=0x7f4f8c004770 comp rx=0 tx=0).stop 2023-07-21T19:09:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 shutdown_connections 2023-07-21T19:09:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4f800662f0 0x7f4f800687a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f9c1603d0 0x7f4f9c0aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9c160000 0x7f4f9c150f60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 --2- 172.21.15.123:0/339844177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f9c0cd7f0 0x7f4f9c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 >> 172.21.15.123:0/339844177 conn(0x7f4f9c0afc60 msgr2=0x7f4f9c0c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:03.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 shutdown_connections 2023-07-21T19:09:03.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.538+0000 7f4fa259e700 1 -- 172.21.15.123:0/339844177 wait complete. 2023-07-21T19:09:03.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:09:03.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbb658d700 1 Processor -- start 2023-07-21T19:09:03.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbb658d700 1 -- start start 2023-07-21T19:09:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbb658d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb015df10 0x7fcbb015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbb658d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb0070a30 con 0x7fcbb00afd80 2023-07-21T19:09:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbb658d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb00b0210 con 0x7fcbb00c8950 2023-07-21T19:09:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbb658d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb015e830 con 0x7fcbb015df10 2023-07-21T19:09:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaf7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcbb00afd80 0x7fcbb00711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54770/0 (socket says 172.21.15.123:54770) 2023-07-21T19:09:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaf7fe700 1 -- 172.21.15.123:0/3628908996 learned_addr learned my addr 172.21.15.123:0/3628908996 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaffff700 1 --2- 172.21.15.123:0/3628908996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb015df10 0x7fcbb015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaeffd700 1 -- 172.21.15.123:0/3628908996 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126483439 0 0) 0x7fcbb0070a30 con 0x7fcbb00afd80 2023-07-21T19:09:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaeffd700 1 -- 172.21.15.123:0/3628908996 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb980035d0 con 0x7fcbb00afd80 2023-07-21T19:09:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaffff700 1 -- 172.21.15.123:0/3628908996 >> v1:172.21.15.145:6789/0 conn(0x7fcbb00c8950 legacy=0x7fcbb006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaffff700 1 -- 172.21.15.123:0/3628908996 >> v1:172.21.15.123:6789/0 conn(0x7fcbb00afd80 legacy=0x7fcbb00711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.746+0000 7fcbaffff700 1 -- 172.21.15.123:0/3628908996 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00b04f0 con 0x7fcbb015df10 2023-07-21T19:09:03.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbaffff700 1 --2- 172.21.15.123:0/3628908996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb015df10 0x7fcbb015e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009880 tx=0x7fcba0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ffd0ca0bccf75 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbaeffd700 1 -- 172.21.15.123:0/3628908996 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0011830 con 0x7fcbb015df10 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbaeffd700 1 -- 172.21.15.123:0/3628908996 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0011990 con 0x7fcbb015df10 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbaeffd700 1 -- 172.21.15.123:0/3628908996 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0011d20 con 0x7fcbb015df10 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 -- 172.21.15.123:0/3628908996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb015df10 msgr2=0x7fcbb015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3628908996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb015df10 0x7fcbb015e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009880 tx=0x7fcba0009b90 comp rx=0 tx=0).stop 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 -- 172.21.15.123:0/3628908996 shutdown_connections 2023-07-21T19:09:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3628908996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb015df10 0x7fcbb015e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 -- 172.21.15.123:0/3628908996 >> 172.21.15.123:0/3628908996 conn(0x7fcbb00cad80 msgr2=0x7fcbb00cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 -- 172.21.15.123:0/3628908996 shutdown_connections 2023-07-21T19:09:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 -- 172.21.15.123:0/3628908996 wait complete. 2023-07-21T19:09:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 Processor -- start 2023-07-21T19:09:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.750+0000 7fcbb658d700 1 -- start start 2023-07-21T19:09:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 0x7fcbb01f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb00c8950 0x7fcbb00cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb00ab8f0 0x7fcbb015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb01f2510 con 0x7fcbb00afd80 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00abd60 con 0x7fcbb00c8950 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ac040 con 0x7fcbb00ab8f0 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 0x7fcbb01f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 0x7fcbb01f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40446/0 (socket says 172.21.15.123:40446) 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 -- 172.21.15.123:0/3876110742 learned_addr learned my addr 172.21.15.123:0/3876110742 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaf7fe700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb00c8950 0x7fcbb00cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb4b2a700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb00ab8f0 0x7fcbb015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 -- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb00ab8f0 msgr2=0x7fcbb015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb00ab8f0 0x7fcbb015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 -- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb00c8950 msgr2=0x7fcbb00cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb00c8950 0x7fcbb00cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 -- 172.21.15.123:0/3876110742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00094b0 con 0x7fcbb00afd80 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaf7fe700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb00c8950 0x7fcbb00cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbaffff700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 0x7fcbb01f1fd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcba0013040 tx=0x7fcba0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00038c0 con 0x7fcbb00afd80 2023-07-21T19:09:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0003a40 con 0x7fcbb00afd80 2023-07-21T19:09:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb00ac320 con 0x7fcbb00afd80 2023-07-21T19:09:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0003df0 con 0x7fcbb00afd80 2023-07-21T19:09:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.754+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb00ac8e0 con 0x7fcbb00afd80 2023-07-21T19:09:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.758+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb00acad0 con 0x7fcbb00afd80 2023-07-21T19:09:03.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.758+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcba001b400 con 0x7fcbb00afd80 2023-07-21T19:09:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.758+0000 7fcbacff9700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcb9c0662f0 0x7fcb9c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.758+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcba0085730 con 0x7fcbb00afd80 2023-07-21T19:09:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.758+0000 7fcbaf7fe700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcb9c0662f0 0x7fcb9c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.762+0000 7fcbaf7fe700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcb9c0662f0 0x7fcb9c0687a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00cf2e0 tx=0x7fcba4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.762+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcba0052870 con 0x7fcbb00afd80 2023-07-21T19:09:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.934+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbb004dcb0 con 0x7fcbb00afd80 2023-07-21T19:09:03.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.934+0000 7fcbacff9700 1 -- 172.21.15.123:0/3876110742 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcba0055e90 con 0x7fcbb00afd80 2023-07-21T19:09:03.949 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:09:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcb9c0662f0 msgr2=0x7fcb9c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcb9c0662f0 0x7fcb9c0687a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00cf2e0 tx=0x7fcba4009040 comp rx=0 tx=0).stop 2023-07-21T19:09:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 msgr2=0x7fcbb01f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:03.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 0x7fcbb01f1fd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcba0013040 tx=0x7fcba0004770 comp rx=0 tx=0).stop 2023-07-21T19:09:03.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 shutdown_connections 2023-07-21T19:09:03.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcb9c0662f0 0x7fcb9c0687a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb00c8950 0x7fcbb00cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcbb00ab8f0 0x7fcbb015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 --2- 172.21.15.123:0/3876110742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbb00afd80 0x7fcbb01f1fd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 >> 172.21.15.123:0/3876110742 conn(0x7fcbb00cad80 msgr2=0x7fcbb015b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 shutdown_connections 2023-07-21T19:09:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:03.938+0000 7fcbb658d700 1 -- 172.21.15.123:0/3876110742 wait complete. 2023-07-21T19:09:03.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:09:04.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.142+0000 7f29a2820700 1 Processor -- start 2023-07-21T19:09:04.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.142+0000 7f29a2820700 1 -- start start 2023-07-21T19:09:04.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c15df10 0x7f299c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f299c0afd80 0x7f299c0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f299c0716e0 0x7f299c0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c15e830 con 0x7f299c0716e0 2023-07-21T19:09:04.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c070a30 con 0x7f299c0afd80 2023-07-21T19:09:04.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0b0210 con 0x7f299c15df10 2023-07-21T19:09:04.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f299c0716e0 0x7f299c0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f299c0716e0 0x7f299c0c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40452/0 (socket says 172.21.15.123:40452) 2023-07-21T19:09:04.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 -- 172.21.15.123:0/1571029738 learned_addr learned my addr 172.21.15.123:0/1571029738 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:04.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f2993fff700 1 --2- 172.21.15.123:0/1571029738 >> v2:172.21.15.145:3300/0 conn(0x7f299c0afd80 0x7f299c0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f299bfff700 1 --2- 172.21.15.123:0/1571029738 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c15df10 0x7f299c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 -- 172.21.15.123:0/1571029738 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c15df10 msgr2=0x7f299c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 --2- 172.21.15.123:0/1571029738 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c15df10 0x7f299c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 -- 172.21.15.123:0/1571029738 >> v2:172.21.15.145:3300/0 conn(0x7f299c0afd80 msgr2=0x7f299c0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 --2- 172.21.15.123:0/1571029738 >> v2:172.21.15.145:3300/0 conn(0x7f299c0afd80 0x7f299c0711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 -- 172.21.15.123:0/1571029738 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0b04f0 con 0x7f299c0716e0 2023-07-21T19:09:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a0dbd700 1 --2- 172.21.15.123:0/1571029738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0716e0 0x7f299c0c8950 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f299c06b970 tx=0x7f299400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52721806b747e231 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f299b7fe700 1 -- 172.21.15.123:0/1571029738 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400e070 con 0x7f299c0716e0 2023-07-21T19:09:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f299b7fe700 1 -- 172.21.15.123:0/1571029738 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400b910 con 0x7f299c0716e0 2023-07-21T19:09:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f299b7fe700 1 -- 172.21.15.123:0/1571029738 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400bcc0 con 0x7f299c0716e0 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- 172.21.15.123:0/1571029738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0716e0 msgr2=0x7f299c0c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- 172.21.15.123:0/1571029738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0716e0 0x7f299c0c8950 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f299c06b970 tx=0x7f299400b330 comp rx=0 tx=0).stop 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- 172.21.15.123:0/1571029738 shutdown_connections 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- 172.21.15.123:0/1571029738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0716e0 0x7f299c0c8950 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- 172.21.15.123:0/1571029738 >> v2:172.21.15.145:3300/0 conn(0x7f299c0afd80 0x7f299c0711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 --2- 172.21.15.123:0/1571029738 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c15df10 0x7f299c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- 172.21.15.123:0/1571029738 >> 172.21.15.123:0/1571029738 conn(0x7f299c0cad80 msgr2=0x7f299c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- 172.21.15.123:0/1571029738 shutdown_connections 2023-07-21T19:09:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.146+0000 7f29a2820700 1 -- 172.21.15.123:0/1571029738 wait complete. 2023-07-21T19:09:04.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 Processor -- start 2023-07-21T19:09:04.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 -- start start 2023-07-21T19:09:04.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f299c0716e0 0x7f299c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 0x7f299c0b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c0b26c0 0x7f299c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0b2b30 con 0x7f299c0afd80 2023-07-21T19:09:04.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c157a90 con 0x7f299c0716e0 2023-07-21T19:09:04.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a2820700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c15cbe0 con 0x7f299c0b26c0 2023-07-21T19:09:04.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 0x7f299c0b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 0x7f299c0b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40460/0 (socket says 172.21.15.123:40460) 2023-07-21T19:09:04.167 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 -- 172.21.15.123:0/54522048 learned_addr learned my addr 172.21.15.123:0/54522048 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:04.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a0dbd700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c0b26c0 0x7f299c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 -- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c0b26c0 msgr2=0x7f299c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f299bfff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f299c0716e0 0x7f299c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c0b26c0 0x7f299c15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 -- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f299c0716e0 msgr2=0x7f299c157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f299c0716e0 0x7f299c157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f2993fff700 1 -- 172.21.15.123:0/54522048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994009b30 con 0x7f299c0afd80 2023-07-21T19:09:04.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.150+0000 7f29a0dbd700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c0b26c0 0x7f299c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f299bfff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f299c0716e0 0x7f299c157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f2993fff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 0x7f299c0b2180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f298400e940 tx=0x7f298400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29840096a0 con 0x7f299c0afd80 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400c850 con 0x7f299c0afd80 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c15cec0 con 0x7f299c0afd80 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400cbe0 con 0x7f299c0afd80 2023-07-21T19:09:04.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c0b3030 con 0x7f299c0afd80 2023-07-21T19:09:04.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c04dcb0 con 0x7f299c0afd80 2023-07-21T19:09:04.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.154+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f298400cd40 con 0x7f299c0afd80 2023-07-21T19:09:04.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.158+0000 7f29997fa700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f297c0662f0 0x7f297c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.158+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f29840841d0 con 0x7f299c0afd80 2023-07-21T19:09:04.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.158+0000 7f299bfff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f297c0662f0 0x7f297c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.158+0000 7f299bfff700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f297c0662f0 0x7f297c0687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f298c009840 tx=0x7f298c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:04.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.162+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2984054d10 con 0x7f299c0afd80 2023-07-21T19:09:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.330+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f299c06c0f0 con 0x7f299c0afd80 2023-07-21T19:09:04.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.334+0000 7f29997fa700 1 -- 172.21.15.123:0/54522048 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f29840548a0 con 0x7f299c0afd80 2023-07-21T19:09:04.348 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:04.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f297c0662f0 msgr2=0x7f297c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f297c0662f0 0x7f297c0687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f298c009840 tx=0x7f298c008040 comp rx=0 tx=0).stop 2023-07-21T19:09:04.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 msgr2=0x7f299c0b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 0x7f299c0b2180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f298400e940 tx=0x7f298400ed00 comp rx=0 tx=0).stop 2023-07-21T19:09:04.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 shutdown_connections 2023-07-21T19:09:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f297c0662f0 0x7f297c0687a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f299c0b26c0 0x7f299c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f299c0afd80 0x7f299c0b2180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 --2- 172.21.15.123:0/54522048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f299c0716e0 0x7f299c157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 >> 172.21.15.123:0/54522048 conn(0x7f299c0cad80 msgr2=0x7f299c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 shutdown_connections 2023-07-21T19:09:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.338+0000 7f29a2820700 1 -- 172.21.15.123:0/54522048 wait complete. 2023-07-21T19:09:04.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:09:04.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.530+0000 7f22bf59e700 1 Processor -- start 2023-07-21T19:09:04.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.530+0000 7f22bf59e700 1 -- start start 2023-07-21T19:09:04.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bf59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22c006dc20 0x7f22c00cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bf59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c00c9820 0x7f22c00ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bf59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c0159d60 con 0x7f22c0158fe0 2023-07-21T19:09:04.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bf59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c00cd250 con 0x7f22c006dc20 2023-07-21T19:09:04.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bf59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00c8a60 con 0x7f22c00c9820 2023-07-21T19:09:04.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22c006dc20 0x7f22c00cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22c006dc20 0x7f22c00cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40470/0 (socket says 172.21.15.123:40470) 2023-07-21T19:09:04.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 -- 172.21.15.123:0/3766948360 learned_addr learned my addr 172.21.15.123:0/3766948360 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:04.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bdd9b700 1 --2- 172.21.15.123:0/3766948360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c00c9820 0x7f22c00ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 -- 172.21.15.123:0/3766948360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c00c9820 msgr2=0x7f22c00ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:04.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 --2- 172.21.15.123:0/3766948360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c00c9820 0x7f22c00ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 -- 172.21.15.123:0/3766948360 >> v1:172.21.15.123:6789/0 conn(0x7f22c0158fe0 legacy=0x7f22c0159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:04.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 -- 172.21.15.123:0/3766948360 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c00c8d40 con 0x7f22c006dc20 2023-07-21T19:09:04.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22be59c700 1 --2- 172.21.15.123:0/3766948360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c006dc20 0x7f22c00cded0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009940 tx=0x7f22b0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66397f13f8a7a8e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bd59a700 1 -- 172.21.15.123:0/3766948360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0004230 con 0x7f22c006dc20 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bd59a700 1 -- 172.21.15.123:0/3766948360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0009e90 con 0x7f22c006dc20 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.534+0000 7f22bd59a700 1 -- 172.21.15.123:0/3766948360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00045b0 con 0x7f22c006dc20 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 -- 172.21.15.123:0/3766948360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c006dc20 msgr2=0x7f22c00cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 --2- 172.21.15.123:0/3766948360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c006dc20 0x7f22c00cded0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009940 tx=0x7f22b0009c50 comp rx=0 tx=0).stop 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 -- 172.21.15.123:0/3766948360 shutdown_connections 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 --2- 172.21.15.123:0/3766948360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c00c9820 0x7f22c00ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 --2- 172.21.15.123:0/3766948360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c006dc20 0x7f22c00cded0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 -- 172.21.15.123:0/3766948360 >> 172.21.15.123:0/3766948360 conn(0x7f22c006e960 msgr2=0x7f22c006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:04.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 -- 172.21.15.123:0/3766948360 shutdown_connections 2023-07-21T19:09:04.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 -- 172.21.15.123:0/3766948360 wait complete. 2023-07-21T19:09:04.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 Processor -- start 2023-07-21T19:09:04.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.538+0000 7f22bf59e700 1 -- start start 2023-07-21T19:09:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c006dc20 0x7f22c0142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22c00c9820 0x7f22c00c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 0x7f22c00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00b3280 con 0x7f22c0158fe0 2023-07-21T19:09:04.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00b2660 con 0x7f22c00c9820 2023-07-21T19:09:04.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00c7d90 con 0x7f22c006dc20 2023-07-21T19:09:04.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 0x7f22c00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 0x7f22c00c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40486/0 (socket says 172.21.15.123:40486) 2023-07-21T19:09:04.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 -- 172.21.15.123:0/2014755151 learned_addr learned my addr 172.21.15.123:0/2014755151 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22be59c700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c006dc20 0x7f22c0142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bdd9b700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22c00c9820 0x7f22c00c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 -- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c006dc20 msgr2=0x7f22c0142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c006dc20 0x7f22c0142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 -- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22c00c9820 msgr2=0x7f22c00c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22c00c9820 0x7f22c00c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 -- 172.21.15.123:0/2014755151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009570 con 0x7f22c0158fe0 2023-07-21T19:09:04.559 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bdd9b700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22c00c9820 0x7f22c00c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:04.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bed9d700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 0x7f22c00c4510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f22b800b9a0 tx=0x7f22b800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:04.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800c930 con 0x7f22c0158fe0 2023-07-21T19:09:04.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b800ca90 con 0x7f22c0158fe0 2023-07-21T19:09:04.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c00b28e0 con 0x7f22c0158fe0 2023-07-21T19:09:04.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800ce40 con 0x7f22c0158fe0 2023-07-21T19:09:04.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.542+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c00b2ea0 con 0x7f22c0158fe0 2023-07-21T19:09:04.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.546+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c00b33c0 con 0x7f22c0158fe0 2023-07-21T19:09:04.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.546+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22b801d3b0 con 0x7f22c0158fe0 2023-07-21T19:09:04.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.550+0000 7f22aeffd700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22a00662f0 0x7f22a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:04.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.550+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22b8083d10 con 0x7f22c0158fe0 2023-07-21T19:09:04.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.550+0000 7f22be59c700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22a00662f0 0x7f22a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:04.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.550+0000 7f22be59c700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22a00662f0 0x7f22a00687a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009860 tx=0x7f22b001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:04.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.550+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f22c00b33c0 con 0x7f22c0158fe0 2023-07-21T19:09:04.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.738+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f22c00b33c0 con 0x7f22c0158fe0 2023-07-21T19:09:04.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.738+0000 7f22aeffd700 1 -- 172.21.15.123:0/2014755151 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f22c00b33c0 con 0x7f22c0158fe0 2023-07-21T19:09:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22a00662f0 msgr2=0x7f22a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22a00662f0 0x7f22a00687a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009860 tx=0x7f22b001c040 comp rx=0 tx=0).stop 2023-07-21T19:09:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 msgr2=0x7f22c00c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 0x7f22c00c4510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f22b800b9a0 tx=0x7f22b800bcb0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 shutdown_connections 2023-07-21T19:09:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22a00662f0 0x7f22a00687a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22c00c9820 0x7f22c00c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22c0158fe0 0x7f22c00c4510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 --2- 172.21.15.123:0/2014755151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22c006dc20 0x7f22c0142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 >> 172.21.15.123:0/2014755151 conn(0x7f22c006e960 msgr2=0x7f22c0159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 shutdown_connections 2023-07-21T19:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:04.742+0000 7f22bf59e700 1 -- 172.21.15.123:0/2014755151 wait complete. 2023-07-21T19:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:09:04.776 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2023-07-21T19:09:04.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:04.778 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-07-21T19:09:04.810 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:09:04.810 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T19:09:04.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:04.811 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-21T19:09:04.870 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:09:04.871 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:09:04.890 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:09:04.890 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:09:04.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.114+0000 7f64e0973700 1 Processor -- start 2023-07-21T19:09:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.114+0000 7f64e0973700 1 -- start start 2023-07-21T19:09:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64e0973700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f64dc06be70 0x7f64dc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64e0973700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64dc0c1e00 0x7f64dc0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64e0973700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc0cc1b0 con 0x7f64dc06d860 2023-07-21T19:09:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64e0973700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc0cd690 con 0x7f64dc0c1e00 2023-07-21T19:09:05.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64e0973700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc0cd970 con 0x7f64dc06be70 2023-07-21T19:09:05.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64da59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f64dc06d860 0x7f64dc06dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54788/0 (socket says 172.21.15.123:54788) 2023-07-21T19:09:05.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64da59c700 1 -- 172.21.15.123:0/2929962150 learned_addr learned my addr 172.21.15.123:0/2929962150 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:05.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64dad9d700 1 --2- 172.21.15.123:0/2929962150 >> v2:172.21.15.123:3300/0 conn(0x7f64dc0c1e00 0x7f64dc0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64d9d9b700 1 --2- 172.21.15.123:0/2929962150 >> v2:172.21.15.145:3300/0 conn(0x7f64dc06be70 0x7f64dc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64d959a700 1 -- 172.21.15.123:0/2929962150 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355817570 0 0) 0x7f64dc0cc1b0 con 0x7f64dc06d860 2023-07-21T19:09:05.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64d959a700 1 -- 172.21.15.123:0/2929962150 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c40035d0 con 0x7f64dc06d860 2023-07-21T19:09:05.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64dad9d700 1 -- 172.21.15.123:0/2929962150 >> v2:172.21.15.145:3300/0 conn(0x7f64dc06be70 msgr2=0x7f64dc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:05.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64dad9d700 1 --2- 172.21.15.123:0/2929962150 >> v2:172.21.15.145:3300/0 conn(0x7f64dc06be70 0x7f64dc0cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64dad9d700 1 -- 172.21.15.123:0/2929962150 >> v1:172.21.15.123:6789/0 conn(0x7f64dc06d860 legacy=0x7f64dc06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.118+0000 7f64dad9d700 1 -- 172.21.15.123:0/2929962150 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc0cdc50 con 0x7f64dc0c1e00 2023-07-21T19:09:05.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64dad9d700 1 --2- 172.21.15.123:0/2929962150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0cc640 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0b0c60 tx=0x7f64d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4d68b7d6fa2fa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64d959a700 1 -- 172.21.15.123:0/2929962150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400e070 con 0x7f64dc0c1e00 2023-07-21T19:09:05.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64d959a700 1 -- 172.21.15.123:0/2929962150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400bb20 con 0x7f64dc0c1e00 2023-07-21T19:09:05.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64d959a700 1 -- 172.21.15.123:0/2929962150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400be90 con 0x7f64dc0c1e00 2023-07-21T19:09:05.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 -- 172.21.15.123:0/2929962150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc0c1e00 msgr2=0x7f64dc0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 --2- 172.21.15.123:0/2929962150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0cc640 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0b0c60 tx=0x7f64d400b330 comp rx=0 tx=0).stop 2023-07-21T19:09:05.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 -- 172.21.15.123:0/2929962150 shutdown_connections 2023-07-21T19:09:05.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 --2- 172.21.15.123:0/2929962150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0cc640 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 --2- 172.21.15.123:0/2929962150 >> v2:172.21.15.145:3300/0 conn(0x7f64dc06be70 0x7f64dc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 -- 172.21.15.123:0/2929962150 >> 172.21.15.123:0/2929962150 conn(0x7f64dc0cad30 msgr2=0x7f64dc0cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:05.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 -- 172.21.15.123:0/2929962150 shutdown_connections 2023-07-21T19:09:05.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.122+0000 7f64e0973700 1 -- 172.21.15.123:0/2929962150 wait complete. 2023-07-21T19:09:05.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 Processor -- start 2023-07-21T19:09:05.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 -- start start 2023-07-21T19:09:05.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64dc06be70 0x7f64dc14cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 0x7f64dc0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0afaa0 con 0x7f64dc06d860 2023-07-21T19:09:05.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0c71a0 con 0x7f64dc0c1e00 2023-07-21T19:09:05.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0aee90 con 0x7f64dc06be70 2023-07-21T19:09:05.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 0x7f64dc0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 0x7f64dc0ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40502/0 (socket says 172.21.15.123:40502) 2023-07-21T19:09:05.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 -- 172.21.15.123:0/2224626504 learned_addr learned my addr 172.21.15.123:0/2224626504 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:05.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64da59c700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64dc06be70 0x7f64dc14cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64dad9d700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 -- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64dc06be70 msgr2=0x7f64dc14cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64dc06be70 0x7f64dc14cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 -- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64dc0c1e00 msgr2=0x7f64dc0c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 -- 172.21.15.123:0/2224626504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4009a70 con 0x7f64dc06d860 2023-07-21T19:09:05.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64d9d9b700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 0x7f64dc0ae790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64d000e9d0 tx=0x7f64d000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0009720 con 0x7f64dc06d860 2023-07-21T19:09:05.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000c850 con 0x7f64dc06d860 2023-07-21T19:09:05.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc0af170 con 0x7f64dc06d860 2023-07-21T19:09:05.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000cbc0 con 0x7f64dc06d860 2023-07-21T19:09:05.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.126+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc0af730 con 0x7f64dc06d860 2023-07-21T19:09:05.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.130+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc0afc50 con 0x7f64dc06d860 2023-07-21T19:09:05.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.130+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64d000cd20 con 0x7f64dc06d860 2023-07-21T19:09:05.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.134+0000 7f64caffd700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f64bc0662f0 0x7f64bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.134+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f64d0084290 con 0x7f64dc06d860 2023-07-21T19:09:05.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.134+0000 7f64da59c700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f64bc0662f0 0x7f64bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.134+0000 7f64da59c700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f64bc0662f0 0x7f64bc0687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005930 tx=0x7f64cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.138+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f64dc0afc50 con 0x7f64dc06d860 2023-07-21T19:09:05.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.310+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64dc14d000 con 0x7f64dc06d860 2023-07-21T19:09:05.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.314+0000 7f64caffd700 1 -- 172.21.15.123:0/2224626504 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f64d0054de0 con 0x7f64dc06d860 2023-07-21T19:09:05.330 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:05.331 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f64bc0662f0 msgr2=0x7f64bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f64bc0662f0 0x7f64bc0687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005930 tx=0x7f64cc009040 comp rx=0 tx=0).stop 2023-07-21T19:09:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 msgr2=0x7f64dc0ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 0x7f64dc0ae790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64d000e9d0 tx=0x7f64d000ed90 comp rx=0 tx=0).stop 2023-07-21T19:09:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 shutdown_connections 2023-07-21T19:09:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f64bc0662f0 0x7f64bc0687a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64dc0c1e00 0x7f64dc0c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64dc06d860 0x7f64dc0ae790 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 --2- 172.21.15.123:0/2224626504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64dc06be70 0x7f64dc14cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.318+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 >> 172.21.15.123:0/2224626504 conn(0x7f64dc0cad30 msgr2=0x7f64dc072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:05.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.322+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 shutdown_connections 2023-07-21T19:09:05.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.322+0000 7f64e0973700 1 -- 172.21.15.123:0/2224626504 wait complete. 2023-07-21T19:09:05.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:09:05.358 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:09:05.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.522+0000 7f136cd45700 1 Processor -- start 2023-07-21T19:09:05.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.522+0000 7f136cd45700 1 -- start start 2023-07-21T19:09:05.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f136cd45700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f13680cd7f0 0x7f136806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f136cd45700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13680cdfb0 con 0x7f13681603d0 2023-07-21T19:09:05.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f136cd45700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13680cdcd0 con 0x7f1368160000 2023-07-21T19:09:05.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f136cd45700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1368070e40 con 0x7f13680cd7f0 2023-07-21T19:09:05.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1366ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f13681603d0 0x7f13680c0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54790/0 (socket says 172.21.15.123:54790) 2023-07-21T19:09:05.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1366ffd700 1 -- 172.21.15.123:0/3622403416 learned_addr learned my addr 172.21.15.123:0/3622403416 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:05.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1367fff700 1 --2- 172.21.15.123:0/3622403416 >> v2:172.21.15.145:3300/0 conn(0x7f13680cd7f0 0x7f136806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206077405 0 0) 0x7f135c001110 con 0x7f13681603d0 2023-07-21T19:09:05.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13500035d0 con 0x7f13681603d0 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 152868214 0 0) 0x7f13500035d0 con 0x7f13681603d0 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 >> v2:172.21.15.145:3300/0 conn(0x7f13680cd7f0 msgr2=0x7f136806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 --2- 172.21.15.123:0/3622403416 >> v2:172.21.15.145:3300/0 conn(0x7f13680cd7f0 0x7f136806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 >> v1:172.21.15.145:6789/0 conn(0x7f1368160000 legacy=0x7f13680c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368070780 con 0x7f13681603d0 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f135c001800 con 0x7f13681603d0 2023-07-21T19:09:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 >> v1:172.21.15.123:6789/0 conn(0x7f13681603d0 legacy=0x7f13680c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1350003a20 0x7f1350003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f1350004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1350005220 0x7f135000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368070e40 con 0x7f1350004870 2023-07-21T19:09:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135000c0a0 con 0x7f1350003a20 2023-07-21T19:09:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135000c260 con 0x7f1350005220 2023-07-21T19:09:05.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1366ffd700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f1350004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f13677fe700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1350003a20 0x7f1350003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1367fff700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1350005220 0x7f135000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1366ffd700 1 -- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1350005220 msgr2=0x7f135000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.526+0000 7f1366ffd700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1350005220 0x7f135000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f1366ffd700 1 -- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1350003a20 msgr2=0x7f1350003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f1366ffd700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1350003a20 0x7f1350003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f1366ffd700 1 -- 172.21.15.123:0/3622403416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500035d0 con 0x7f1350004870 2023-07-21T19:09:05.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f1367fff700 1 -- 172.21.15.123:0/3622403416 reap_dead start 2023-07-21T19:09:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f1366ffd700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f1350004ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c320 tx=0x7f13500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636fb9daea6836e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00cde0 con 0x7f1350004870 2023-07-21T19:09:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c005980 con 0x7f1350004870 2023-07-21T19:09:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f13667fc700 1 -- 172.21.15.123:0/3622403416 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c005d30 con 0x7f1350004870 2023-07-21T19:09:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 -- 172.21.15.123:0/3622403416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 msgr2=0x7f1350004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f1350004ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c320 tx=0x7f13500058a0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 -- 172.21.15.123:0/3622403416 shutdown_connections 2023-07-21T19:09:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 --2- 172.21.15.123:0/3622403416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f1350004ce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 -- 172.21.15.123:0/3622403416 >> 172.21.15.123:0/3622403416 conn(0x7f13680afc60 msgr2=0x7f13680b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 -- 172.21.15.123:0/3622403416 shutdown_connections 2023-07-21T19:09:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.530+0000 7f136cd45700 1 -- 172.21.15.123:0/3622403416 wait complete. 2023-07-21T19:09:05.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 Processor -- start 2023-07-21T19:09:05.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 -- start start 2023-07-21T19:09:05.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f13680accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13680c8050 0x7f1368162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13680c59a0 0x7f13680c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b1f20 con 0x7f1350004870 2023-07-21T19:09:05.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680c6360 con 0x7f13680c8050 2023-07-21T19:09:05.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1368162d60 con 0x7f13680c59a0 2023-07-21T19:09:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f13680accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f13680accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40514/0 (socket says 172.21.15.123:40514) 2023-07-21T19:09:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 -- 172.21.15.123:0/733404196 learned_addr learned my addr 172.21.15.123:0/733404196 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f1367fff700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13680c59a0 0x7f13680c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f1366ffd700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13680c8050 0x7f1368162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 -- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13680c59a0 msgr2=0x7f13680c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13680c59a0 0x7f13680c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 -- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13680c8050 msgr2=0x7f1368162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13680c8050 0x7f1368162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 -- 172.21.15.123:0/733404196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368163040 con 0x7f1350004870 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f1366ffd700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13680c8050 0x7f1368162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f1367fff700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13680c59a0 0x7f13680c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f13677fe700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f13680accf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f135800f7a0 tx=0x7f135800fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580052e0 con 0x7f1350004870 2023-07-21T19:09:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358005440 con 0x7f1350004870 2023-07-21T19:09:05.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580038e0 con 0x7f1350004870 2023-07-21T19:09:05.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.534+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1368163320 con 0x7f1350004870 2023-07-21T19:09:05.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.538+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680ad230 con 0x7f1350004870 2023-07-21T19:09:05.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.538+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1368163510 con 0x7f1350004870 2023-07-21T19:09:05.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.538+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1358003a40 con 0x7f1350004870 2023-07-21T19:09:05.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.542+0000 7f134ffff700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13540662f0 0x7f13540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.542+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1358083db0 con 0x7f1350004870 2023-07-21T19:09:05.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.542+0000 7f1366ffd700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13540662f0 0x7f13540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.542+0000 7f1366ffd700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13540662f0 0x7f13540687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f135c015040 tx=0x7f135c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.546+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1358050ee0 con 0x7f1350004870 2023-07-21T19:09:05.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.714+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f136804e500 con 0x7f1350004870 2023-07-21T19:09:05.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.714+0000 7f134ffff700 1 -- 172.21.15.123:0/733404196 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1358054500 con 0x7f1350004870 2023-07-21T19:09:05.729 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:09:05.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13540662f0 msgr2=0x7f13540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13540662f0 0x7f13540687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f135c015040 tx=0x7f135c007000 comp rx=0 tx=0).stop 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 msgr2=0x7f13680accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f13680accf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f135800f7a0 tx=0x7f135800fb60 comp rx=0 tx=0).stop 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 shutdown_connections 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13540662f0 0x7f13540687a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13680c8050 0x7f1368162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13680c59a0 0x7f13680c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 --2- 172.21.15.123:0/733404196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1350004870 0x7f13680accf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 >> 172.21.15.123:0/733404196 conn(0x7f13680afc60 msgr2=0x7f13680c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:05.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 shutdown_connections 2023-07-21T19:09:05.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.718+0000 7f136cd45700 1 -- 172.21.15.123:0/733404196 wait complete. 2023-07-21T19:09:05.754 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:09:05.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.914+0000 7ff503b4d700 1 Processor -- start 2023-07-21T19:09:05.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff503b4d700 1 -- start start 2023-07-21T19:09:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff503b4d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4fc160240 0x7ff4fc0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff503b4d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 0x7ff4fc0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff503b4d700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc163fe0 con 0x7ff4fc0afd80 2023-07-21T19:09:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff503b4d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c8c30 con 0x7ff4fc160240 2023-07-21T19:09:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff503b4d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc0ca9e0 con 0x7ff4fc160610 2023-07-21T19:09:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff5018e9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4fc160240 0x7ff4fc0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff5010e8700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 0x7ff4fc0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff5010e8700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 0x7ff4fc0ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:52124/0 (socket says 172.21.15.123:52124) 2023-07-21T19:09:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.918+0000 7ff5010e8700 1 -- 172.21.15.123:0/1101950163 learned_addr learned my addr 172.21.15.123:0/1101950163 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:05.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5018e9700 1 -- 172.21.15.123:0/1101950163 >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 msgr2=0x7ff4fc0ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:05.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5018e9700 1 --2- 172.21.15.123:0/1101950163 >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 0x7ff4fc0ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5018e9700 1 -- 172.21.15.123:0/1101950163 >> v1:172.21.15.145:6789/0 conn(0x7ff4fc0afd80 legacy=0x7ff4fc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5008e7700 1 -- 172.21.15.123:0/1101950163 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927697332 0 0) 0x7ff4fc163fe0 con 0x7ff4fc0afd80 2023-07-21T19:09:05.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5018e9700 1 -- 172.21.15.123:0/1101950163 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc164230 con 0x7ff4fc160240 2023-07-21T19:09:05.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5010e8700 1 --2- 172.21.15.123:0/1101950163 >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 0x7ff4fc0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:05.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5018e9700 1 --2- 172.21.15.123:0/1101950163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160240 0x7ff4fc0cdc20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc06e390 tx=0x7ff4f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76e19325cbbf009 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5008e7700 1 -- 172.21.15.123:0/1101950163 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8011830 con 0x7ff4fc160240 2023-07-21T19:09:05.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5008e7700 1 -- 172.21.15.123:0/1101950163 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8011990 con 0x7ff4fc160240 2023-07-21T19:09:05.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff5008e7700 1 -- 172.21.15.123:0/1101950163 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8011d20 con 0x7ff4fc160240 2023-07-21T19:09:05.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 -- 172.21.15.123:0/1101950163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160240 msgr2=0x7ff4fc0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 --2- 172.21.15.123:0/1101950163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160240 0x7ff4fc0cdc20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc06e390 tx=0x7ff4f8009b30 comp rx=0 tx=0).stop 2023-07-21T19:09:05.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 -- 172.21.15.123:0/1101950163 shutdown_connections 2023-07-21T19:09:05.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 --2- 172.21.15.123:0/1101950163 >> v2:172.21.15.145:3300/0 conn(0x7ff4fc160610 0x7ff4fc0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 --2- 172.21.15.123:0/1101950163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160240 0x7ff4fc0cdc20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 -- 172.21.15.123:0/1101950163 >> 172.21.15.123:0/1101950163 conn(0x7ff4fc0cad80 msgr2=0x7ff4fc0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:05.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 -- 172.21.15.123:0/1101950163 shutdown_connections 2023-07-21T19:09:05.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.922+0000 7ff503b4d700 1 -- 172.21.15.123:0/1101950163 wait complete. 2023-07-21T19:09:05.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 Processor -- start 2023-07-21T19:09:05.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 -- start start 2023-07-21T19:09:05.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4fc0afd80 0x7ff4fc1f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4fc160240 0x7ff4fc1f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 0x7ff4fc15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc1f5b40 con 0x7ff4fc160610 2023-07-21T19:09:05.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c81d0 con 0x7ff4fc0afd80 2023-07-21T19:09:05.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff503b4d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c3c70 con 0x7ff4fc160240 2023-07-21T19:09:05.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 0x7ff4fc15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 0x7ff4fc15bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40520/0 (socket says 172.21.15.123:40520) 2023-07-21T19:09:05.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 -- 172.21.15.123:0/3580385949 learned_addr learned my addr 172.21.15.123:0/3580385949 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:05.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5018e9700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4fc0afd80 0x7ff4fc1f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5010e8700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4fc160240 0x7ff4fc1f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 -- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4fc160240 msgr2=0x7ff4fc1f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4fc160240 0x7ff4fc1f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 -- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4fc0afd80 msgr2=0x7ff4fc1f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4fc0afd80 0x7ff4fc1f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.926+0000 7ff5020ea700 1 -- 172.21.15.123:0/3580385949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009570 con 0x7ff4fc160610 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff5020ea700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 0x7ff4fc15bf90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400cc40 tx=0x7ff4f400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4003e50 con 0x7ff4fc160610 2023-07-21T19:09:05.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f400a720 con 0x7ff4fc160610 2023-07-21T19:09:05.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400aad0 con 0x7ff4fc160610 2023-07-21T19:09:05.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80094b0 con 0x7ff4fc160610 2023-07-21T19:09:05.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc0c7e60 con 0x7ff4fc160610 2023-07-21T19:09:05.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc1644f0 con 0x7ff4fc160610 2023-07-21T19:09:05.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.930+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4f400ac30 con 0x7ff4fc160610 2023-07-21T19:09:05.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.934+0000 7ff4f27fc700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff4e00662f0 0x7ff4e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:05.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.934+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4f4083aa0 con 0x7ff4fc160610 2023-07-21T19:09:05.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.934+0000 7ff5018e9700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff4e00662f0 0x7ff4e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:05.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.934+0000 7ff5018e9700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff4e00662f0 0x7ff4e00687a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:05.938+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff4fc1644f0 con 0x7ff4fc160610 2023-07-21T19:09:06.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.110+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff4fc0c8380 con 0x7ff4fc160610 2023-07-21T19:09:06.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff4f27fc700 1 -- 172.21.15.123:0/3580385949 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff4f4017020 con 0x7ff4fc160610 2023-07-21T19:09:06.127 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:09:06.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff4e00662f0 msgr2=0x7ff4e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff4e00662f0 0x7ff4e00687a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8008030 comp rx=0 tx=0).stop 2023-07-21T19:09:06.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 msgr2=0x7ff4fc15bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 0x7ff4fc15bf90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400cc40 tx=0x7ff4f400cf50 comp rx=0 tx=0).stop 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 shutdown_connections 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff4e00662f0 0x7ff4e00687a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4fc160610 0x7ff4fc15bf90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4fc160240 0x7ff4fc1f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 --2- 172.21.15.123:0/3580385949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4fc0afd80 0x7ff4fc1f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 >> 172.21.15.123:0/3580385949 conn(0x7ff4fc0cad80 msgr2=0x7ff4fc0ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:06.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 shutdown_connections 2023-07-21T19:09:06.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.114+0000 7ff503b4d700 1 -- 172.21.15.123:0/3580385949 wait complete. 2023-07-21T19:09:06.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:09:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.314+0000 7f23621d5700 1 Processor -- start 2023-07-21T19:09:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.314+0000 7f23621d5700 1 -- start start 2023-07-21T19:09:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f23621d5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f23621d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f235c0b0680 0x7f235c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f23621d5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c0c9500 con 0x7f235c0c90a0 2023-07-21T19:09:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f23621d5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c158970 con 0x7f235c0b0680 2023-07-21T19:09:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f23621d5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0ce080 con 0x7f235c0cdcb0 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f235c0b0680 0x7f235c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f235c0c90a0 0x7f235c15bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54806/0 (socket says 172.21.15.123:54806) 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235bfff700 1 -- 172.21.15.123:0/3741235740 learned_addr learned my addr 172.21.15.123:0/3741235740 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235b7fe700 1 --2- 172.21.15.123:0/3741235740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235affd700 1 -- 172.21.15.123:0/3741235740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 msgr2=0x7f235c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235affd700 1 --2- 172.21.15.123:0/3741235740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235affd700 1 -- 172.21.15.123:0/3741235740 >> v1:172.21.15.123:6789/0 conn(0x7f235c0c90a0 legacy=0x7f235c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235affd700 1 -- 172.21.15.123:0/3741235740 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c158bf0 con 0x7f235c0b0680 2023-07-21T19:09:06.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235a7fc700 1 -- 172.21.15.123:0/3741235740 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204516150 0 0) 0x7f235c0c9500 con 0x7f235c0c90a0 2023-07-21T19:09:06.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235affd700 1 --2- 172.21.15.123:0/3741235740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0b0680 0x7f235c0c8b60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2350009850 tx=0x7f2350009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfb8fead15e3fe1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:06.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235a7fc700 1 -- 172.21.15.123:0/3741235740 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000f8a0 con 0x7f235c0b0680 2023-07-21T19:09:06.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235a7fc700 1 -- 172.21.15.123:0/3741235740 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000fa00 con 0x7f235c0b0680 2023-07-21T19:09:06.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.318+0000 7f235a7fc700 1 -- 172.21.15.123:0/3741235740 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000fdb0 con 0x7f235c0b0680 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 -- 172.21.15.123:0/3741235740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0b0680 msgr2=0x7f235c0c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 --2- 172.21.15.123:0/3741235740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0b0680 0x7f235c0c8b60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2350009850 tx=0x7f2350009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 -- 172.21.15.123:0/3741235740 shutdown_connections 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 --2- 172.21.15.123:0/3741235740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0b0680 0x7f235c0c8b60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 --2- 172.21.15.123:0/3741235740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 -- 172.21.15.123:0/3741235740 >> 172.21.15.123:0/3741235740 conn(0x7f235c0cad80 msgr2=0x7f235c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:06.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 -- 172.21.15.123:0/3741235740 shutdown_connections 2023-07-21T19:09:06.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 -- 172.21.15.123:0/3741235740 wait complete. 2023-07-21T19:09:06.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.322+0000 7f23621d5700 1 Processor -- start 2023-07-21T19:09:06.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 -- start start 2023-07-21T19:09:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f235c0b0680 0x7f235c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 0x7f235c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c14bb80 con 0x7f235c0c90a0 2023-07-21T19:09:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1f1ba0 con 0x7f235c0b0680 2023-07-21T19:09:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1f1e80 con 0x7f235c0cdcb0 2023-07-21T19:09:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 0x7f235c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 0x7f235c14b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40540/0 (socket says 172.21.15.123:40540) 2023-07-21T19:09:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 -- 172.21.15.123:0/234442699 learned_addr learned my addr 172.21.15.123:0/234442699 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235bfff700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235b7fe700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f235c0b0680 0x7f235c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 -- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 msgr2=0x7f235c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 -- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f235c0b0680 msgr2=0x7f235c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f235c0b0680 0x7f235c0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 -- 172.21.15.123:0/234442699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500094b0 con 0x7f235c0c90a0 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f235affd700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 0x7f235c14b640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2350000c00 tx=0x7f2350004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350010e50 con 0x7f235c0c90a0 2023-07-21T19:09:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2350019400 con 0x7f235c0c90a0 2023-07-21T19:09:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c1f2160 con 0x7f235c0c90a0 2023-07-21T19:09:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500197b0 con 0x7f235c0c90a0 2023-07-21T19:09:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.326+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c1519d0 con 0x7f235c0c90a0 2023-07-21T19:09:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.330+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c061060 con 0x7f235c0c90a0 2023-07-21T19:09:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.330+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2350019910 con 0x7f235c0c90a0 2023-07-21T19:09:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.330+0000 7f2343fff700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f23480662f0 0x7f23480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.334+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f23500857f0 con 0x7f235c0c90a0 2023-07-21T19:09:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.334+0000 7f235b7fe700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f23480662f0 0x7f23480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.334+0000 7f235b7fe700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f23480662f0 0x7f23480687a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f235c159b20 tx=0x7f234c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:06.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.338+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2350052930 con 0x7f235c0c90a0 2023-07-21T19:09:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.514+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f235c04dcb0 con 0x7f235c0c90a0 2023-07-21T19:09:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.514+0000 7f2343fff700 1 -- 172.21.15.123:0/234442699 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2350055f50 con 0x7f235c0c90a0 2023-07-21T19:09:06.531 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:06.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f23480662f0 msgr2=0x7f23480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f23480662f0 0x7f23480687a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f235c159b20 tx=0x7f234c008040 comp rx=0 tx=0).stop 2023-07-21T19:09:06.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 msgr2=0x7f235c14b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 0x7f235c14b640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2350000c00 tx=0x7f2350004770 comp rx=0 tx=0).stop 2023-07-21T19:09:06.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 shutdown_connections 2023-07-21T19:09:06.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f23480662f0 0x7f23480687a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f235c0cdcb0 0x7f235c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f235c0c90a0 0x7f235c14b640 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 --2- 172.21.15.123:0/234442699 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f235c0b0680 0x7f235c0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 >> 172.21.15.123:0/234442699 conn(0x7f235c0cad80 msgr2=0x7f235c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:06.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 shutdown_connections 2023-07-21T19:09:06.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.518+0000 7f23621d5700 1 -- 172.21.15.123:0/234442699 wait complete. 2023-07-21T19:09:06.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:09:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.718+0000 7fd3aac16700 1 Processor -- start 2023-07-21T19:09:06.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.722+0000 7fd3aac16700 1 -- start start 2023-07-21T19:09:06.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.722+0000 7fd3aac16700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd3a40cd260 0x7fd3a40d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.722+0000 7fd3aac16700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a40af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3aac16700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a40d1a60 con 0x7fd3a40b0ee0 2023-07-21T19:09:06.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3aac16700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a40d1ef0 con 0x7fd3a40cd260 2023-07-21T19:09:06.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3aac16700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40d0e50 con 0x7fd3a40d0610 2023-07-21T19:09:06.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd3a40cd260 0x7fd3a40d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd3a40cd260 0x7fd3a40d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:52170/0 (socket says 172.21.15.123:52170) 2023-07-21T19:09:06.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 -- 172.21.15.123:0/845014752 learned_addr learned my addr 172.21.15.123:0/845014752 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:06.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3aa415700 1 --2- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a40af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 -- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 msgr2=0x7fd3a40af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:06.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 --2- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a40af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 -- 172.21.15.123:0/845014752 >> v1:172.21.15.145:6789/0 conn(0x7fd3a40b0ee0 legacy=0x7fd3a40ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 -- 172.21.15.123:0/845014752 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40d1130 con 0x7fd3a40cd260 2023-07-21T19:09:06.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a9413700 1 --2- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40cd260 0x7fd3a40d00d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd394009910 tx=0x7fd394009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1dfd59db506bfcb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:06.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a8c12700 1 -- 172.21.15.123:0/845014752 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011830 con 0x7fd3a40cd260 2023-07-21T19:09:06.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a8c12700 1 -- 172.21.15.123:0/845014752 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394011990 con 0x7fd3a40cd260 2023-07-21T19:09:06.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.726+0000 7fd3a8c12700 1 -- 172.21.15.123:0/845014752 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011d40 con 0x7fd3a40cd260 2023-07-21T19:09:06.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 -- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40cd260 msgr2=0x7fd3a40d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 --2- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40cd260 0x7fd3a40d00d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd394009910 tx=0x7fd394009c20 comp rx=0 tx=0).stop 2023-07-21T19:09:06.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 -- 172.21.15.123:0/845014752 shutdown_connections 2023-07-21T19:09:06.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 --2- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a40af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 --2- 172.21.15.123:0/845014752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40cd260 0x7fd3a40d00d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 -- 172.21.15.123:0/845014752 >> 172.21.15.123:0/845014752 conn(0x7fd3a4060c40 msgr2=0x7fd3a409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:06.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 -- 172.21.15.123:0/845014752 shutdown_connections 2023-07-21T19:09:06.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.730+0000 7fd3aac16700 1 -- 172.21.15.123:0/845014752 wait complete. 2023-07-21T19:09:06.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 Processor -- start 2023-07-21T19:09:06.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 -- start start 2023-07-21T19:09:06.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40b0ee0 0x7fd3a40c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 0x7fd3a415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a41f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40b1af0 con 0x7fd3a40cd260 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40b2070 con 0x7fd3a40b0ee0 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aac16700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40c6550 con 0x7fd3a40d0610 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 0x7fd3a415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 0x7fd3a415b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40544/0 (socket says 172.21.15.123:40544) 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 -- 172.21.15.123:0/261234754 learned_addr learned my addr 172.21.15.123:0/261234754 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:06.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3aa415700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a41f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9c14700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40b0ee0 0x7fd3a40c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 -- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 msgr2=0x7fd3a41f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a41f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 -- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40b0ee0 msgr2=0x7fd3a40c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40b0ee0 0x7fd3a40c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 -- 172.21.15.123:0/261234754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394009570 con 0x7fd3a40cd260 2023-07-21T19:09:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.734+0000 7fd3a9413700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 0x7fd3a415b3b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd394013000 tx=0x7fd394004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394004510 con 0x7fd3a40cd260 2023-07-21T19:09:06.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940036c0 con 0x7fd3a40cd260 2023-07-21T19:09:06.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394003a70 con 0x7fd3a40cd260 2023-07-21T19:09:06.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a41f1fe0 con 0x7fd3a40cd260 2023-07-21T19:09:06.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a40b1d00 con 0x7fd3a40cd260 2023-07-21T19:09:06.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a404e500 con 0x7fd3a40cd260 2023-07-21T19:09:06.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.738+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd394003bd0 con 0x7fd3a40cd260 2023-07-21T19:09:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.742+0000 7fd39a7fc700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3880662f0 0x7fd3880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.742+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd394021030 con 0x7fd3a40cd260 2023-07-21T19:09:06.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.742+0000 7fd3a9c14700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3880662f0 0x7fd3880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:06.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.742+0000 7fd3a9c14700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3880662f0 0x7fd3880687a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0000f60 tx=0x7fd3a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:06.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.746+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd394052780 con 0x7fd3a40cd260 2023-07-21T19:09:06.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.918+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3a40b18d0 con 0x7fd3a40cd260 2023-07-21T19:09:06.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.918+0000 7fd39a7fc700 1 -- 172.21.15.123:0/261234754 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd394055da0 con 0x7fd3a40cd260 2023-07-21T19:09:06.933 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:09:06.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3880662f0 msgr2=0x7fd3880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3880662f0 0x7fd3880687a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0000f60 tx=0x7fd3a0009040 comp rx=0 tx=0).stop 2023-07-21T19:09:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 msgr2=0x7fd3a415b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 0x7fd3a415b3b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd394013000 tx=0x7fd394004770 comp rx=0 tx=0).stop 2023-07-21T19:09:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 shutdown_connections 2023-07-21T19:09:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd3880662f0 0x7fd3880687a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a40d0610 0x7fd3a41f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3a40cd260 0x7fd3a415b3b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 --2- 172.21.15.123:0/261234754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a40b0ee0 0x7fd3a40c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:06.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 >> 172.21.15.123:0/261234754 conn(0x7fd3a4060c40 msgr2=0x7fd3a40b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:06.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 shutdown_connections 2023-07-21T19:09:06.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:06.922+0000 7fd3aac16700 1 -- 172.21.15.123:0/261234754 wait complete. 2023-07-21T19:09:06.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:09:07.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:07.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.106+0000 7f66c53e6700 1 Processor -- start 2023-07-21T19:09:07.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.106+0000 7f66c53e6700 1 -- start start 2023-07-21T19:09:07.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66c53e6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f66c00caef0 0x7f66c006d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66c53e6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 0x7f66c006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66c53e6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c0069cd0 con 0x7f66c006a6a0 2023-07-21T19:09:07.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66c53e6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c00ccd30 con 0x7f66c00caef0 2023-07-21T19:09:07.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66c53e6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c006ded0 con 0x7f66c006d7c0 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66be7fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 0x7f66c006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66be7fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 0x7f66c006a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46518/0 (socket says 172.21.15.123:46518) 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66be7fc700 1 -- 172.21.15.123:0/2530735902 learned_addr learned my addr 172.21.15.123:0/2530735902 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.110+0000 7f66beffd700 1 --2- 172.21.15.123:0/2530735902 >> v2:172.21.15.145:3300/0 conn(0x7f66c00caef0 0x7f66c006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66be7fc700 1 -- 172.21.15.123:0/2530735902 >> v2:172.21.15.145:3300/0 conn(0x7f66c00caef0 msgr2=0x7f66c006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66be7fc700 1 --2- 172.21.15.123:0/2530735902 >> v2:172.21.15.145:3300/0 conn(0x7f66c00caef0 0x7f66c006d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66be7fc700 1 -- 172.21.15.123:0/2530735902 >> v1:172.21.15.145:6789/0 conn(0x7f66c006a6a0 legacy=0x7f66c006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66be7fc700 1 -- 172.21.15.123:0/2530735902 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c006e1b0 con 0x7f66c006d7c0 2023-07-21T19:09:07.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66be7fc700 1 --2- 172.21.15.123:0/2530735902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 0x7f66c006a160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009910 tx=0x7f66b4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3860f9e36be86364 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66bdffb700 1 -- 172.21.15.123:0/2530735902 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4011830 con 0x7f66c006d7c0 2023-07-21T19:09:07.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66bdffb700 1 -- 172.21.15.123:0/2530735902 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4011990 con 0x7f66c006d7c0 2023-07-21T19:09:07.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66bdffb700 1 -- 172.21.15.123:0/2530735902 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4011d40 con 0x7f66c006d7c0 2023-07-21T19:09:07.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 -- 172.21.15.123:0/2530735902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 msgr2=0x7f66c006a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 --2- 172.21.15.123:0/2530735902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 0x7f66c006a160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009910 tx=0x7f66b4009c20 comp rx=0 tx=0).stop 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 -- 172.21.15.123:0/2530735902 shutdown_connections 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 --2- 172.21.15.123:0/2530735902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c006d7c0 0x7f66c006a160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 --2- 172.21.15.123:0/2530735902 >> v2:172.21.15.145:3300/0 conn(0x7f66c00caef0 0x7f66c006d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 -- 172.21.15.123:0/2530735902 >> 172.21.15.123:0/2530735902 conn(0x7f66c00706b0 msgr2=0x7f66c00cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 -- 172.21.15.123:0/2530735902 shutdown_connections 2023-07-21T19:09:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 -- 172.21.15.123:0/2530735902 wait complete. 2023-07-21T19:09:07.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 Processor -- start 2023-07-21T19:09:07.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.114+0000 7f66c53e6700 1 -- start start 2023-07-21T19:09:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66c006a6a0 0x7f66c0155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 0x7f66c00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c00caef0 0x7f66c00adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0156060 con 0x7f66c006d7c0 2023-07-21T19:09:07.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c00acae0 con 0x7f66c006a6a0 2023-07-21T19:09:07.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c00acdc0 con 0x7f66c00caef0 2023-07-21T19:09:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 0x7f66c00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 0x7f66c00c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40554/0 (socket says 172.21.15.123:40554) 2023-07-21T19:09:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 -- 172.21.15.123:0/188154153 learned_addr learned my addr 172.21.15.123:0/188154153 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66bf7fe700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c00caef0 0x7f66c00adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66beffd700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66c006a6a0 0x7f66c0155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 -- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c00caef0 msgr2=0x7f66c00adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c00caef0 0x7f66c00adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 -- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66c006a6a0 msgr2=0x7f66c0155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66c006a6a0 0x7f66c0155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 -- 172.21.15.123:0/188154153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4009570 con 0x7f66c006d7c0 2023-07-21T19:09:07.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66bf7fe700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c00caef0 0x7f66c00adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66be7fc700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 0x7f66c00c3ec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009c60 tx=0x7f66b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004480 con 0x7f66c006d7c0 2023-07-21T19:09:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b401f070 con 0x7f66c006d7c0 2023-07-21T19:09:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c00ad0a0 con 0x7f66c006d7c0 2023-07-21T19:09:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4003900 con 0x7f66c006d7c0 2023-07-21T19:09:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.118+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c00ad660 con 0x7f66c006d7c0 2023-07-21T19:09:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.122+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c00ad850 con 0x7f66c006d7c0 2023-07-21T19:09:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.122+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66b4021030 con 0x7f66c006d7c0 2023-07-21T19:09:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.126+0000 7f66a77fe700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f66ac0662f0 0x7f66ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.126+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66b4085610 con 0x7f66c006d7c0 2023-07-21T19:09:07.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.126+0000 7f66beffd700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f66ac0662f0 0x7f66ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.126+0000 7f66beffd700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f66ac0662f0 0x7f66ac0687a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009b80 tx=0x7f66b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.130+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f66b4052870 con 0x7f66c006d7c0 2023-07-21T19:09:07.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.298+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f66c004dcb0 con 0x7f66c006d7c0 2023-07-21T19:09:07.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.302+0000 7f66a77fe700 1 -- 172.21.15.123:0/188154153 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f66b4055e90 con 0x7f66c006d7c0 2023-07-21T19:09:07.315 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:07.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f66ac0662f0 msgr2=0x7f66ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f66ac0662f0 0x7f66ac0687a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009b80 tx=0x7f66b0008040 comp rx=0 tx=0).stop 2023-07-21T19:09:07.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 msgr2=0x7f66c00c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 0x7f66c00c3ec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009c60 tx=0x7f66b4004770 comp rx=0 tx=0).stop 2023-07-21T19:09:07.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 shutdown_connections 2023-07-21T19:09:07.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f66ac0662f0 0x7f66ac0687a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66c00caef0 0x7f66c00adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c006d7c0 0x7f66c00c3ec0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 --2- 172.21.15.123:0/188154153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66c006a6a0 0x7f66c0155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 >> 172.21.15.123:0/188154153 conn(0x7f66c00706b0 msgr2=0x7f66c00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:07.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 shutdown_connections 2023-07-21T19:09:07.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.306+0000 7f66c53e6700 1 -- 172.21.15.123:0/188154153 wait complete. 2023-07-21T19:09:07.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:09:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.550+0000 7ff1551be700 1 Processor -- start 2023-07-21T19:09:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.550+0000 7ff1551be700 1 -- start start 2023-07-21T19:09:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff150071000 0x7ff15015ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff1500cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015d230 con 0x7ff1501599d0 2023-07-21T19:09:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1500cde10 con 0x7ff150071000 2023-07-21T19:09:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500cb3c0 con 0x7ff1500caa20 2023-07-21T19:09:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1477fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff150071000 0x7ff15015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff1500cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff1500cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46526/0 (socket says 172.21.15.123:46526) 2023-07-21T19:09:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 -- 172.21.15.123:0/1745348500 learned_addr learned my addr 172.21.15.123:0/1745348500 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 -- 172.21.15.123:0/1745348500 >> v2:172.21.15.145:3300/0 conn(0x7ff150071000 msgr2=0x7ff15015ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 --2- 172.21.15.123:0/1745348500 >> v2:172.21.15.145:3300/0 conn(0x7ff150071000 0x7ff15015ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 -- 172.21.15.123:0/1745348500 >> v1:172.21.15.145:6789/0 conn(0x7ff1501599d0 legacy=0x7ff1500c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 -- 172.21.15.123:0/1745348500 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500cd520 con 0x7ff1500caa20 2023-07-21T19:09:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1549bd700 1 --2- 172.21.15.123:0/1745348500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff1500cae80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff148009e50 tx=0x7ff14800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58d33b9a4490abdf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff14f7fe700 1 -- 172.21.15.123:0/1745348500 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800e070 con 0x7ff1500caa20 2023-07-21T19:09:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff14f7fe700 1 -- 172.21.15.123:0/1745348500 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14800b910 con 0x7ff1500caa20 2023-07-21T19:09:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff14f7fe700 1 -- 172.21.15.123:0/1745348500 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800bc80 con 0x7ff1500caa20 2023-07-21T19:09:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- 172.21.15.123:0/1745348500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 msgr2=0x7ff1500cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 --2- 172.21.15.123:0/1745348500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff1500cae80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff148009e50 tx=0x7ff14800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- 172.21.15.123:0/1745348500 shutdown_connections 2023-07-21T19:09:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 --2- 172.21.15.123:0/1745348500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff1500cae80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 --2- 172.21.15.123:0/1745348500 >> v2:172.21.15.145:3300/0 conn(0x7ff150071000 0x7ff15015ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- 172.21.15.123:0/1745348500 >> 172.21.15.123:0/1745348500 conn(0x7ff15006e960 msgr2=0x7ff15006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- 172.21.15.123:0/1745348500 shutdown_connections 2023-07-21T19:09:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.554+0000 7ff1551be700 1 -- 172.21.15.123:0/1745348500 wait complete. 2023-07-21T19:09:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 Processor -- start 2023-07-21T19:09:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 -- start start 2023-07-21T19:09:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 0x7ff1500b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff150151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1501599d0 0x7ff1501f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b24a0 con 0x7ff150071000 2023-07-21T19:09:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b2780 con 0x7ff1501599d0 2023-07-21T19:09:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.558+0000 7ff1551be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b2a60 con 0x7ff1500caa20 2023-07-21T19:09:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 0x7ff1500b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 0x7ff1500b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40566/0 (socket says 172.21.15.123:40566) 2023-07-21T19:09:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 -- 172.21.15.123:0/277164404 learned_addr learned my addr 172.21.15.123:0/277164404 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff1549bd700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1501599d0 0x7ff1501f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff1477fe700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff150151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 -- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 msgr2=0x7ff150151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff150151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 -- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1501599d0 msgr2=0x7ff1501f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1501599d0 0x7ff1501f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 -- 172.21.15.123:0/277164404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff148009b30 con 0x7ff150071000 2023-07-21T19:09:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14ffff700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 0x7ff1500b06c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c500 tx=0x7ff14000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1400052d0 con 0x7ff150071000 2023-07-21T19:09:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140005430 con 0x7ff150071000 2023-07-21T19:09:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1400055a0 con 0x7ff150071000 2023-07-21T19:09:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1501f4d40 con 0x7ff150071000 2023-07-21T19:09:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff150151a70 con 0x7ff150071000 2023-07-21T19:09:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.562+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1501f5260 con 0x7ff150071000 2023-07-21T19:09:07.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.566+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1400038e0 con 0x7ff150071000 2023-07-21T19:09:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.566+0000 7ff14d7fa700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1300662f0 0x7ff1300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.566+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff140083480 con 0x7ff150071000 2023-07-21T19:09:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.566+0000 7ff1477fe700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1300662f0 0x7ff1300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.570+0000 7ff1477fe700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1300662f0 0x7ff1300687a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff15015b4c0 tx=0x7ff138009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.574+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff1400504a0 con 0x7ff150071000 2023-07-21T19:09:07.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.758+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1500b25e0 con 0x7ff150071000 2023-07-21T19:09:07.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.758+0000 7ff14d7fa700 1 -- 172.21.15.123:0/277164404 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1500b25e0 con 0x7ff150071000 2023-07-21T19:09:07.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1300662f0 msgr2=0x7ff1300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1300662f0 0x7ff1300687a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff15015b4c0 tx=0x7ff138009240 comp rx=0 tx=0).stop 2023-07-21T19:09:07.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 msgr2=0x7ff1500b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 0x7ff1500b06c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c500 tx=0x7ff14000c810 comp rx=0 tx=0).stop 2023-07-21T19:09:07.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 shutdown_connections 2023-07-21T19:09:07.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7ff1300662f0 0x7ff1300687a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1501599d0 0x7ff1501f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1500caa20 0x7ff150151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 --2- 172.21.15.123:0/277164404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff150071000 0x7ff1500b06c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 >> 172.21.15.123:0/277164404 conn(0x7ff15006e960 msgr2=0x7ff15006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:07.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 shutdown_connections 2023-07-21T19:09:07.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.762+0000 7ff1551be700 1 -- 172.21.15.123:0/277164404 wait complete. 2023-07-21T19:09:07.782 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:09:07.800 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T19:09:07.801 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T19:09:07.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.974+0000 7f1369d3e700 1 Processor -- start 2023-07-21T19:09:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.974+0000 7f1369d3e700 1 -- start start 2023-07-21T19:09:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f1369d3e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1364159f20 0x7f13640caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f1369d3e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13640caf70 0x7f136415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f1369d3e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640b0ef0 con 0x7f13640c9d90 2023-07-21T19:09:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f1369d3e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640ce9c0 con 0x7f13640caf70 2023-07-21T19:09:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f1369d3e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640cee50 con 0x7f1364159f20 2023-07-21T19:09:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13640caf70 0x7f136415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13640caf70 0x7f136415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40582/0 (socket says 172.21.15.123:40582) 2023-07-21T19:09:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f1368d3c700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f13640c9d90 0x7f13640ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:45338/0 (socket says 172.21.15.123:45338) 2023-07-21T19:09:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 -- 172.21.15.123:0/3399153595 learned_addr learned my addr 172.21.15.123:0/3399153595 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f135bfff700 1 --2- 172.21.15.123:0/3399153595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1364159f20 0x7f13640caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 -- 172.21.15.123:0/3399153595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1364159f20 msgr2=0x7f13640caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 --2- 172.21.15.123:0/3399153595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1364159f20 0x7f13640caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 -- 172.21.15.123:0/3399153595 >> v1:172.21.15.145:6789/0 conn(0x7f13640c9d90 legacy=0x7f13640ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 -- 172.21.15.123:0/3399153595 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640cb4f0 con 0x7f13640caf70 2023-07-21T19:09:07.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f135b7fe700 1 -- 172.21.15.123:0/3399153595 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86960211 0 0) 0x7f13640b0ef0 con 0x7f13640c9d90 2023-07-21T19:09:07.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f136953d700 1 --2- 172.21.15.123:0/3399153595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640caf70 0x7f136415d7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f135c009e50 tx=0x7f135c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1632ff62837c73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f135b7fe700 1 -- 172.21.15.123:0/3399153595 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00e070 con 0x7f13640caf70 2023-07-21T19:09:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f135b7fe700 1 -- 172.21.15.123:0/3399153595 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c00b910 con 0x7f13640caf70 2023-07-21T19:09:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.978+0000 7f135b7fe700 1 -- 172.21.15.123:0/3399153595 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00bcc0 con 0x7f13640caf70 2023-07-21T19:09:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 -- 172.21.15.123:0/3399153595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640caf70 msgr2=0x7f136415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 --2- 172.21.15.123:0/3399153595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640caf70 0x7f136415d7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f135c009e50 tx=0x7f135c00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 -- 172.21.15.123:0/3399153595 shutdown_connections 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 --2- 172.21.15.123:0/3399153595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640caf70 0x7f136415d7f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 --2- 172.21.15.123:0/3399153595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1364159f20 0x7f13640caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 -- 172.21.15.123:0/3399153595 >> 172.21.15.123:0/3399153595 conn(0x7f136406e960 msgr2=0x7f136406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 -- 172.21.15.123:0/3399153595 shutdown_connections 2023-07-21T19:09:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 -- 172.21.15.123:0/3399153595 wait complete. 2023-07-21T19:09:07.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 Processor -- start 2023-07-21T19:09:07.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.982+0000 7f1369d3e700 1 -- start start 2023-07-21T19:09:07.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 0x7f13640c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13640caf70 0x7f1364155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1364159f20 0x7f1364151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c34b0 con 0x7f13640c9d90 2023-07-21T19:09:08.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c2590 con 0x7f1364159f20 2023-07-21T19:09:08.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c2830 con 0x7f13640caf70 2023-07-21T19:09:08.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 0x7f13640c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 0x7f13640c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40590/0 (socket says 172.21.15.123:40590) 2023-07-21T19:09:08.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 -- 172.21.15.123:0/109829255 learned_addr learned my addr 172.21.15.123:0/109829255 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:08.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f136953d700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1364159f20 0x7f1364151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f135bfff700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13640caf70 0x7f1364155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 -- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13640caf70 msgr2=0x7f1364155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13640caf70 0x7f1364155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 -- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1364159f20 msgr2=0x7f1364151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1364159f20 0x7f1364151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 -- 172.21.15.123:0/109829255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c009b30 con 0x7f13640c9d90 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f136953d700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1364159f20 0x7f1364151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1368d3c700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 0x7f13640c2050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f136000c4e0 tx=0x7f136000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360004ca0 con 0x7f13640c9d90 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360004e20 con 0x7f13640c9d90 2023-07-21T19:09:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13640c2b10 con 0x7f13640c9d90 2023-07-21T19:09:08.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360007310 con 0x7f13640c9d90 2023-07-21T19:09:08.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.986+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13640c30d0 con 0x7f13640c9d90 2023-07-21T19:09:08.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.990+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13640c35f0 con 0x7f13640c9d90 2023-07-21T19:09:08.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.990+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1360007470 con 0x7f13640c9d90 2023-07-21T19:09:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.994+0000 7f13597fa700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13500662f0 0x7f13500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.994+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1360083d70 con 0x7f13640c9d90 2023-07-21T19:09:08.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.994+0000 7f135bfff700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13500662f0 0x7f13500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.994+0000 7f135bfff700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13500662f0 0x7f13500687a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f13640b2ee0 tx=0x7f1354008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:07.998+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f13640c35f0 con 0x7f13640c9d90 2023-07-21T19:09:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.170+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13640c35f0 con 0x7f13640c9d90 2023-07-21T19:09:08.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.174+0000 7f13597fa700 1 -- 172.21.15.123:0/109829255 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f13640c35f0 con 0x7f13640c9d90 2023-07-21T19:09:08.188 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:08.189 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.174+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13500662f0 msgr2=0x7f13500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.174+0000 7f1369d3e700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13500662f0 0x7f13500687a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f13640b2ee0 tx=0x7f1354008040 comp rx=0 tx=0).stop 2023-07-21T19:09:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.174+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 msgr2=0x7f13640c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.174+0000 7f1369d3e700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 0x7f13640c2050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f136000c4e0 tx=0x7f136000c8a0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 shutdown_connections 2023-07-21T19:09:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f13500662f0 0x7f13500687a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1364159f20 0x7f1364151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13640caf70 0x7f1364155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 --2- 172.21.15.123:0/109829255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13640c9d90 0x7f13640c2050 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 >> 172.21.15.123:0/109829255 conn(0x7f136406e960 msgr2=0x7f13640ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 shutdown_connections 2023-07-21T19:09:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.178+0000 7f1369d3e700 1 -- 172.21.15.123:0/109829255 wait complete. 2023-07-21T19:09:08.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:09:08.214 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:09:08.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.378+0000 7fe402101700 1 Processor -- start 2023-07-21T19:09:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.378+0000 7fe402101700 1 -- start start 2023-07-21T19:09:08.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.378+0000 7fe402101700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc15c1a0 0x7fe3fc0d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3fc0b1130 0x7fe3fc06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0b0ca0 con 0x7fe3fc0b4130 2023-07-21T19:09:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0d2530 con 0x7fe3fc0b1130 2023-07-21T19:09:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b03b0 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3fc0b1130 0x7fe3fc06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3fc0b1130 0x7fe3fc06fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40600/0 (socket says 172.21.15.123:40600) 2023-07-21T19:09:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 -- 172.21.15.123:0/504750931 learned_addr learned my addr 172.21.15.123:0/504750931 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3f3fff700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc15c1a0 0x7fe3fc0d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 -- 172.21.15.123:0/504750931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc15c1a0 msgr2=0x7fe3fc0d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc15c1a0 0x7fe3fc0d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 -- 172.21.15.123:0/504750931 >> v1:172.21.15.145:6789/0 conn(0x7fe3fc0b4130 legacy=0x7fe3fc0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:08.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 -- 172.21.15.123:0/504750931 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0b0650 con 0x7fe3fc0b1130 2023-07-21T19:09:08.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3f3fff700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc15c1a0 0x7fe3fc0d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:08.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3fbfff700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc0b1130 0x7fe3fc06fdd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009e50 tx=0x7fe3f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2c08b183301494 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3faffd700 1 -- 172.21.15.123:0/504750931 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400e070 con 0x7fe3fc0b1130 2023-07-21T19:09:08.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3faffd700 1 -- 172.21.15.123:0/504750931 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4003a40 con 0x7fe3fc0b1130 2023-07-21T19:09:08.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe3faffd700 1 -- 172.21.15.123:0/504750931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4003df0 con 0x7fe3fc0b1130 2023-07-21T19:09:08.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- 172.21.15.123:0/504750931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc0b1130 msgr2=0x7fe3fc06fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc0b1130 0x7fe3fc06fdd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009e50 tx=0x7fe3f400b330 comp rx=0 tx=0).stop 2023-07-21T19:09:08.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- 172.21.15.123:0/504750931 shutdown_connections 2023-07-21T19:09:08.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc0b1130 0x7fe3fc06fdd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 --2- 172.21.15.123:0/504750931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc15c1a0 0x7fe3fc0d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- 172.21.15.123:0/504750931 >> 172.21.15.123:0/504750931 conn(0x7fe3fc09ba10 msgr2=0x7fe3fc0d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- 172.21.15.123:0/504750931 shutdown_connections 2023-07-21T19:09:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.382+0000 7fe402101700 1 -- 172.21.15.123:0/504750931 wait complete. 2023-07-21T19:09:08.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.386+0000 7fe402101700 1 Processor -- start 2023-07-21T19:09:08.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.386+0000 7fe402101700 1 -- start start 2023-07-21T19:09:08.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc0b1130 0x7fe3fc15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc0b4130 0x7fe3fc0b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 0x7fe3fc158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15e0e0 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b6ab0 con 0x7fe3fc0b4130 2023-07-21T19:09:08.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc1f28f0 con 0x7fe3fc0b1130 2023-07-21T19:09:08.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 0x7fe3fc158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 0x7fe3fc158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40616/0 (socket says 172.21.15.123:40616) 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 -- 172.21.15.123:0/2723059677 learned_addr learned my addr 172.21.15.123:0/2723059677 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3f3fff700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc0b4130 0x7fe3fc0b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fb7fe700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc0b1130 0x7fe3fc15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 -- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc0b1130 msgr2=0x7fe3fc15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc0b1130 0x7fe3fc15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 -- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc0b4130 msgr2=0x7fe3fc0b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc0b4130 0x7fe3fc0b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 -- 172.21.15.123:0/2723059677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f4009b30 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fb7fe700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc0b1130 0x7fe3fc15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3fbfff700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 0x7fe3fc158a80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b730 tx=0x7fe3f4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40044c0 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4004620 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f401c440 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc158fc0 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.390+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc1f1e20 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.394+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc0b7410 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.394+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3f401c5a0 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.394+0000 7fe3f8ff9700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe3dc0662f0 0x7fe3dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.394+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe3f4085420 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.394+0000 7fe3fb7fe700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe3dc0662f0 0x7fe3dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.398+0000 7fe3fb7fe700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe3dc0662f0 0x7fe3dc0687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec007fd0 tx=0x7fe3ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.402+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe3f4052600 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.578+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3fc0d2ec0 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.582+0000 7fe3f8ff9700 1 -- 172.21.15.123:0/2723059677 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3f4055c20 con 0x7fe3fc15c1a0 2023-07-21T19:09:08.595 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:09:08.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe3dc0662f0 msgr2=0x7fe3dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe3dc0662f0 0x7fe3dc0687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec007fd0 tx=0x7fe3ec009040 comp rx=0 tx=0).stop 2023-07-21T19:09:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 msgr2=0x7fe3fc158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 0x7fe3fc158a80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b730 tx=0x7fe3f4004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 shutdown_connections 2023-07-21T19:09:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe3dc0662f0 0x7fe3dc0687a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc0b4130 0x7fe3fc0b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc15c1a0 0x7fe3fc158a80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 --2- 172.21.15.123:0/2723059677 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe3fc0b1130 0x7fe3fc15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 >> 172.21.15.123:0/2723059677 conn(0x7fe3fc09ba10 msgr2=0x7fe3fc0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 shutdown_connections 2023-07-21T19:09:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.586+0000 7fe402101700 1 -- 172.21.15.123:0/2723059677 wait complete. 2023-07-21T19:09:08.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:09:08.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.782+0000 7f03d9600700 1 Processor -- start 2023-07-21T19:09:08.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d9600700 1 -- start start 2023-07-21T19:09:08.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d9600700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f03d40ce2d0 0x7f03d4160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d9600700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d415fd90 con 0x7f03d4069ca0 2023-07-21T19:09:08.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d9600700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d415fa90 con 0x7f03d406e960 2023-07-21T19:09:08.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d9600700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d406ad90 con 0x7f03d40ce2d0 2023-07-21T19:09:08.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d2ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f03d4069ca0 0x7f03d406a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54816/0 (socket says 172.21.15.123:54816) 2023-07-21T19:09:08.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d2ffd700 1 -- 172.21.15.123:0/3415164203 learned_addr learned my addr 172.21.15.123:0/3415164203 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:08.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03cbfff700 1 --2- 172.21.15.123:0/3415164203 >> v2:172.21.15.145:3300/0 conn(0x7f03d40ce2d0 0x7f03d4160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d27fc700 1 -- 172.21.15.123:0/3415164203 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105750108 0 0) 0x7f03d415fd90 con 0x7f03d4069ca0 2023-07-21T19:09:08.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d27fc700 1 -- 172.21.15.123:0/3415164203 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c00035d0 con 0x7f03d4069ca0 2023-07-21T19:09:08.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03cbfff700 1 -- 172.21.15.123:0/3415164203 >> v1:172.21.15.145:6789/0 conn(0x7f03d406e960 legacy=0x7f03d415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03cbfff700 1 -- 172.21.15.123:0/3415164203 >> v1:172.21.15.123:6789/0 conn(0x7f03d4069ca0 legacy=0x7f03d406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03d27fc700 1 -- 172.21.15.123:0/3415164203 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22426873 0 0) 0x7f03c00035d0 con 0x7f03d4069ca0 2023-07-21T19:09:08.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03cbfff700 1 -- 172.21.15.123:0/3415164203 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40ce8b0 con 0x7f03d40ce2d0 2023-07-21T19:09:08.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.786+0000 7f03cbfff700 1 --2- 172.21.15.123:0/3415164203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d40ce2d0 0x7f03d4160220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009850 tx=0x7f03bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41051653e5e677ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d27fc700 1 -- 172.21.15.123:0/3415164203 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011830 con 0x7f03d40ce2d0 2023-07-21T19:09:08.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d27fc700 1 -- 172.21.15.123:0/3415164203 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc011990 con 0x7f03d40ce2d0 2023-07-21T19:09:08.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d27fc700 1 -- 172.21.15.123:0/3415164203 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011d40 con 0x7f03d40ce2d0 2023-07-21T19:09:08.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 -- 172.21.15.123:0/3415164203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d40ce2d0 msgr2=0x7f03d4160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 --2- 172.21.15.123:0/3415164203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d40ce2d0 0x7f03d4160220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009850 tx=0x7f03bc009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:08.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 -- 172.21.15.123:0/3415164203 shutdown_connections 2023-07-21T19:09:08.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 --2- 172.21.15.123:0/3415164203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d40ce2d0 0x7f03d4160220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 -- 172.21.15.123:0/3415164203 >> 172.21.15.123:0/3415164203 conn(0x7f03d406fa70 msgr2=0x7f03d406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:08.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 -- 172.21.15.123:0/3415164203 shutdown_connections 2023-07-21T19:09:08.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.790+0000 7f03d9600700 1 -- 172.21.15.123:0/3415164203 wait complete. 2023-07-21T19:09:08.807 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 Processor -- start 2023-07-21T19:09:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 -- start start 2023-07-21T19:09:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 0x7f03d4153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d406e960 0x7f03d415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03d40ce2d0 0x7f03d40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40ab8f0 con 0x7f03d4069ca0 2023-07-21T19:09:08.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40abb40 con 0x7f03d406e960 2023-07-21T19:09:08.810 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d9600700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40abe20 con 0x7f03d40ce2d0 2023-07-21T19:09:08.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 0x7f03d4153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 0x7f03d4153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40628/0 (socket says 172.21.15.123:40628) 2023-07-21T19:09:08.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 -- 172.21.15.123:0/1337193042 learned_addr learned my addr 172.21.15.123:0/1337193042 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:08.811 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03cbfff700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d406e960 0x7f03d415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d37fe700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03d40ce2d0 0x7f03d40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 -- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03d40ce2d0 msgr2=0x7f03d40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03d40ce2d0 0x7f03d40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 -- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d406e960 msgr2=0x7f03d415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d406e960 0x7f03d415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03d2ffd700 1 -- 172.21.15.123:0/1337193042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0094b0 con 0x7f03d4069ca0 2023-07-21T19:09:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.794+0000 7f03cbfff700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d406e960 0x7f03d415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03d2ffd700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 0x7f03d4153470 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f03c400c780 tx=0x7f03c400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4005d90 con 0x7f03d4069ca0 2023-07-21T19:09:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40070d0 con 0x7f03d4069ca0 2023-07-21T19:09:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40074c0 con 0x7f03d4069ca0 2023-07-21T19:09:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d40ac100 con 0x7f03d4069ca0 2023-07-21T19:09:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d40ac6c0 con 0x7f03d4069ca0 2023-07-21T19:09:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.798+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d404e500 con 0x7f03d4069ca0 2023-07-21T19:09:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.802+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03c4007620 con 0x7f03d4069ca0 2023-07-21T19:09:08.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.802+0000 7f03cb7fe700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f03b4066320 0x7f03b40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:08.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.802+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f03c4083710 con 0x7f03d4069ca0 2023-07-21T19:09:08.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.802+0000 7f03cbfff700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f03b4066320 0x7f03b40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:08.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.802+0000 7f03cbfff700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f03b4066320 0x7f03b40687d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0090b0 tx=0x7f03bc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:08.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.806+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f03c40507d0 con 0x7f03d4069ca0 2023-07-21T19:09:08.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.978+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03d40b1890 con 0x7f03d4069ca0 2023-07-21T19:09:08.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.982+0000 7f03cb7fe700 1 -- 172.21.15.123:0/1337193042 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03c4053df0 con 0x7f03d4069ca0 2023-07-21T19:09:08.995 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:09:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f03b4066320 msgr2=0x7f03b40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f03b4066320 0x7f03b40687d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0090b0 tx=0x7f03bc01c040 comp rx=0 tx=0).stop 2023-07-21T19:09:09.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 msgr2=0x7f03d4153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 0x7f03d4153470 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f03c400c780 tx=0x7f03c400cb40 comp rx=0 tx=0).stop 2023-07-21T19:09:09.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 shutdown_connections 2023-07-21T19:09:09.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f03b4066320 0x7f03b40687d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03d406e960 0x7f03d415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03d40ce2d0 0x7f03d40cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 --2- 172.21.15.123:0/1337193042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d4069ca0 0x7f03d4153470 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 >> 172.21.15.123:0/1337193042 conn(0x7f03d406fa70 msgr2=0x7f03d406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:09.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 shutdown_connections 2023-07-21T19:09:09.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:08.986+0000 7f03d9600700 1 -- 172.21.15.123:0/1337193042 wait complete. 2023-07-21T19:09:09.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:09:09.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.182+0000 7f3a57d08700 1 Processor -- start 2023-07-21T19:09:09.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.182+0000 7f3a57d08700 1 -- start start 2023-07-21T19:09:09.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a57d08700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3a500caef0 0x7f3a5006d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a57d08700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3a5006d7c0 0x7f3a5006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a57d08700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50069cd0 con 0x7f3a5006a6a0 2023-07-21T19:09:09.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a57d08700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500ccd30 con 0x7f3a500caef0 2023-07-21T19:09:09.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a57d08700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5006ded0 con 0x7f3a5006d7c0 2023-07-21T19:09:09.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a55aa4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3a500caef0 0x7f3a5006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a562a5700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3a5006a6a0 0x7f3a5006e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54826/0 (socket says 172.21.15.123:54826) 2023-07-21T19:09:09.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a562a5700 1 -- 172.21.15.123:0/3043844923 learned_addr learned my addr 172.21.15.123:0/3043844923 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:09.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a552a3700 1 --2- 172.21.15.123:0/3043844923 >> v2:172.21.15.145:3300/0 conn(0x7f3a5006d7c0 0x7f3a5006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3043844923 >> v2:172.21.15.145:3300/0 conn(0x7f3a5006d7c0 msgr2=0x7f3a5006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:09.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a55aa4700 1 --2- 172.21.15.123:0/3043844923 >> v2:172.21.15.145:3300/0 conn(0x7f3a5006d7c0 0x7f3a5006a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3043844923 >> v1:172.21.15.123:6789/0 conn(0x7f3a5006a6a0 legacy=0x7f3a5006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3043844923 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5006e1b0 con 0x7f3a500caef0 2023-07-21T19:09:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.186+0000 7f3a54aa2700 1 -- 172.21.15.123:0/3043844923 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904819513 0 0) 0x7f3a50069cd0 con 0x7f3a5006a6a0 2023-07-21T19:09:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a55aa4700 1 --2- 172.21.15.123:0/3043844923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a500caef0 0x7f3a5006d030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3a500c2e10 tx=0x7f3a4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8030751659ee6964 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a54aa2700 1 -- 172.21.15.123:0/3043844923 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00e070 con 0x7f3a500caef0 2023-07-21T19:09:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a54aa2700 1 -- 172.21.15.123:0/3043844923 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00bb20 con 0x7f3a500caef0 2023-07-21T19:09:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a54aa2700 1 -- 172.21.15.123:0/3043844923 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c012430 con 0x7f3a500caef0 2023-07-21T19:09:09.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 -- 172.21.15.123:0/3043844923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a500caef0 msgr2=0x7f3a5006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3043844923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a500caef0 0x7f3a5006d030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3a500c2e10 tx=0x7f3a4c00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:09.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 -- 172.21.15.123:0/3043844923 shutdown_connections 2023-07-21T19:09:09.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3043844923 >> v2:172.21.15.145:3300/0 conn(0x7f3a5006d7c0 0x7f3a5006a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3043844923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a500caef0 0x7f3a5006d030 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 -- 172.21.15.123:0/3043844923 >> 172.21.15.123:0/3043844923 conn(0x7f3a500706b0 msgr2=0x7f3a500cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:09.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 -- 172.21.15.123:0/3043844923 shutdown_connections 2023-07-21T19:09:09.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.190+0000 7f3a57d08700 1 -- 172.21.15.123:0/3043844923 wait complete. 2023-07-21T19:09:09.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 Processor -- start 2023-07-21T19:09:09.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 -- start start 2023-07-21T19:09:09.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 0x7f3a5014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a5006d7c0 0x7f3a5014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a500caef0 0x7f3a500abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014ddf0 con 0x7f3a5006a6a0 2023-07-21T19:09:09.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014ac10 con 0x7f3a500caef0 2023-07-21T19:09:09.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a57d08700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014cec0 con 0x7f3a5006d7c0 2023-07-21T19:09:09.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 0x7f3a5014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 0x7f3a5014ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40652/0 (socket says 172.21.15.123:40652) 2023-07-21T19:09:09.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3099833728 learned_addr learned my addr 172.21.15.123:0/3099833728 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:09.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a552a3700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a5006d7c0 0x7f3a5014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a562a5700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a500caef0 0x7f3a500abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a5006d7c0 msgr2=0x7f3a5014a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a5006d7c0 0x7f3a5014a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a500caef0 msgr2=0x7f3a500abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a500caef0 0x7f3a500abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 -- 172.21.15.123:0/3099833728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c009a70 con 0x7f3a5006a6a0 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a552a3700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a5006d7c0 0x7f3a5014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:09.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a55aa4700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 0x7f3a5014ae90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b680 tx=0x7f3a4c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:09.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.194+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c012430 con 0x7f3a5006a6a0 2023-07-21T19:09:09.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.198+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c020070 con 0x7f3a5006a6a0 2023-07-21T19:09:09.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.198+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c004280 con 0x7f3a5006a6a0 2023-07-21T19:09:09.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.198+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5014d170 con 0x7f3a5006a6a0 2023-07-21T19:09:09.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.198+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5014d730 con 0x7f3a5006a6a0 2023-07-21T19:09:09.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.198+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5004dcb0 con 0x7f3a5006a6a0 2023-07-21T19:09:09.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.198+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a4c0043e0 con 0x7f3a5006a6a0 2023-07-21T19:09:09.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.202+0000 7f3a467fc700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3a34066320 0x7f3a340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.202+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3a4c022070 con 0x7f3a5006a6a0 2023-07-21T19:09:09.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.202+0000 7f3a552a3700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3a34066320 0x7f3a340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.202+0000 7f3a552a3700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3a34066320 0x7f3a340687d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009c40 tx=0x7f3a40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:09.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.206+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3a4c052e70 con 0x7f3a5006a6a0 2023-07-21T19:09:09.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.382+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a500b5430 con 0x7f3a5006a6a0 2023-07-21T19:09:09.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.382+0000 7f3a467fc700 1 -- 172.21.15.123:0/3099833728 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a4c056490 con 0x7f3a5006a6a0 2023-07-21T19:09:09.398 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:09.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3a34066320 msgr2=0x7f3a340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3a34066320 0x7f3a340687d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009c40 tx=0x7f3a40008040 comp rx=0 tx=0).stop 2023-07-21T19:09:09.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 msgr2=0x7f3a5014ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 0x7f3a5014ae90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b680 tx=0x7f3a4c004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 shutdown_connections 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f3a34066320 0x7f3a340687d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a500caef0 0x7f3a500abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a5006d7c0 0x7f3a5014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 --2- 172.21.15.123:0/3099833728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a5006a6a0 0x7f3a5014ae90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 >> 172.21.15.123:0/3099833728 conn(0x7f3a500706b0 msgr2=0x7f3a5006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:09.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 shutdown_connections 2023-07-21T19:09:09.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.386+0000 7f3a57d08700 1 -- 172.21.15.123:0/3099833728 wait complete. 2023-07-21T19:09:09.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:09:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.582+0000 7fa8a188c700 1 Processor -- start 2023-07-21T19:09:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.582+0000 7fa8a188c700 1 -- start start 2023-07-21T19:09:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a188c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa89c06fa70 0x7fa89c06fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a188c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa89c15c0c0 0x7fa89c069950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a188c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c0af510 0x7fa89c069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a188c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0ad890 con 0x7fa89c06fa70 2023-07-21T19:09:09.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a188c700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0acf30 con 0x7fa89c15c0c0 2023-07-21T19:09:09.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a188c700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c070380 con 0x7fa89c0af510 2023-07-21T19:09:09.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa89c06fa70 0x7fa89c06fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa89c06fa70 0x7fa89c06fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40656/0 (socket says 172.21.15.123:40656) 2023-07-21T19:09:09.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 -- 172.21.15.123:0/1246882872 learned_addr learned my addr 172.21.15.123:0/1246882872 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa893fff700 1 --2- 172.21.15.123:0/1246882872 >> v2:172.21.15.145:3300/0 conn(0x7fa89c15c0c0 0x7fa89c069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a108b700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c0af510 0x7fa89c069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 -- 172.21.15.123:0/1246882872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c0af510 msgr2=0x7fa89c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c0af510 0x7fa89c069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 -- 172.21.15.123:0/1246882872 >> v2:172.21.15.145:3300/0 conn(0x7fa89c15c0c0 msgr2=0x7fa89c069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 --2- 172.21.15.123:0/1246882872 >> v2:172.21.15.145:3300/0 conn(0x7fa89c15c0c0 0x7fa89c069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 -- 172.21.15.123:0/1246882872 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c06b370 con 0x7fa89c06fa70 2023-07-21T19:09:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a108b700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c0af510 0x7fa89c069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8a088a700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c06fa70 0x7fa89c06fe40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0b63b0 tx=0x7fa89800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a69f2f979f79e05 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.586+0000 7fa8937fe700 1 -- 172.21.15.123:0/1246882872 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800e070 con 0x7fa89c06fa70 2023-07-21T19:09:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8937fe700 1 -- 172.21.15.123:0/1246882872 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8980090d0 con 0x7fa89c06fa70 2023-07-21T19:09:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8937fe700 1 -- 172.21.15.123:0/1246882872 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800bb50 con 0x7fa89c06fa70 2023-07-21T19:09:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 -- 172.21.15.123:0/1246882872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c06fa70 msgr2=0x7fa89c06fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c06fa70 0x7fa89c06fe40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0b63b0 tx=0x7fa89800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 -- 172.21.15.123:0/1246882872 shutdown_connections 2023-07-21T19:09:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c0af510 0x7fa89c069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 --2- 172.21.15.123:0/1246882872 >> v2:172.21.15.145:3300/0 conn(0x7fa89c15c0c0 0x7fa89c069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 --2- 172.21.15.123:0/1246882872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c06fa70 0x7fa89c06fe40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 -- 172.21.15.123:0/1246882872 >> 172.21.15.123:0/1246882872 conn(0x7fa89c0d0300 msgr2=0x7fa89c0d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 -- 172.21.15.123:0/1246882872 shutdown_connections 2023-07-21T19:09:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.590+0000 7fa8a188c700 1 -- 172.21.15.123:0/1246882872 wait complete. 2023-07-21T19:09:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 Processor -- start 2023-07-21T19:09:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 -- start start 2023-07-21T19:09:09.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa89c06fa70 0x7fa89c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 0x7fa89c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c15c0c0 0x7fa89c1f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f1fa0 con 0x7fa89c0af510 2023-07-21T19:09:09.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f19e0 con 0x7fa89c06fa70 2023-07-21T19:09:09.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a188c700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f1cc0 con 0x7fa89c15c0c0 2023-07-21T19:09:09.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa893fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 0x7fa89c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa893fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 0x7fa89c0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40664/0 (socket says 172.21.15.123:40664) 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa893fff700 1 -- 172.21.15.123:0/4070314697 learned_addr learned my addr 172.21.15.123:0/4070314697 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a088a700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa89c06fa70 0x7fa89c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.594+0000 7fa8a108b700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c15c0c0 0x7fa89c1f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa893fff700 1 -- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c15c0c0 msgr2=0x7fa89c1f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa893fff700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c15c0c0 0x7fa89c1f1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa893fff700 1 -- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa89c06fa70 msgr2=0x7fa89c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa893fff700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa89c06fa70 0x7fa89c158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa893fff700 1 -- 172.21.15.123:0/4070314697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009b30 con 0x7fa89c0af510 2023-07-21T19:09:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8a088a700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa89c06fa70 0x7fa89c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa893fff700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 0x7fa89c0c7d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00e9d0 tx=0x7fa88c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c009720 con 0x7fa89c0af510 2023-07-21T19:09:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c00c850 con 0x7fa89c0af510 2023-07-21T19:09:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0c7500 con 0x7fa89c0af510 2023-07-21T19:09:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00cbc0 con 0x7fa89c0af510 2023-07-21T19:09:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c0c8240 con 0x7fa89c0af510 2023-07-21T19:09:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.598+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c04e500 con 0x7fa89c0af510 2023-07-21T19:09:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.602+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa88c00cd20 con 0x7fa89c0af510 2023-07-21T19:09:09.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.602+0000 7fa8917fa700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa888066320 0x7fa8880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:09.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.602+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa88c084140 con 0x7fa89c0af510 2023-07-21T19:09:09.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.602+0000 7fa8a088a700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa888066320 0x7fa8880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:09.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.602+0000 7fa8a088a700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa888066320 0x7fa8880687d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa898000f80 tx=0x7fa898009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.606+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa88c054d10 con 0x7fa89c0af510 2023-07-21T19:09:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.778+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa89c071360 con 0x7fa89c0af510 2023-07-21T19:09:09.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.782+0000 7fa8917fa700 1 -- 172.21.15.123:0/4070314697 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa88c0548a0 con 0x7fa89c0af510 2023-07-21T19:09:09.797 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:09:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa888066320 msgr2=0x7fa8880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa888066320 0x7fa8880687d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa898000f80 tx=0x7fa898009000 comp rx=0 tx=0).stop 2023-07-21T19:09:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 msgr2=0x7fa89c0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 0x7fa89c0c7d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00e9d0 tx=0x7fa88c00ed90 comp rx=0 tx=0).stop 2023-07-21T19:09:09.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 shutdown_connections 2023-07-21T19:09:09.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa888066320 0x7fa8880687d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa89c15c0c0 0x7fa89c1f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89c0af510 0x7fa89c0c7d00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 --2- 172.21.15.123:0/4070314697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa89c06fa70 0x7fa89c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:09.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 >> 172.21.15.123:0/4070314697 conn(0x7fa89c0d0300 msgr2=0x7fa89c0b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:09.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 shutdown_connections 2023-07-21T19:09:09.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.786+0000 7fa8a188c700 1 -- 172.21.15.123:0/4070314697 wait complete. 2023-07-21T19:09:09.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:09:10.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 Processor -- start 2023-07-21T19:09:10.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 -- start start 2023-07-21T19:09:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d2c06bdd0 0x7f6d2c0705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6d2c070b20 0x7f6d2c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c070f60 con 0x7f6d2c158360 2023-07-21T19:09:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0cbdc0 con 0x7f6d2c06bdd0 2023-07-21T19:09:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.986+0000 7f6d2b59e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0cc0a0 con 0x7f6d2c070b20 2023-07-21T19:09:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2a59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6d2c158360 0x7f6d2c071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54836/0 (socket says 172.21.15.123:54836) 2023-07-21T19:09:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2a59c700 1 -- 172.21.15.123:0/43877208 learned_addr learned my addr 172.21.15.123:0/43877208 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d29d9b700 1 --2- 172.21.15.123:0/43877208 >> v2:172.21.15.123:3300/0 conn(0x7f6d2c06bdd0 0x7f6d2c0705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2ad9d700 1 --2- 172.21.15.123:0/43877208 >> v2:172.21.15.145:3300/0 conn(0x7f6d2c070b20 0x7f6d2c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2959a700 1 -- 172.21.15.123:0/43877208 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114201206 0 0) 0x7f6d2c070f60 con 0x7f6d2c158360 2023-07-21T19:09:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2959a700 1 -- 172.21.15.123:0/43877208 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d140057e0 con 0x7f6d2c158360 2023-07-21T19:09:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d29d9b700 1 -- 172.21.15.123:0/43877208 >> v2:172.21.15.145:3300/0 conn(0x7f6d2c070b20 msgr2=0x7f6d2c0cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d29d9b700 1 --2- 172.21.15.123:0/43877208 >> v2:172.21.15.145:3300/0 conn(0x7f6d2c070b20 0x7f6d2c0cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d29d9b700 1 -- 172.21.15.123:0/43877208 >> v1:172.21.15.123:6789/0 conn(0x7f6d2c158360 legacy=0x7f6d2c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d29d9b700 1 -- 172.21.15.123:0/43877208 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0cc380 con 0x7f6d2c06bdd0 2023-07-21T19:09:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d29d9b700 1 --2- 172.21.15.123:0/43877208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c0705e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0b0870 tx=0x7f6d20009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27241158c589b8a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2959a700 1 -- 172.21.15.123:0/43877208 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20011830 con 0x7f6d2c06bdd0 2023-07-21T19:09:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2959a700 1 -- 172.21.15.123:0/43877208 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20011990 con 0x7f6d2c06bdd0 2023-07-21T19:09:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2959a700 1 -- 172.21.15.123:0/43877208 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20011d20 con 0x7f6d2c06bdd0 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 -- 172.21.15.123:0/43877208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c06bdd0 msgr2=0x7f6d2c0705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/43877208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c0705e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0b0870 tx=0x7f6d20009b30 comp rx=0 tx=0).stop 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 -- 172.21.15.123:0/43877208 shutdown_connections 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/43877208 >> v2:172.21.15.145:3300/0 conn(0x7f6d2c070b20 0x7f6d2c0cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/43877208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c0705e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 -- 172.21.15.123:0/43877208 >> 172.21.15.123:0/43877208 conn(0x7f6d2c0afc60 msgr2=0x7f6d2c0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 -- 172.21.15.123:0/43877208 shutdown_connections 2023-07-21T19:09:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.990+0000 7f6d2b59e700 1 -- 172.21.15.123:0/43877208 wait complete. 2023-07-21T19:09:10.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.994+0000 7f6d2b59e700 1 Processor -- start 2023-07-21T19:09:10.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.994+0000 7f6d2b59e700 1 -- start start 2023-07-21T19:09:10.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d2c070b20 0x7f6d2c143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 0x7f6d2c143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c1e35a0 con 0x7f6d2c158360 2023-07-21T19:09:10.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c1e2660 con 0x7f6d2c06bdd0 2023-07-21T19:09:10.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c1e2920 con 0x7f6d2c070b20 2023-07-21T19:09:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 0x7f6d2c143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2a59c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 0x7f6d2c143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40684/0 (socket says 172.21.15.123:40684) 2023-07-21T19:09:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2a59c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:52288/0 (socket says 172.21.15.123:52288) 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 -- 172.21.15.123:0/2335196470 learned_addr learned my addr 172.21.15.123:0/2335196470 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d29d9b700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d2c070b20 0x7f6d2c143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 -- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d2c070b20 msgr2=0x7f6d2c143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d2c070b20 0x7f6d2c143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 -- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d2c06bdd0 msgr2=0x7f6d2c151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 -- 172.21.15.123:0/2335196470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200094b0 con 0x7f6d2c158360 2023-07-21T19:09:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2ad9d700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 0x7f6d2c143760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400efc0 tx=0x7f6d2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24009ea0 con 0x7f6d2c158360 2023-07-21T19:09:10.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2400f040 con 0x7f6d2c158360 2023-07-21T19:09:10.015 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400ced0 con 0x7f6d2c158360 2023-07-21T19:09:10.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c1e2c00 con 0x7f6d2c158360 2023-07-21T19:09:10.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:09.998+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c1e31c0 con 0x7f6d2c158360 2023-07-21T19:09:10.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.002+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c1e36e0 con 0x7f6d2c158360 2023-07-21T19:09:10.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.002+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d24014480 con 0x7f6d2c158360 2023-07-21T19:09:10.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.006+0000 7f6d1affd700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6d0c0662f0 0x7f6d0c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.006+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d24084930 con 0x7f6d2c158360 2023-07-21T19:09:10.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.006+0000 7f6d2a59c700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6d0c0662f0 0x7f6d0c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.006+0000 7f6d2a59c700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6d0c0662f0 0x7f6d0c0687a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c007fd0 tx=0x7f6d1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.010+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6d2c1e36e0 con 0x7f6d2c158360 2023-07-21T19:09:10.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6d2c1e36e0 con 0x7f6d2c158360 2023-07-21T19:09:10.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d1affd700 1 -- 172.21.15.123:0/2335196470 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6d2c1e36e0 con 0x7f6d2c158360 2023-07-21T19:09:10.192 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:10.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6d0c0662f0 msgr2=0x7f6d0c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6d0c0662f0 0x7f6d0c0687a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c007fd0 tx=0x7f6d1c009040 comp rx=0 tx=0).stop 2023-07-21T19:09:10.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 msgr2=0x7f6d2c143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 0x7f6d2c143760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400efc0 tx=0x7f6d2400c3a0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 shutdown_connections 2023-07-21T19:09:10.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6d0c0662f0 0x7f6d0c0687a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2c158360 0x7f6d2c143760 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d2c070b20 0x7f6d2c143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 --2- 172.21.15.123:0/2335196470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d2c06bdd0 0x7f6d2c151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.178+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 >> 172.21.15.123:0/2335196470 conn(0x7f6d2c0afc60 msgr2=0x7f6d2c0aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:10.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.182+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 shutdown_connections 2023-07-21T19:09:10.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.182+0000 7f6d2b59e700 1 -- 172.21.15.123:0/2335196470 wait complete. 2023-07-21T19:09:10.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T19:09:10.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 Processor -- start 2023-07-21T19:09:10.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 -- start start 2023-07-21T19:09:10.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fddf0158710 0x7fddf00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fddf006a220 0x7fddf006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf006ab80 con 0x7fddf015c3e0 2023-07-21T19:09:10.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf015d3d0 con 0x7fddf0158710 2023-07-21T19:09:10.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddf5781700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf00cdf70 con 0x7fddf006a220 2023-07-21T19:09:10.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddeeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fddf0158710 0x7fddf00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddeeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fddf0158710 0x7fddf00cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40696/0 (socket says 172.21.15.123:40696) 2023-07-21T19:09:10.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddee7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fddf015c3e0 0x7fddf0159fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54850/0 (socket says 172.21.15.123:54850) 2023-07-21T19:09:10.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddeeffd700 1 -- 172.21.15.123:0/2067164945 learned_addr learned my addr 172.21.15.123:0/2067164945 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:10.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.378+0000 7fddef7fe700 1 --2- 172.21.15.123:0/2067164945 >> v2:172.21.15.145:3300/0 conn(0x7fddf006a220 0x7fddf006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddeeffd700 1 -- 172.21.15.123:0/2067164945 >> v2:172.21.15.145:3300/0 conn(0x7fddf006a220 msgr2=0x7fddf006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:10.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddeeffd700 1 --2- 172.21.15.123:0/2067164945 >> v2:172.21.15.145:3300/0 conn(0x7fddf006a220 0x7fddf006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddeeffd700 1 -- 172.21.15.123:0/2067164945 >> v1:172.21.15.123:6789/0 conn(0x7fddf015c3e0 legacy=0x7fddf0159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddeeffd700 1 -- 172.21.15.123:0/2067164945 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf015c860 con 0x7fddf0158710 2023-07-21T19:09:10.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddef7fe700 1 --2- 172.21.15.123:0/2067164945 >> v2:172.21.15.145:3300/0 conn(0x7fddf006a220 0x7fddf006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:10.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddeeffd700 1 --2- 172.21.15.123:0/2067164945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf0158710 0x7fddf00cda30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fddf00c2c70 tx=0x7fdde000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7989ebd4b58e313 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddedffb700 1 -- 172.21.15.123:0/2067164945 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde000dd90 con 0x7fddf0158710 2023-07-21T19:09:10.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddedffb700 1 -- 172.21.15.123:0/2067164945 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0010470 con 0x7fddf0158710 2023-07-21T19:09:10.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddedffb700 1 -- 172.21.15.123:0/2067164945 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0010800 con 0x7fddf0158710 2023-07-21T19:09:10.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 -- 172.21.15.123:0/2067164945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf0158710 msgr2=0x7fddf00cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 --2- 172.21.15.123:0/2067164945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf0158710 0x7fddf00cda30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fddf00c2c70 tx=0x7fdde000be90 comp rx=0 tx=0).stop 2023-07-21T19:09:10.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 -- 172.21.15.123:0/2067164945 shutdown_connections 2023-07-21T19:09:10.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 --2- 172.21.15.123:0/2067164945 >> v2:172.21.15.145:3300/0 conn(0x7fddf006a220 0x7fddf006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 --2- 172.21.15.123:0/2067164945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf0158710 0x7fddf00cda30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 -- 172.21.15.123:0/2067164945 >> 172.21.15.123:0/2067164945 conn(0x7fddf00b0ce0 msgr2=0x7fddf00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:10.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 -- 172.21.15.123:0/2067164945 shutdown_connections 2023-07-21T19:09:10.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.382+0000 7fddf5781700 1 -- 172.21.15.123:0/2067164945 wait complete. 2023-07-21T19:09:10.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 Processor -- start 2023-07-21T19:09:10.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 -- start start 2023-07-21T19:09:10.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 0x7fddf01f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf0158710 0x7fddf0156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf015c3e0 0x7fddf00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01f4450 con 0x7fddf006a220 2023-07-21T19:09:10.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf00cb860 con 0x7fddf015c3e0 2023-07-21T19:09:10.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01f1570 con 0x7fddf0158710 2023-07-21T19:09:10.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 0x7fddf01f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 0x7fddf01f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40700/0 (socket says 172.21.15.123:40700) 2023-07-21T19:09:10.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 -- 172.21.15.123:0/16677125 learned_addr learned my addr 172.21.15.123:0/16677125 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:10.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddef7fe700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf015c3e0 0x7fddf00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 -- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf0158710 msgr2=0x7fddf0156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf0158710 0x7fddf0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 -- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf015c3e0 msgr2=0x7fddf00b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf015c3e0 0x7fddf00b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 -- 172.21.15.123:0/16677125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde000b810 con 0x7fddf006a220 2023-07-21T19:09:10.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddeeffd700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 0x7fddf01f1030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdde0000c00 tx=0x7fdde0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0003c90 con 0x7fddf006a220 2023-07-21T19:09:10.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0003e10 con 0x7fddf006a220 2023-07-21T19:09:10.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf00caec0 con 0x7fddf006a220 2023-07-21T19:09:10.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0010820 con 0x7fddf006a220 2023-07-21T19:09:10.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.386+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf00cb480 con 0x7fddf006a220 2023-07-21T19:09:10.408 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.390+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf00cb9a0 con 0x7fddf006a220 2023-07-21T19:09:10.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.390+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdde002a430 con 0x7fddf006a220 2023-07-21T19:09:10.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.394+0000 7fddd77fe700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdddc0662f0 0x7fdddc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.394+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdde0085240 con 0x7fddf006a220 2023-07-21T19:09:10.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.394+0000 7fddee7fc700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdddc0662f0 0x7fdddc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.394+0000 7fddee7fc700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdddc0662f0 0x7fdddc0687a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fddf00b5100 tx=0x7fdde4007a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.398+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fddf00cb9a0 con 0x7fddf006a220 2023-07-21T19:09:10.597 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.582+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fddf00cb9a0 con 0x7fddf006a220 2023-07-21T19:09:10.598 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.582+0000 7fddd77fe700 1 -- 172.21.15.123:0/16677125 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fddf00cb9a0 con 0x7fddf006a220 2023-07-21T19:09:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdddc0662f0 msgr2=0x7fdddc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdddc0662f0 0x7fdddc0687a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fddf00b5100 tx=0x7fdde4007a70 comp rx=0 tx=0).stop 2023-07-21T19:09:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 msgr2=0x7fddf01f1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 0x7fddf01f1030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdde0000c00 tx=0x7fdde0004770 comp rx=0 tx=0).stop 2023-07-21T19:09:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 shutdown_connections 2023-07-21T19:09:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fdddc0662f0 0x7fdddc0687a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf015c3e0 0x7fddf00b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf0158710 0x7fddf0156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 --2- 172.21.15.123:0/16677125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf006a220 0x7fddf01f1030 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 >> 172.21.15.123:0/16677125 conn(0x7fddf00b0ce0 msgr2=0x7fddf00c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 shutdown_connections 2023-07-21T19:09:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.586+0000 7fddf5781700 1 -- 172.21.15.123:0/16677125 wait complete. 2023-07-21T19:09:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-07-21T19:09:10.622 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi145.front.sepia.ceph.com... 2023-07-21T19:09:10.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:10.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-07-21T19:09:10.662 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:09:10.662 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T19:09:10.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:10.663 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-21T19:09:10.724 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T19:09:10.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:09:10.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f62f69700 1 Processor -- start 2023-07-21T19:09:10.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f62f69700 1 -- start start 2023-07-21T19:09:10.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f62f69700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f62f69700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0cc1b0 con 0x7f2f5c06be70 2023-07-21T19:09:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f62f69700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0cd690 con 0x7f2f5c06d860 2023-07-21T19:09:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f62f69700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0c2510 con 0x7f2f5c0cb840 2023-07-21T19:09:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f5bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2f5c06be70 0x7f2f5c0c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54852/0 (socket says 172.21.15.123:54852) 2023-07-21T19:09:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f5bfff700 1 -- 172.21.15.123:0/39289719 learned_addr learned my addr 172.21.15.123:0/39289719 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f61506700 1 --2- 172.21.15.123:0/39289719 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241903873 0 0) 0x7f2f5c0cc1b0 con 0x7f2f5c06be70 2023-07-21T19:09:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.890+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f4c0035d0 con 0x7f2f5c06be70 2023-07-21T19:09:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807117220 0 0) 0x7f2f5c0cd690 con 0x7f2f5c06d860 2023-07-21T19:09:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5c0cc1b0 con 0x7f2f5c06d860 2023-07-21T19:09:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f61506700 1 -- 172.21.15.123:0/39289719 >> v1:172.21.15.145:6789/0 conn(0x7f2f5c06d860 legacy=0x7f2f5c06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f61506700 1 -- 172.21.15.123:0/39289719 >> v1:172.21.15.123:6789/0 conn(0x7f2f5c06be70 legacy=0x7f2f5c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f61506700 1 -- 172.21.15.123:0/39289719 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0cd970 con 0x7f2f5c0cb840 2023-07-21T19:09:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f61506700 1 --2- 172.21.15.123:0/39289719 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0cc640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009dc0 tx=0x7f2f5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be208f119eb3d19 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400e070 con 0x7f2f5c0cb840 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400bb20 con 0x7f2f5c0cb840 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f5b7fe700 1 -- 172.21.15.123:0/39289719 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54012430 con 0x7f2f5c0cb840 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 -- 172.21.15.123:0/39289719 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 msgr2=0x7f2f5c0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 --2- 172.21.15.123:0/39289719 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0cc640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009dc0 tx=0x7f2f5400b330 comp rx=0 tx=0).stop 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 -- 172.21.15.123:0/39289719 shutdown_connections 2023-07-21T19:09:10.910 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 --2- 172.21.15.123:0/39289719 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0cc640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 -- 172.21.15.123:0/39289719 >> 172.21.15.123:0/39289719 conn(0x7f2f5c0cad30 msgr2=0x7f2f5c0cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:10.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 -- 172.21.15.123:0/39289719 shutdown_connections 2023-07-21T19:09:10.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.894+0000 7f2f62f69700 1 -- 172.21.15.123:0/39289719 wait complete. 2023-07-21T19:09:10.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.898+0000 7f2f62f69700 1 Processor -- start 2023-07-21T19:09:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.898+0000 7f2f62f69700 1 -- start start 2023-07-21T19:09:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.898+0000 7f2f62f69700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f5c06be70 0x7f2f5c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.898+0000 7f2f62f69700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 0x7f2f5c148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0b3010 con 0x7f2f5c06d860 2023-07-21T19:09:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0b2750 con 0x7f2f5c06be70 2023-07-21T19:09:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c149450 con 0x7f2f5c0cb840 2023-07-21T19:09:10.916 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 0x7f2f5c148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 0x7f2f5c148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40710/0 (socket says 172.21.15.123:40710) 2023-07-21T19:09:10.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 -- 172.21.15.123:0/2977473694 learned_addr learned my addr 172.21.15.123:0/2977473694 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:10.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f60d05700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f5c06be70 0x7f2f5c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f61506700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 -- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 msgr2=0x7f2f5c0b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 -- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f5c06be70 msgr2=0x7f2f5c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f5c06be70 0x7f2f5c148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 -- 172.21.15.123:0/2977473694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009a70 con 0x7f2f5c06d860 2023-07-21T19:09:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f61506700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f5bfff700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 0x7f2f5c148660 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800c5c0 tx=0x7f2f4800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48005d90 con 0x7f2f5c06d860 2023-07-21T19:09:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480070d0 con 0x7f2f5c06d860 2023-07-21T19:09:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c0b29c0 con 0x7f2f5c06d860 2023-07-21T19:09:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48007460 con 0x7f2f5c06d860 2023-07-21T19:09:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c148ba0 con 0x7f2f5c06d860 2023-07-21T19:09:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.902+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c0b31c0 con 0x7f2f5c06d860 2023-07-21T19:09:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.906+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f480075c0 con 0x7f2f5c06d860 2023-07-21T19:09:10.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.906+0000 7f2f597fa700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f400662f0 0x7f2f400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:10.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.906+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f480835c0 con 0x7f2f5c06d860 2023-07-21T19:09:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.906+0000 7f2f60d05700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f400662f0 0x7f2f400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.910+0000 7f2f60d05700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f400662f0 0x7f2f400687a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f50007fd0 tx=0x7f2f50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:10.914+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2f48050710 con 0x7f2f5c06d860 2023-07-21T19:09:11.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.118+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f5c04dcb0 con 0x7f2f5c06d860 2023-07-21T19:09:11.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.122+0000 7f2f597fa700 1 -- 172.21.15.123:0/2977473694 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f2f48053d30 con 0x7f2f5c06d860 2023-07-21T19:09:11.136 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:11.136 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:09:11.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.122+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f400662f0 msgr2=0x7f2f400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.122+0000 7f2f62f69700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f400662f0 0x7f2f400687a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f50007fd0 tx=0x7f2f50009040 comp rx=0 tx=0).stop 2023-07-21T19:09:11.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.122+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 msgr2=0x7f2f5c148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.122+0000 7f2f62f69700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 0x7f2f5c148660 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800c5c0 tx=0x7f2f4800c980 comp rx=0 tx=0).stop 2023-07-21T19:09:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 shutdown_connections 2023-07-21T19:09:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2f400662f0 0x7f2f400687a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f5c0cb840 0x7f2f5c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5c06d860 0x7f2f5c148660 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 --2- 172.21.15.123:0/2977473694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f5c06be70 0x7f2f5c148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 >> 172.21.15.123:0/2977473694 conn(0x7f2f5c0cad30 msgr2=0x7f2f5c0c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:11.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 shutdown_connections 2023-07-21T19:09:11.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.126+0000 7f2f62f69700 1 -- 172.21.15.123:0/2977473694 wait complete. 2023-07-21T19:09:11.141 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:09:11.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:11.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 Processor -- start 2023-07-21T19:09:11.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 -- start start 2023-07-21T19:09:11.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f622c0c9d90 0x7f622c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c0b0ef0 con 0x7f622c0caf70 2023-07-21T19:09:11.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c0ce9c0 con 0x7f622c0c9d90 2023-07-21T19:09:11.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.318+0000 7f6231f64700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0cee50 con 0x7f622c159f20 2023-07-21T19:09:11.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f622c0c9d90 0x7f622c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f622c0c9d90 0x7f622c0ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40718/0 (socket says 172.21.15.123:40718) 2023-07-21T19:09:11.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 -- 172.21.15.123:0/2857093930 learned_addr learned my addr 172.21.15.123:0/2857093930 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:11.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231763700 1 --1- 172.21.15.123:0/2857093930 >> v1:172.21.15.145:6789/0 conn(0x7f622c0caf70 0x7f622c0c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:45376/0 (socket says 172.21.15.123:45376) 2023-07-21T19:09:11.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6223fff700 1 --2- 172.21.15.123:0/2857093930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 -- 172.21.15.123:0/2857093930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 msgr2=0x7f622c0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:11.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 --2- 172.21.15.123:0/2857093930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 -- 172.21.15.123:0/2857093930 >> v1:172.21.15.145:6789/0 conn(0x7f622c0caf70 legacy=0x7f622c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 -- 172.21.15.123:0/2857093930 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0ca6a0 con 0x7f622c0c9d90 2023-07-21T19:09:11.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f62237fe700 1 -- 172.21.15.123:0/2857093930 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512754047 0 0) 0x7f622c0b0ef0 con 0x7f622c0caf70 2023-07-21T19:09:11.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6230f62700 1 --2- 172.21.15.123:0/2857093930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c0ca160 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6228009910 tx=0x7f6228009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a7682bcab60f71 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:11.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f62237fe700 1 -- 172.21.15.123:0/2857093930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228011830 con 0x7f622c0c9d90 2023-07-21T19:09:11.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f62237fe700 1 -- 172.21.15.123:0/2857093930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228011990 con 0x7f622c0c9d90 2023-07-21T19:09:11.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f62237fe700 1 -- 172.21.15.123:0/2857093930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228011d40 con 0x7f622c0c9d90 2023-07-21T19:09:11.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 -- 172.21.15.123:0/2857093930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 msgr2=0x7f622c0ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 --2- 172.21.15.123:0/2857093930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c0ca160 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6228009910 tx=0x7f6228009c20 comp rx=0 tx=0).stop 2023-07-21T19:09:11.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 -- 172.21.15.123:0/2857093930 shutdown_connections 2023-07-21T19:09:11.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 --2- 172.21.15.123:0/2857093930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 --2- 172.21.15.123:0/2857093930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c0ca160 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 -- 172.21.15.123:0/2857093930 >> 172.21.15.123:0/2857093930 conn(0x7f622c06e960 msgr2=0x7f622c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:11.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 -- 172.21.15.123:0/2857093930 shutdown_connections 2023-07-21T19:09:11.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.322+0000 7f6231f64700 1 -- 172.21.15.123:0/2857093930 wait complete. 2023-07-21T19:09:11.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.326+0000 7f6231f64700 1 Processor -- start 2023-07-21T19:09:11.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.326+0000 7f6231f64700 1 -- start start 2023-07-21T19:09:11.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622c0caf70 0x7f622c0c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c152fd0 con 0x7f622c0c9d90 2023-07-21T19:09:11.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0c2d30 con 0x7f622c0caf70 2023-07-21T19:09:11.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c157070 con 0x7f622c159f20 2023-07-21T19:09:11.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40734/0 (socket says 172.21.15.123:40734) 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 -- 172.21.15.123:0/922212279 learned_addr learned my addr 172.21.15.123:0/922212279 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6223fff700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622c0caf70 0x7f622c0c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231763700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 -- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 msgr2=0x7f622c1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 -- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622c0caf70 msgr2=0x7f622c0c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622c0caf70 0x7f622c0c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 -- 172.21.15.123:0/922212279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228009570 con 0x7f622c0c9d90 2023-07-21T19:09:11.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6230f62700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c152a90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6228014040 tx=0x7f6228004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:11.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800ba70 con 0x7f622c0c9d90 2023-07-21T19:09:11.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622801e070 con 0x7f622c0c9d90 2023-07-21T19:09:11.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800be50 con 0x7f622c0c9d90 2023-07-21T19:09:11.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c0c2490 con 0x7f622c0c9d90 2023-07-21T19:09:11.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.330+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c0c2a50 con 0x7f622c0c9d90 2023-07-21T19:09:11.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.334+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c156e20 con 0x7f622c0c9d90 2023-07-21T19:09:11.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.334+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f622801a420 con 0x7f622c0c9d90 2023-07-21T19:09:11.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.338+0000 7f62217fa700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f62180662f0 0x7f62180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.338+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6228085120 con 0x7f622c0c9d90 2023-07-21T19:09:11.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.338+0000 7f6223fff700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f62180662f0 0x7f62180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.338+0000 7f6223fff700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f62180662f0 0x7f62180687a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f622c159930 tx=0x7f621c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:11.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.342+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6228052260 con 0x7f622c0c9d90 2023-07-21T19:09:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.518+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f622c04e500 con 0x7f622c0c9d90 2023-07-21T19:09:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.518+0000 7f62217fa700 1 -- 172.21.15.123:0/922212279 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f6228055880 con 0x7f622c0c9d90 2023-07-21T19:09:11.536 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:11.536 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:11.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f62180662f0 msgr2=0x7f62180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f62180662f0 0x7f62180687a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f622c159930 tx=0x7f621c008040 comp rx=0 tx=0).stop 2023-07-21T19:09:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 msgr2=0x7f622c152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c152a90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6228014040 tx=0x7f6228004770 comp rx=0 tx=0).stop 2023-07-21T19:09:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 shutdown_connections 2023-07-21T19:09:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f62180662f0 0x7f62180687a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622c0caf70 0x7f622c0c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f622c159f20 0x7f622c1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 --2- 172.21.15.123:0/922212279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f622c0c9d90 0x7f622c152a90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 >> 172.21.15.123:0/922212279 conn(0x7f622c06e960 msgr2=0x7f622c0b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 shutdown_connections 2023-07-21T19:09:11.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.522+0000 7f6231f64700 1 -- 172.21.15.123:0/922212279 wait complete. 2023-07-21T19:09:11.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T19:07:46.025897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T19:07:46.872387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-21T19:07:50.533523+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-21T19:09:11.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:09:11.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.730+0000 7f2258e7b700 1 Processor -- start 2023-07-21T19:09:11.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.730+0000 7f2258e7b700 1 -- start start 2023-07-21T19:09:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2258e7b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22540d07e0 0x7f22541669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2258e7b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22540d1a60 con 0x7f22540b0ee0 2023-07-21T19:09:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2258e7b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22540d1ef0 con 0x7f22540cd260 2023-07-21T19:09:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2258e7b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22540d0c60 con 0x7f22540d07e0 2023-07-21T19:09:11.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2253fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22540d07e0 0x7f22541669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2253fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22540d07e0 0x7f22541669b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40744/0 (socket says 172.21.15.123:40744) 2023-07-21T19:09:11.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2253fff700 1 -- 172.21.15.123:0/2636488247 learned_addr learned my addr 172.21.15.123:0/2636488247 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:11.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2253fff700 1 -- 172.21.15.123:0/2636488247 >> v1:172.21.15.145:6789/0 conn(0x7f22540cd260 legacy=0x7f22540d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2253fff700 1 -- 172.21.15.123:0/2636488247 >> v1:172.21.15.123:6789/0 conn(0x7f22540b0ee0 legacy=0x7f22540ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f22527fc700 1 -- 172.21.15.123:0/2636488247 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565545397 0 0) 0x7f22540d1a60 con 0x7f22540b0ee0 2023-07-21T19:09:11.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.734+0000 7f2253fff700 1 -- 172.21.15.123:0/2636488247 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540d0e50 con 0x7f22540d07e0 2023-07-21T19:09:11.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2253fff700 1 --2- 172.21.15.123:0/2636488247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540d07e0 0x7f22541669b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f224c009e50 tx=0x7f224c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c43ae37cdf322f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:11.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f22527fc700 1 -- 172.21.15.123:0/2636488247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c00e070 con 0x7f22540d07e0 2023-07-21T19:09:11.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f22527fc700 1 -- 172.21.15.123:0/2636488247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c00b9c0 con 0x7f22540d07e0 2023-07-21T19:09:11.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f22527fc700 1 -- 172.21.15.123:0/2636488247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c00bd70 con 0x7f22540d07e0 2023-07-21T19:09:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 -- 172.21.15.123:0/2636488247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540d07e0 msgr2=0x7f22541669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 --2- 172.21.15.123:0/2636488247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540d07e0 0x7f22541669b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f224c009e50 tx=0x7f224c00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 -- 172.21.15.123:0/2636488247 shutdown_connections 2023-07-21T19:09:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 --2- 172.21.15.123:0/2636488247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540d07e0 0x7f22541669b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 -- 172.21.15.123:0/2636488247 >> 172.21.15.123:0/2636488247 conn(0x7f2254060c40 msgr2=0x7f225409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 -- 172.21.15.123:0/2636488247 shutdown_connections 2023-07-21T19:09:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.738+0000 7f2258e7b700 1 -- 172.21.15.123:0/2636488247 wait complete. 2023-07-21T19:09:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 Processor -- start 2023-07-21T19:09:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 -- start start 2023-07-21T19:09:11.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22540b0ee0 0x7f22541f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 0x7f22540b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22540d07e0 0x7f22541f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22541f69b0 con 0x7f22540cd260 2023-07-21T19:09:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22541f3440 con 0x7f22540d07e0 2023-07-21T19:09:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2258e7b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22540b3b90 con 0x7f22540b0ee0 2023-07-21T19:09:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f22537fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22540b0ee0 0x7f22541f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 0x7f22540b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 0x7f22540b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40752/0 (socket says 172.21.15.123:40752) 2023-07-21T19:09:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 -- 172.21.15.123:0/8103561 learned_addr learned my addr 172.21.15.123:0/8103561 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f22537fe700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22540b0ee0 0x7f22541f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:46660/0 (socket says 172.21.15.123:46660) 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2253fff700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22540d07e0 0x7f22541f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 -- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22540b0ee0 msgr2=0x7f22541f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22540b0ee0 0x7f22541f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 -- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22540d07e0 msgr2=0x7f22541f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22540d07e0 0x7f22541f59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.742+0000 7f2252ffd700 1 -- 172.21.15.123:0/8103561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009b30 con 0x7f22540cd260 2023-07-21T19:09:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f2252ffd700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 0x7f22540b4610 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f224800c4d0 tx=0x7f224800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480052d0 con 0x7f22540cd260 2023-07-21T19:09:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248005430 con 0x7f22540cd260 2023-07-21T19:09:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22541f63f0 con 0x7f22540cd260 2023-07-21T19:09:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480055a0 con 0x7f22540cd260 2023-07-21T19:09:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22540b3e10 con 0x7f22540cd260 2023-07-21T19:09:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22540b76a0 con 0x7f22540cd260 2023-07-21T19:09:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.746+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22480038c0 con 0x7f22540cd260 2023-07-21T19:09:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.750+0000 7f223bfff700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22400662f0 0x7f22400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.750+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2248083300 con 0x7f22540cd260 2023-07-21T19:09:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.750+0000 7f22537fe700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22400662f0 0x7f22400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.750+0000 7f22537fe700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22400662f0 0x7f22400687a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2254071080 tx=0x7f2244009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.754+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2248050440 con 0x7f22540cd260 2023-07-21T19:09:11.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.926+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22540b82a0 con 0x7f22540cd260 2023-07-21T19:09:11.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.926+0000 7f223bfff700 1 -- 172.21.15.123:0/8103561 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2248053a60 con 0x7f22540cd260 2023-07-21T19:09:11.942 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:09:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22400662f0 msgr2=0x7f22400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22400662f0 0x7f22400687a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2254071080 tx=0x7f2244009040 comp rx=0 tx=0).stop 2023-07-21T19:09:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 msgr2=0x7f22540b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 0x7f22540b4610 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f224800c4d0 tx=0x7f224800c7e0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 shutdown_connections 2023-07-21T19:09:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f22400662f0 0x7f22400687a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22540d07e0 0x7f22541f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22540cd260 0x7f22540b4610 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 --2- 172.21.15.123:0/8103561 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22540b0ee0 0x7f22541f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 >> 172.21.15.123:0/8103561 conn(0x7f2254060c40 msgr2=0x7f2254071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:11.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 shutdown_connections 2023-07-21T19:09:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:11.930+0000 7f2258e7b700 1 -- 172.21.15.123:0/8103561 wait complete. 2023-07-21T19:09:11.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:09:12.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.126+0000 7fcb0efc3700 1 Processor -- start 2023-07-21T19:09:12.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.126+0000 7fcb0efc3700 1 -- start start 2023-07-21T19:09:12.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb080cd260 0x7fcb080d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080d1a60 con 0x7fcb080b0ee0 2023-07-21T19:09:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080d1ef0 con 0x7fcb080cd260 2023-07-21T19:09:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080d0e50 con 0x7fcb080d0610 2023-07-21T19:09:12.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0d7c0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb080cd260 0x7fcb080d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0dfc1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb080b0ee0 0x7fcb080ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54878/0 (socket says 172.21.15.123:54878) 2023-07-21T19:09:12.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0dfc1700 1 -- 172.21.15.123:0/2606830597 learned_addr learned my addr 172.21.15.123:0/2606830597 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:12.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0e7c2700 1 --2- 172.21.15.123:0/2606830597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0d7c0700 1 -- 172.21.15.123:0/2606830597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 msgr2=0x7fcb080af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:12.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0d7c0700 1 --2- 172.21.15.123:0/2606830597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0d7c0700 1 -- 172.21.15.123:0/2606830597 >> v1:172.21.15.123:6789/0 conn(0x7fcb080b0ee0 legacy=0x7fcb080ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0cfbf700 1 -- 172.21.15.123:0/2606830597 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194754445 0 0) 0x7fcb080d1a60 con 0x7fcb080b0ee0 2023-07-21T19:09:12.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0d7c0700 1 -- 172.21.15.123:0/2606830597 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080d1130 con 0x7fcb080cd260 2023-07-21T19:09:12.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0d7c0700 1 --2- 172.21.15.123:0/2606830597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080cd260 0x7fcb080d00d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009850 tx=0x7fcaf8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b5e7f10a4810b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0cfbf700 1 -- 172.21.15.123:0/2606830597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8011830 con 0x7fcb080cd260 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0cfbf700 1 -- 172.21.15.123:0/2606830597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8011990 con 0x7fcb080cd260 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0cfbf700 1 -- 172.21.15.123:0/2606830597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8011d20 con 0x7fcb080cd260 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 -- 172.21.15.123:0/2606830597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080cd260 msgr2=0x7fcb080d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.130+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/2606830597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080cd260 0x7fcb080d00d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009850 tx=0x7fcaf8009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 -- 172.21.15.123:0/2606830597 shutdown_connections 2023-07-21T19:09:12.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/2606830597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/2606830597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080cd260 0x7fcb080d00d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 -- 172.21.15.123:0/2606830597 >> 172.21.15.123:0/2606830597 conn(0x7fcb08060c40 msgr2=0x7fcb0809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:12.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 -- 172.21.15.123:0/2606830597 shutdown_connections 2023-07-21T19:09:12.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 -- 172.21.15.123:0/2606830597 wait complete. 2023-07-21T19:09:12.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 Processor -- start 2023-07-21T19:09:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.134+0000 7fcb0efc3700 1 -- start start 2023-07-21T19:09:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 0x7fcb081588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb080cd260 0x7fcb080c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b3830 con 0x7fcb080b0ee0 2023-07-21T19:09:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b3b10 con 0x7fcb080cd260 2023-07-21T19:09:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b3df0 con 0x7fcb080d0610 2023-07-21T19:09:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 0x7fcb081588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 0x7fcb081588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40784/0 (socket says 172.21.15.123:40784) 2023-07-21T19:09:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 -- 172.21.15.123:0/1760885030 learned_addr learned my addr 172.21.15.123:0/1760885030 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0e7c2700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0d7c0700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb080cd260 0x7fcb080c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 -- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 msgr2=0x7fcb080c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 -- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb080cd260 msgr2=0x7fcb080c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb080cd260 0x7fcb080c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 -- 172.21.15.123:0/1760885030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80094b0 con 0x7fcb080b0ee0 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0d7c0700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb080cd260 0x7fcb080c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0dfc1700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 0x7fcb081588d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c4e0 tx=0x7fcb0400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04004ca0 con 0x7fcb080b0ee0 2023-07-21T19:09:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04004e20 con 0x7fcb080b0ee0 2023-07-21T19:09:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04007310 con 0x7fcb080b0ee0 2023-07-21T19:09:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb080b40d0 con 0x7fcb080b0ee0 2023-07-21T19:09:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.138+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb080b3520 con 0x7fcb080b0ee0 2023-07-21T19:09:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.142+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0804e500 con 0x7fcb080b0ee0 2023-07-21T19:09:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.142+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb04007470 con 0x7fcb080b0ee0 2023-07-21T19:09:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.142+0000 7fcafe7fc700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcaec0662f0 0x7fcaec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.142+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb04083c80 con 0x7fcb080b0ee0 2023-07-21T19:09:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.142+0000 7fcb0d7c0700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcaec0662f0 0x7fcaec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.146+0000 7fcb0d7c0700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcaec0662f0 0x7fcaec0687a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcb080cd650 tx=0x7fcaf8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.150+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcb04050e60 con 0x7fcb080b0ee0 2023-07-21T19:09:12.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.326+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb080b18d0 con 0x7fcb080b0ee0 2023-07-21T19:09:12.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.326+0000 7fcafe7fc700 1 -- 172.21.15.123:0/1760885030 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb04007720 con 0x7fcb080b0ee0 2023-07-21T19:09:12.340 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:09:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcaec0662f0 msgr2=0x7fcaec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcaec0662f0 0x7fcaec0687a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcb080cd650 tx=0x7fcaf8008030 comp rx=0 tx=0).stop 2023-07-21T19:09:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 msgr2=0x7fcb081588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 0x7fcb081588d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c4e0 tx=0x7fcb0400c8a0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 shutdown_connections 2023-07-21T19:09:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fcaec0662f0 0x7fcaec0687a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb080cd260 0x7fcb080c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb080d0610 0x7fcb080c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 --2- 172.21.15.123:0/1760885030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb080b0ee0 0x7fcb081588d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 >> 172.21.15.123:0/1760885030 conn(0x7fcb08060c40 msgr2=0x7fcb080b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 shutdown_connections 2023-07-21T19:09:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.330+0000 7fcb0efc3700 1 -- 172.21.15.123:0/1760885030 wait complete. 2023-07-21T19:09:12.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T19:09:12.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.526+0000 7f886e513700 1 Processor -- start 2023-07-21T19:09:12.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.526+0000 7f886e513700 1 -- start start 2023-07-21T19:09:12.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f88680b1c50 0x7f8868071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680d0210 0x7f88680d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886815c420 con 0x7f88680cf000 2023-07-21T19:09:12.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8868070840 con 0x7f88680b1c50 2023-07-21T19:09:12.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868070b20 con 0x7f88680d0210 2023-07-21T19:09:12.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886cab0700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f88680cf000 0x7f88680ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41128/0 (socket says 172.21.15.123:41128) 2023-07-21T19:09:12.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886cab0700 1 -- 172.21.15.123:0/3080772662 learned_addr learned my addr 172.21.15.123:0/3080772662 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:12.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f88677fe700 1 --2- 172.21.15.123:0/3080772662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680d0210 0x7f88680d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8867fff700 1 --2- 172.21.15.123:0/3080772662 >> v2:172.21.15.145:3300/0 conn(0x7f88680b1c50 0x7f8868071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8866ffd700 1 -- 172.21.15.123:0/3080772662 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720165419 0 0) 0x7f886815c420 con 0x7f88680cf000 2023-07-21T19:09:12.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8866ffd700 1 -- 172.21.15.123:0/3080772662 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88500035d0 con 0x7f88680cf000 2023-07-21T19:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f88677fe700 1 -- 172.21.15.123:0/3080772662 >> v2:172.21.15.145:3300/0 conn(0x7f88680b1c50 msgr2=0x7f8868071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f88677fe700 1 --2- 172.21.15.123:0/3080772662 >> v2:172.21.15.145:3300/0 conn(0x7f88680b1c50 0x7f8868071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f88677fe700 1 -- 172.21.15.123:0/3080772662 >> v1:172.21.15.123:6789/0 conn(0x7f88680cf000 legacy=0x7f88680ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f88677fe700 1 -- 172.21.15.123:0/3080772662 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868070e00 con 0x7f88680d0210 2023-07-21T19:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8867fff700 1 --2- 172.21.15.123:0/3080772662 >> v2:172.21.15.145:3300/0 conn(0x7f88680b1c50 0x7f8868071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f88677fe700 1 --2- 172.21.15.123:0/3080772662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680d0210 0x7f88680d0640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f885c009850 tx=0x7f885c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ce8058676177b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8866ffd700 1 -- 172.21.15.123:0/3080772662 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c011830 con 0x7f88680d0210 2023-07-21T19:09:12.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8866ffd700 1 -- 172.21.15.123:0/3080772662 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c011990 con 0x7f88680d0210 2023-07-21T19:09:12.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f8866ffd700 1 -- 172.21.15.123:0/3080772662 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c011d40 con 0x7f88680d0210 2023-07-21T19:09:12.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- 172.21.15.123:0/3080772662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680d0210 msgr2=0x7f88680d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 --2- 172.21.15.123:0/3080772662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680d0210 0x7f88680d0640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f885c009850 tx=0x7f885c009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:12.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- 172.21.15.123:0/3080772662 shutdown_connections 2023-07-21T19:09:12.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 --2- 172.21.15.123:0/3080772662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680d0210 0x7f88680d0640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 --2- 172.21.15.123:0/3080772662 >> v2:172.21.15.145:3300/0 conn(0x7f88680b1c50 0x7f8868071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- 172.21.15.123:0/3080772662 >> 172.21.15.123:0/3080772662 conn(0x7f886809b9c0 msgr2=0x7f88680d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:12.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- 172.21.15.123:0/3080772662 shutdown_connections 2023-07-21T19:09:12.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.530+0000 7f886e513700 1 -- 172.21.15.123:0/3080772662 wait complete. 2023-07-21T19:09:12.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 Processor -- start 2023-07-21T19:09:12.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 -- start start 2023-07-21T19:09:12.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680b1c50 0x7f886814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88680cf000 0x7f88680b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 0x7f88681f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c5e10 con 0x7f88680d0210 2023-07-21T19:09:12.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c94a0 con 0x7f88680cf000 2023-07-21T19:09:12.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.534+0000 7f886e513700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88681f1410 con 0x7f88680b1c50 2023-07-21T19:09:12.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 0x7f88681f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 0x7f88681f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34418/0 (socket says 172.21.15.123:34418) 2023-07-21T19:09:12.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 -- 172.21.15.123:0/3660168477 learned_addr learned my addr 172.21.15.123:0/3660168477 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f8867fff700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680b1c50 0x7f886814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f88677fe700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88680cf000 0x7f88680b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 -- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680b1c50 msgr2=0x7f886814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680b1c50 0x7f886814ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 -- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88680cf000 msgr2=0x7f88680b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88680cf000 0x7f88680b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 -- 172.21.15.123:0/3660168477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580094b0 con 0x7f88680d0210 2023-07-21T19:09:12.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886cab0700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 0x7f88681f0ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f886000cb70 tx=0x7f886000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860007480 con 0x7f88680d0210 2023-07-21T19:09:12.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88600075e0 con 0x7f88680d0210 2023-07-21T19:09:12.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860007950 con 0x7f88680d0210 2023-07-21T19:09:12.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0094b0 con 0x7f88680d0210 2023-07-21T19:09:12.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88680c6300 con 0x7f88680d0210 2023-07-21T19:09:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.538+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886804dcb0 con 0x7f88680d0210 2023-07-21T19:09:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.542+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f886001b3b0 con 0x7f88680d0210 2023-07-21T19:09:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.542+0000 7f8864ff9700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f88540662f0 0x7f88540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.542+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8860083920 con 0x7f88680d0210 2023-07-21T19:09:12.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.542+0000 7f8867fff700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f88540662f0 0x7f88540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.542+0000 7f8867fff700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f88540662f0 0x7f88540687a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88680c5d60 tx=0x7f8858009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.550+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8860050a80 con 0x7f88680d0210 2023-07-21T19:09:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.722+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f886808b5b0 con 0x7f88680d0210 2023-07-21T19:09:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.722+0000 7f8864ff9700 1 -- 172.21.15.123:0/3660168477 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88600540a0 con 0x7f88680d0210 2023-07-21T19:09:12.738 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f88540662f0 msgr2=0x7f88540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f88540662f0 0x7f88540687a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88680c5d60 tx=0x7f8858009240 comp rx=0 tx=0).stop 2023-07-21T19:09:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 msgr2=0x7f88681f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 0x7f88681f0ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f886000cb70 tx=0x7f886000cba0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 shutdown_connections 2023-07-21T19:09:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f88540662f0 0x7f88540687a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88680cf000 0x7f88680b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88680d0210 0x7f88681f0ed0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 --2- 172.21.15.123:0/3660168477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88680b1c50 0x7f886814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 >> 172.21.15.123:0/3660168477 conn(0x7f886809b9c0 msgr2=0x7f886815b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 shutdown_connections 2023-07-21T19:09:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.726+0000 7f886e513700 1 -- 172.21.15.123:0/3660168477 wait complete. 2023-07-21T19:09:12.762 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T19:09:12.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.922+0000 7f399b337700 1 Processor -- start 2023-07-21T19:09:12.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.922+0000 7f399b337700 1 -- start start 2023-07-21T19:09:12.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399b337700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3994160000 0x7f399406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399b337700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39941603d0 0x7f39940c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399b337700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940cdfb0 con 0x7f39940cd7f0 2023-07-21T19:09:12.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399b337700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3994070e40 con 0x7f3994160000 2023-07-21T19:09:12.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399b337700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940cdcd0 con 0x7f39941603d0 2023-07-21T19:09:12.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399ab36700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f39940cd7f0 0x7f39940c0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41132/0 (socket says 172.21.15.123:41132) 2023-07-21T19:09:12.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399ab36700 1 -- 172.21.15.123:0/1846065145 learned_addr learned my addr 172.21.15.123:0/1846065145 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:12.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399a335700 1 --2- 172.21.15.123:0/1846065145 >> v2:172.21.15.145:3300/0 conn(0x7f3994160000 0x7f399406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f3999b34700 1 --2- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39941603d0 0x7f39940c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f3999333700 1 -- 172.21.15.123:0/1846065145 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010252355 0 0) 0x7f398c001490 con 0x7f39940cd7f0 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f3999333700 1 -- 172.21.15.123:0/1846065145 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39800035d0 con 0x7f39940cd7f0 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399a335700 1 -- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39941603d0 msgr2=0x7f39940c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399a335700 1 --2- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39941603d0 0x7f39940c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399a335700 1 -- 172.21.15.123:0/1846065145 >> v1:172.21.15.123:6789/0 conn(0x7f39940cd7f0 legacy=0x7f39940c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399a335700 1 -- 172.21.15.123:0/1846065145 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994070780 con 0x7f3994160000 2023-07-21T19:09:12.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.926+0000 7f399a335700 1 --2- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3994160000 0x7f399406dd10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3990009850 tx=0x7f3990009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=defdb68ac9c35a67 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f3999333700 1 -- 172.21.15.123:0/1846065145 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990011830 con 0x7f3994160000 2023-07-21T19:09:12.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f3999333700 1 -- 172.21.15.123:0/1846065145 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3990011990 con 0x7f3994160000 2023-07-21T19:09:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f3999333700 1 -- 172.21.15.123:0/1846065145 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990011d40 con 0x7f3994160000 2023-07-21T19:09:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 -- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3994160000 msgr2=0x7f399406dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 --2- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3994160000 0x7f399406dd10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3990009850 tx=0x7f3990009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:12.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 -- 172.21.15.123:0/1846065145 shutdown_connections 2023-07-21T19:09:12.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 --2- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39941603d0 0x7f39940c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 --2- 172.21.15.123:0/1846065145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3994160000 0x7f399406dd10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 -- 172.21.15.123:0/1846065145 >> 172.21.15.123:0/1846065145 conn(0x7f39940afc60 msgr2=0x7f39940b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:12.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 -- 172.21.15.123:0/1846065145 shutdown_connections 2023-07-21T19:09:12.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.930+0000 7f399b337700 1 -- 172.21.15.123:0/1846065145 wait complete. 2023-07-21T19:09:12.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 Processor -- start 2023-07-21T19:09:12.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 -- start start 2023-07-21T19:09:12.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940cd7f0 0x7f39941546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3994160000 0x7f39940ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 0x7f39940cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940b2750 con 0x7f39941603d0 2023-07-21T19:09:12.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994154c20 con 0x7f39940cd7f0 2023-07-21T19:09:12.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399b337700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940c75e0 con 0x7f3994160000 2023-07-21T19:09:12.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 0x7f39940cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 0x7f39940cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34434/0 (socket says 172.21.15.123:34434) 2023-07-21T19:09:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 -- 172.21.15.123:0/267775138 learned_addr learned my addr 172.21.15.123:0/267775138 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399a335700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940cd7f0 0x7f39941546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f3999b34700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3994160000 0x7f39940ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 -- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3994160000 msgr2=0x7f39940ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3994160000 0x7f39940ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 -- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940cd7f0 msgr2=0x7f39941546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940cd7f0 0x7f39941546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 -- 172.21.15.123:0/267775138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900094b0 con 0x7f39941603d0 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399a335700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940cd7f0 0x7f39941546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f3999b34700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3994160000 0x7f39940ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.934+0000 7f399ab36700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 0x7f39940cac30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f398c00cb10 tx=0x7f398c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.938+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00a820 con 0x7f39941603d0 2023-07-21T19:09:12.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.938+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39940b2100 con 0x7f39941603d0 2023-07-21T19:09:12.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.938+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c00a980 con 0x7f39941603d0 2023-07-21T19:09:12.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.938+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00ad10 con 0x7f39941603d0 2023-07-21T19:09:12.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.938+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39940c78c0 con 0x7f39941603d0 2023-07-21T19:09:12.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.938+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994071240 con 0x7f39941603d0 2023-07-21T19:09:12.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.942+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f398c01b3b0 con 0x7f39941603d0 2023-07-21T19:09:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.942+0000 7f398affd700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39780662f0 0x7f39780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.942+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f398c083a70 con 0x7f39941603d0 2023-07-21T19:09:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.942+0000 7f399a335700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39780662f0 0x7f39780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.942+0000 7f399a335700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39780662f0 0x7f39780687a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f39900090b0 tx=0x7f3990008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:12.946+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3994071240 con 0x7f39941603d0 2023-07-21T19:09:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.114+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39940cdfb0 con 0x7f39941603d0 2023-07-21T19:09:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.114+0000 7f398affd700 1 -- 172.21.15.123:0/267775138 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39940cdfb0 con 0x7f39941603d0 2023-07-21T19:09:13.128 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-07-21T19:09:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39780662f0 msgr2=0x7f39780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39780662f0 0x7f39780687a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f39900090b0 tx=0x7f3990008030 comp rx=0 tx=0).stop 2023-07-21T19:09:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 msgr2=0x7f39940cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 0x7f39940cac30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f398c00cb10 tx=0x7f398c00cbf0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 shutdown_connections 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f39780662f0 0x7f39780687a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39941603d0 0x7f39940cac30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3994160000 0x7f39940ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 --2- 172.21.15.123:0/267775138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39940cd7f0 0x7f39941546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 >> 172.21.15.123:0/267775138 conn(0x7f39940afc60 msgr2=0x7f39940c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 shutdown_connections 2023-07-21T19:09:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.118+0000 7f399b337700 1 -- 172.21.15.123:0/267775138 wait complete. 2023-07-21T19:09:13.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-21T19:09:13.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.310+0000 7f909f554700 1 Processor -- start 2023-07-21T19:09:13.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.310+0000 7f909f554700 1 -- start start 2023-07-21T19:09:13.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909f554700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160240 0x7f90980cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909f554700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9098160610 0x7f90980ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909f554700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9098163fe0 con 0x7f90980afd80 2023-07-21T19:09:13.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909f554700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980c8c30 con 0x7f9098160610 2023-07-21T19:09:13.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909f554700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90980ca9e0 con 0x7f9098160240 2023-07-21T19:09:13.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909d2f0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160240 0x7f90980cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909caef700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9098160610 0x7f90980ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909d2f0700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160240 0x7f90980cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:54972/0 (socket says 172.21.15.123:54972) 2023-07-21T19:09:13.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909d2f0700 1 -- 172.21.15.123:0/1570887864 learned_addr learned my addr 172.21.15.123:0/1570887864 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:13.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909caef700 1 -- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160240 msgr2=0x7f90980cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:13.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909caef700 1 --2- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160240 0x7f90980cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909caef700 1 -- 172.21.15.123:0/1570887864 >> v1:172.21.15.145:6789/0 conn(0x7f90980afd80 legacy=0x7f909806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909caef700 1 -- 172.21.15.123:0/1570887864 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098164230 con 0x7f9098160610 2023-07-21T19:09:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.314+0000 7f909caef700 1 --2- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160610 0x7f90980ca320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9088009850 tx=0x7f9088009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22437c5770231c97 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f908ffff700 1 -- 172.21.15.123:0/1570887864 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088011830 con 0x7f9098160610 2023-07-21T19:09:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f908ffff700 1 -- 172.21.15.123:0/1570887864 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9088011990 con 0x7f9098160610 2023-07-21T19:09:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f908ffff700 1 -- 172.21.15.123:0/1570887864 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088011d40 con 0x7f9098160610 2023-07-21T19:09:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 -- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160610 msgr2=0x7f90980ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 --2- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160610 0x7f90980ca320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9088009850 tx=0x7f9088009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 -- 172.21.15.123:0/1570887864 shutdown_connections 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 --2- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160610 0x7f90980ca320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 --2- 172.21.15.123:0/1570887864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160240 0x7f90980cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 -- 172.21.15.123:0/1570887864 >> 172.21.15.123:0/1570887864 conn(0x7f90980cad80 msgr2=0x7f90980cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 -- 172.21.15.123:0/1570887864 shutdown_connections 2023-07-21T19:09:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 -- 172.21.15.123:0/1570887864 wait complete. 2023-07-21T19:09:13.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 Processor -- start 2023-07-21T19:09:13.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.318+0000 7f909f554700 1 -- start start 2023-07-21T19:09:13.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 0x7f909815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160240 0x7f90981613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160610 0x7f909815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909815aef0 con 0x7f90980afd80 2023-07-21T19:09:13.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90980c5490 con 0x7f9098160240 2023-07-21T19:09:13.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90981633d0 con 0x7f9098160610 2023-07-21T19:09:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 0x7f909815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 0x7f909815a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34450/0 (socket says 172.21.15.123:34450) 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 -- 172.21.15.123:0/445447626 learned_addr learned my addr 172.21.15.123:0/445447626 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909daf1700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160610 0x7f909815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909caef700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160240 0x7f90981613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 -- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160610 msgr2=0x7f909815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160610 0x7f909815c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 -- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160240 msgr2=0x7f90981613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160240 0x7f90981613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 -- 172.21.15.123:0/445447626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880094b0 con 0x7f90980afd80 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909caef700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160240 0x7f90981613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909d2f0700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 0x7f909815a530 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f909400e890 tx=0x7f909400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094009620 con 0x7f90980afd80 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400ee90 con 0x7f90980afd80 2023-07-21T19:09:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400ca30 con 0x7f90980afd80 2023-07-21T19:09:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90981636b0 con 0x7f90980afd80 2023-07-21T19:09:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.322+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90981630c0 con 0x7f90980afd80 2023-07-21T19:09:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.326+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909804dcb0 con 0x7f90980afd80 2023-07-21T19:09:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.326+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f909400cb90 con 0x7f90980afd80 2023-07-21T19:09:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.330+0000 7f908dffb700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f907c0662f0 0x7f907c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.330+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9094084020 con 0x7f90980afd80 2023-07-21T19:09:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.330+0000 7f909caef700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f907c0662f0 0x7f907c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.330+0000 7f909caef700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f907c0662f0 0x7f907c0687a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f909806bce0 tx=0x7f9088008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:13.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.334+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9094054c00 con 0x7f90980afd80 2023-07-21T19:09:13.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.506+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90980b0bc0 con 0x7f90980afd80 2023-07-21T19:09:13.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.506+0000 7f908dffb700 1 -- 172.21.15.123:0/445447626 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9094054790 con 0x7f90980afd80 2023-07-21T19:09:13.522 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-07-21T19:09:13.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f907c0662f0 msgr2=0x7f907c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f907c0662f0 0x7f907c0687a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f909806bce0 tx=0x7f9088008030 comp rx=0 tx=0).stop 2023-07-21T19:09:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 msgr2=0x7f909815a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 0x7f909815a530 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f909400e890 tx=0x7f909400ec50 comp rx=0 tx=0).stop 2023-07-21T19:09:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 shutdown_connections 2023-07-21T19:09:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f907c0662f0 0x7f907c0687a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9098160240 0x7f90981613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9098160610 0x7f909815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 --2- 172.21.15.123:0/445447626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90980afd80 0x7f909815a530 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 >> 172.21.15.123:0/445447626 conn(0x7f90980cad80 msgr2=0x7f909806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 shutdown_connections 2023-07-21T19:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.510+0000 7f909f554700 1 -- 172.21.15.123:0/445447626 wait complete. 2023-07-21T19:09:13.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:09:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 Processor -- start 2023-07-21T19:09:13.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 -- start start 2023-07-21T19:09:13.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26140c9d90 0x7f26140ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614159f20 0x7f26140caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f26140caf70 0x7f26140c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140b0ef0 con 0x7f26140c9d90 2023-07-21T19:09:13.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140ce9c0 con 0x7f26140caf70 2023-07-21T19:09:13.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261919e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140cee50 con 0x7f2614159f20 2023-07-21T19:09:13.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f2613fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26140c9d90 0x7f26140ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f2613fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26140c9d90 0x7f26140ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34452/0 (socket says 172.21.15.123:34452) 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f2613fff700 1 -- 172.21.15.123:0/365184711 learned_addr learned my addr 172.21.15.123:0/365184711 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f261899d700 1 --2- 172.21.15.123:0/365184711 >> v2:172.21.15.145:3300/0 conn(0x7f26140caf70 0x7f26140c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.702+0000 7f260b7fe700 1 --2- 172.21.15.123:0/365184711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614159f20 0x7f26140caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f2613fff700 1 -- 172.21.15.123:0/365184711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614159f20 msgr2=0x7f26140caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f2613fff700 1 --2- 172.21.15.123:0/365184711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614159f20 0x7f26140caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f2613fff700 1 -- 172.21.15.123:0/365184711 >> v2:172.21.15.145:3300/0 conn(0x7f26140caf70 msgr2=0x7f26140c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:13.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f2613fff700 1 --2- 172.21.15.123:0/365184711 >> v2:172.21.15.145:3300/0 conn(0x7f26140caf70 0x7f26140c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f2613fff700 1 -- 172.21.15.123:0/365184711 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140ca6a0 con 0x7f26140c9d90 2023-07-21T19:09:13.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f2613fff700 1 --2- 172.21.15.123:0/365184711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140ca160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f26140cdf60 tx=0x7f2604009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc209d9932163b19 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:13.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f26137fe700 1 -- 172.21.15.123:0/365184711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604011830 con 0x7f26140c9d90 2023-07-21T19:09:13.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f26137fe700 1 -- 172.21.15.123:0/365184711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604011990 con 0x7f26140c9d90 2023-07-21T19:09:13.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f26137fe700 1 -- 172.21.15.123:0/365184711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604011d20 con 0x7f26140c9d90 2023-07-21T19:09:13.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 -- 172.21.15.123:0/365184711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 msgr2=0x7f26140ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 --2- 172.21.15.123:0/365184711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140ca160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f26140cdf60 tx=0x7f2604009bf0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 -- 172.21.15.123:0/365184711 shutdown_connections 2023-07-21T19:09:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 --2- 172.21.15.123:0/365184711 >> v2:172.21.15.145:3300/0 conn(0x7f26140caf70 0x7f26140c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 --2- 172.21.15.123:0/365184711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2614159f20 0x7f26140caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 --2- 172.21.15.123:0/365184711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140ca160 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 -- 172.21.15.123:0/365184711 >> 172.21.15.123:0/365184711 conn(0x7f261406e960 msgr2=0x7f261406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 -- 172.21.15.123:0/365184711 shutdown_connections 2023-07-21T19:09:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.706+0000 7f261919e700 1 -- 172.21.15.123:0/365184711 wait complete. 2023-07-21T19:09:13.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 Processor -- start 2023-07-21T19:09:13.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 -- start start 2023-07-21T19:09:13.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f26140caf70 0x7f26140c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2614159f20 0x7f26140b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415b7e0 con 0x7f26140c9d90 2023-07-21T19:09:13.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415ab60 con 0x7f2614159f20 2023-07-21T19:09:13.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f261919e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261415ae40 con 0x7f26140caf70 2023-07-21T19:09:13.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.710+0000 7f2613fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34454/0 (socket says 172.21.15.123:34454) 2023-07-21T19:09:13.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 -- 172.21.15.123:0/3660696083 learned_addr learned my addr 172.21.15.123:0/3660696083 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:13.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f260b7fe700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f26140caf70 0x7f26140c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f261899d700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2614159f20 0x7f26140b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 -- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f26140caf70 msgr2=0x7f26140c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f26140caf70 0x7f26140c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 -- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2614159f20 msgr2=0x7f26140b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2614159f20 0x7f26140b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 -- 172.21.15.123:0/3660696083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009570 con 0x7f26140c9d90 2023-07-21T19:09:13.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f2613fff700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140c4610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2604000c00 tx=0x7f2604004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:13.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604004450 con 0x7f26140c9d90 2023-07-21T19:09:13.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260401e070 con 0x7f26140c9d90 2023-07-21T19:09:13.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261415b120 con 0x7f26140c9d90 2023-07-21T19:09:13.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604003900 con 0x7f26140c9d90 2023-07-21T19:09:13.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26140c4b50 con 0x7f26140c9d90 2023-07-21T19:09:13.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.714+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261415b920 con 0x7f26140c9d90 2023-07-21T19:09:13.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.718+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2604003a60 con 0x7f26140c9d90 2023-07-21T19:09:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.718+0000 7f26117fa700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f40662f0 0x7f25f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.718+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2604020070 con 0x7f26140c9d90 2023-07-21T19:09:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.718+0000 7f260b7fe700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f40662f0 0x7f25f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.722+0000 7f260b7fe700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f40662f0 0x7f25f40687a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26140c4f90 tx=0x7f25fc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:13.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.726+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26040525a0 con 0x7f26140c9d90 2023-07-21T19:09:13.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.930+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f261404e500 con 0x7f26140c9d90 2023-07-21T19:09:13.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.930+0000 7f26117fa700 1 -- 172.21.15.123:0/3660696083 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f2604055bc0 con 0x7f26140c9d90 2023-07-21T19:09:13.946 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:13.946 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:09:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f40662f0 msgr2=0x7f25f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f40662f0 0x7f25f40687a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26140c4f90 tx=0x7f25fc009240 comp rx=0 tx=0).stop 2023-07-21T19:09:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 msgr2=0x7f26140c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:13.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140c4610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2604000c00 tx=0x7f2604004770 comp rx=0 tx=0).stop 2023-07-21T19:09:13.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 shutdown_connections 2023-07-21T19:09:13.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f25f40662f0 0x7f25f40687a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2614159f20 0x7f26140b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f26140caf70 0x7f26140c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 --2- 172.21.15.123:0/3660696083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26140c9d90 0x7f26140c4610 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:13.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 >> 172.21.15.123:0/3660696083 conn(0x7f261406e960 msgr2=0x7f26141546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:13.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 shutdown_connections 2023-07-21T19:09:13.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:13.934+0000 7f261919e700 1 -- 172.21.15.123:0/3660696083 wait complete. 2023-07-21T19:09:13.951 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:09:13.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:14.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.130+0000 7fc71d17e700 1 Processor -- start 2023-07-21T19:09:14.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71d17e700 1 -- start start 2023-07-21T19:09:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71d17e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7180b0de0 0x7fc7181669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71d17e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180af0a0 con 0x7fc7180cd240 2023-07-21T19:09:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71d17e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180cf720 con 0x7fc71815bff0 2023-07-21T19:09:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71d17e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7180af2f0 con 0x7fc7180b0de0 2023-07-21T19:09:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc70f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc7180cd240 0x7fc7180ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41140/0 (socket says 172.21.15.123:41140) 2023-07-21T19:09:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc70f7fe700 1 -- 172.21.15.123:0/2364799536 learned_addr learned my addr 172.21.15.123:0/2364799536 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:14.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71c97d700 1 --2- 172.21.15.123:0/2364799536 >> v2:172.21.15.123:3300/0 conn(0x7fc7180b0de0 0x7fc7181669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71c97d700 1 -- 172.21.15.123:0/2364799536 >> v1:172.21.15.145:6789/0 conn(0x7fc71815bff0 legacy=0x7fc7180ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71c97d700 1 -- 172.21.15.123:0/2364799536 >> v1:172.21.15.123:6789/0 conn(0x7fc7180cd240 legacy=0x7fc7180ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71c97d700 1 -- 172.21.15.123:0/2364799536 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180af5d0 con 0x7fc7180b0de0 2023-07-21T19:09:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc7177fe700 1 -- 172.21.15.123:0/2364799536 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388124448 0 0) 0x7fc7180af0a0 con 0x7fc7180cd240 2023-07-21T19:09:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.134+0000 7fc71c97d700 1 --2- 172.21.15.123:0/2364799536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180b0de0 0x7fc7181669d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc71000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7ed21e422ec79c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc7177fe700 1 -- 172.21.15.123:0/2364799536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71000e070 con 0x7fc7180b0de0 2023-07-21T19:09:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc7177fe700 1 -- 172.21.15.123:0/2364799536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71000bbd0 con 0x7fc7180b0de0 2023-07-21T19:09:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc7177fe700 1 -- 172.21.15.123:0/2364799536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710012430 con 0x7fc7180b0de0 2023-07-21T19:09:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 -- 172.21.15.123:0/2364799536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180b0de0 msgr2=0x7fc7181669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2364799536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180b0de0 0x7fc7181669d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc71000b330 comp rx=0 tx=0).stop 2023-07-21T19:09:14.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 -- 172.21.15.123:0/2364799536 shutdown_connections 2023-07-21T19:09:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2364799536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180b0de0 0x7fc7181669d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 -- 172.21.15.123:0/2364799536 >> 172.21.15.123:0/2364799536 conn(0x7fc718060c40 msgr2=0x7fc71809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 -- 172.21.15.123:0/2364799536 shutdown_connections 2023-07-21T19:09:14.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 -- 172.21.15.123:0/2364799536 wait complete. 2023-07-21T19:09:14.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 Processor -- start 2023-07-21T19:09:14.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.138+0000 7fc71d17e700 1 -- start start 2023-07-21T19:09:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7180b0de0 0x7fc7180b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 0x7fc7180b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc71815bff0 0x7fc71815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b5310 con 0x7fc7180cd240 2023-07-21T19:09:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b55f0 con 0x7fc7180b0de0 2023-07-21T19:09:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b58d0 con 0x7fc71815bff0 2023-07-21T19:09:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 0x7fc7180b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 0x7fc7180b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34484/0 (socket says 172.21.15.123:34484) 2023-07-21T19:09:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 -- 172.21.15.123:0/2941104045 learned_addr learned my addr 172.21.15.123:0/2941104045 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc717fff700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7180b0de0 0x7fc7180b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71c97d700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc71815bff0 0x7fc71815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 -- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc71815bff0 msgr2=0x7fc71815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc71815bff0 0x7fc71815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 -- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7180b0de0 msgr2=0x7fc7180b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7180b0de0 0x7fc7180b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 -- 172.21.15.123:0/2941104045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710009a70 con 0x7fc7180cd240 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc717fff700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7180b0de0 0x7fc7180b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc70f7fe700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 0x7fc7180b3da0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c550 tx=0x7fc70000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700004ca0 con 0x7fc7180cd240 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700004e00 con 0x7fc7180cd240 2023-07-21T19:09:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7180b5bb0 con 0x7fc7180cd240 2023-07-21T19:09:14.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700007310 con 0x7fc7180cd240 2023-07-21T19:09:14.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.142+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7180b7d30 con 0x7fc7180cd240 2023-07-21T19:09:14.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.146+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7180b60d0 con 0x7fc7180cd240 2023-07-21T19:09:14.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.146+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc700007470 con 0x7fc7180cd240 2023-07-21T19:09:14.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.146+0000 7fc7157fa700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6f80662f0 0x7fc6f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.146+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc700083de0 con 0x7fc7180cd240 2023-07-21T19:09:14.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.150+0000 7fc717fff700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6f80662f0 0x7fc6f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.150+0000 7fc717fff700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6f80662f0 0x7fc6f80687a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc718155a00 tx=0x7fc708009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.150+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc7180b60d0 con 0x7fc7180cd240 2023-07-21T19:09:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.326+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7180b60d0 con 0x7fc7180cd240 2023-07-21T19:09:14.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.330+0000 7fc7157fa700 1 -- 172.21.15.123:0/2941104045 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7fc7180b60d0 con 0x7fc7180cd240 2023-07-21T19:09:14.344 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:14.344 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.330+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6f80662f0 msgr2=0x7fc6f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.330+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6f80662f0 0x7fc6f80687a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc718155a00 tx=0x7fc708009040 comp rx=0 tx=0).stop 2023-07-21T19:09:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.330+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 msgr2=0x7fc7180b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.330+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 0x7fc7180b3da0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c550 tx=0x7fc70000c910 comp rx=0 tx=0).stop 2023-07-21T19:09:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 shutdown_connections 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6f80662f0 0x7fc6f80687a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc71815bff0 0x7fc71815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7180cd240 0x7fc7180b3da0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 --2- 172.21.15.123:0/2941104045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7180b0de0 0x7fc7180b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 >> 172.21.15.123:0/2941104045 conn(0x7fc718060c40 msgr2=0x7fc7180d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 shutdown_connections 2023-07-21T19:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.334+0000 7fc71d17e700 1 -- 172.21.15.123:0/2941104045 wait complete. 2023-07-21T19:09:14.368 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T19:09:14.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:09:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 Processor -- start 2023-07-21T19:09:14.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 -- start start 2023-07-21T19:09:14.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7d1815bff0 0x7f7d180ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d180cf1c0 0x7f7d180afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d180af0a0 con 0x7f7d180cd070 2023-07-21T19:09:14.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180cd4f0 con 0x7f7d180cf1c0 2023-07-21T19:09:14.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1df24700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180cf720 con 0x7f7d1815bff0 2023-07-21T19:09:14.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d180cf1c0 0x7f7d180afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d180cf1c0 0x7f7d180afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34488/0 (socket says 172.21.15.123:34488) 2023-07-21T19:09:14.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 -- 172.21.15.123:0/1190198422 learned_addr learned my addr 172.21.15.123:0/1190198422 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:14.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1cf22700 1 --2- 172.21.15.123:0/1190198422 >> v2:172.21.15.145:3300/0 conn(0x7f7d1815bff0 0x7f7d180ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 -- 172.21.15.123:0/1190198422 >> v2:172.21.15.145:3300/0 conn(0x7f7d1815bff0 msgr2=0x7f7d180ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:14.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 --2- 172.21.15.123:0/1190198422 >> v2:172.21.15.145:3300/0 conn(0x7f7d1815bff0 0x7f7d180ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 -- 172.21.15.123:0/1190198422 >> v1:172.21.15.145:6789/0 conn(0x7f7d180cd070 legacy=0x7f7d180ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 -- 172.21.15.123:0/1190198422 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180af2f0 con 0x7f7d180cf1c0 2023-07-21T19:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1cf22700 1 --2- 172.21.15.123:0/1190198422 >> v2:172.21.15.145:3300/0 conn(0x7f7d1815bff0 0x7f7d180ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.522+0000 7f7d1d723700 1 --2- 172.21.15.123:0/1190198422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cf1c0 0x7f7d180afdd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d1808ac70 tx=0x7f7d1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bae3464c52c493f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d177fe700 1 -- 172.21.15.123:0/1190198422 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1000e070 con 0x7f7d180cf1c0 2023-07-21T19:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d177fe700 1 -- 172.21.15.123:0/1190198422 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10003a40 con 0x7f7d180cf1c0 2023-07-21T19:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d177fe700 1 -- 172.21.15.123:0/1190198422 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10003df0 con 0x7f7d180cf1c0 2023-07-21T19:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 -- 172.21.15.123:0/1190198422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cf1c0 msgr2=0x7f7d180afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 --2- 172.21.15.123:0/1190198422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cf1c0 0x7f7d180afdd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d1808ac70 tx=0x7f7d1000b330 comp rx=0 tx=0).stop 2023-07-21T19:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 -- 172.21.15.123:0/1190198422 shutdown_connections 2023-07-21T19:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 --2- 172.21.15.123:0/1190198422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cf1c0 0x7f7d180afdd0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 --2- 172.21.15.123:0/1190198422 >> v2:172.21.15.145:3300/0 conn(0x7f7d1815bff0 0x7f7d180ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 -- 172.21.15.123:0/1190198422 >> 172.21.15.123:0/1190198422 conn(0x7f7d18060c40 msgr2=0x7f7d1809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 -- 172.21.15.123:0/1190198422 shutdown_connections 2023-07-21T19:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.526+0000 7f7d1df24700 1 -- 172.21.15.123:0/1190198422 wait complete. 2023-07-21T19:09:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 Processor -- start 2023-07-21T19:09:14.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 -- start start 2023-07-21T19:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 0x7f7d181f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d180cf1c0 0x7f7d1815df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d1815bff0 0x7f7d1806fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18155ae0 con 0x7f7d180cd070 2023-07-21T19:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d181f10a0 con 0x7f7d1815bff0 2023-07-21T19:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1df24700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180b54b0 con 0x7f7d180cf1c0 2023-07-21T19:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1cf22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 0x7f7d181f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1cf22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 0x7f7d181f0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34498/0 (socket says 172.21.15.123:34498) 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.530+0000 7f7d1cf22700 1 -- 172.21.15.123:0/3382881392 learned_addr learned my addr 172.21.15.123:0/3382881392 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d17fff700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d180cf1c0 0x7f7d1815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1d723700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d1815bff0 0x7f7d1806fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1cf22700 1 -- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d180cf1c0 msgr2=0x7f7d1815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1cf22700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d180cf1c0 0x7f7d1815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1cf22700 1 -- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d1815bff0 msgr2=0x7f7d1806fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1cf22700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d1815bff0 0x7f7d1806fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1cf22700 1 -- 172.21.15.123:0/3382881392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009b30 con 0x7f7d180cd070 2023-07-21T19:09:14.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1cf22700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 0x7f7d181f0b60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c7c0 tx=0x7f7d0c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011800 con 0x7f7d180cd070 2023-07-21T19:09:14.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c011960 con 0x7f7d180cd070 2023-07-21T19:09:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d180b5790 con 0x7f7d180cd070 2023-07-21T19:09:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011cf0 con 0x7f7d180cd070 2023-07-21T19:09:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d180b5d50 con 0x7f7d180cd070 2023-07-21T19:09:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.534+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1804e500 con 0x7f7d180cd070 2023-07-21T19:09:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.538+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d0c021350 con 0x7f7d180cd070 2023-07-21T19:09:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.538+0000 7f7d157fa700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7cfc0662f0 0x7f7cfc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.538+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7d0c083fc0 con 0x7f7d180cd070 2023-07-21T19:09:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.538+0000 7f7d17fff700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7cfc0662f0 0x7f7cfc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.538+0000 7f7d17fff700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7cfc0662f0 0x7f7cfc0687a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c9120 tx=0x7f7d04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.546+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7d0c0b4720 con 0x7f7d180cd070 2023-07-21T19:09:14.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.754+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d180c5d70 con 0x7f7d180cd070 2023-07-21T19:09:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.754+0000 7f7d157fa700 1 -- 172.21.15.123:0/3382881392 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f7d0c054bb0 con 0x7f7d180cd070 2023-07-21T19:09:14.768 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:09:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.754+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7cfc0662f0 msgr2=0x7f7cfc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.754+0000 7f7d1df24700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7cfc0662f0 0x7f7cfc0687a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c9120 tx=0x7f7d04008040 comp rx=0 tx=0).stop 2023-07-21T19:09:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.754+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 msgr2=0x7f7d181f0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.754+0000 7f7d1df24700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 0x7f7d181f0b60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c7c0 tx=0x7f7d0c00cb80 comp rx=0 tx=0).stop 2023-07-21T19:09:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 shutdown_connections 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7cfc0662f0 0x7f7cfc0687a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d1815bff0 0x7f7d1806fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d180cf1c0 0x7f7d1815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 --2- 172.21.15.123:0/3382881392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d180cd070 0x7f7d181f0b60 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 >> 172.21.15.123:0/3382881392 conn(0x7f7d18060c40 msgr2=0x7f7d180d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 shutdown_connections 2023-07-21T19:09:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.758+0000 7f7d1df24700 1 -- 172.21.15.123:0/3382881392 wait complete. 2023-07-21T19:09:14.773 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:09:14.791 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:09:14.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.950+0000 7fef3c7ae700 1 Processor -- start 2023-07-21T19:09:14.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.950+0000 7fef3c7ae700 1 -- start start 2023-07-21T19:09:14.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef3c7ae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef3406be70 0x7fef340cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef3c7ae700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340cc1b0 con 0x7fef340c1e00 2023-07-21T19:09:14.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef3c7ae700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340cd690 con 0x7fef3406d860 2023-07-21T19:09:14.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef3c7ae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef340cd970 con 0x7fef3406be70 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef3ad4b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef340c1e00 0x7fef340cc640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41146/0 (socket says 172.21.15.123:41146) 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef3ad4b700 1 -- 172.21.15.123:0/2262094477 learned_addr learned my addr 172.21.15.123:0/2262094477 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39d49700 1 --2- 172.21.15.123:0/2262094477 >> v2:172.21.15.123:3300/0 conn(0x7fef3406be70 0x7fef340cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39548700 1 -- 172.21.15.123:0/2262094477 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819774590 0 0) 0x7fef340cc1b0 con 0x7fef340c1e00 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39548700 1 -- 172.21.15.123:0/2262094477 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef200035d0 con 0x7fef340c1e00 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39d49700 1 -- 172.21.15.123:0/2262094477 >> v1:172.21.15.145:6789/0 conn(0x7fef3406d860 legacy=0x7fef3406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39d49700 1 -- 172.21.15.123:0/2262094477 >> v1:172.21.15.123:6789/0 conn(0x7fef340c1e00 legacy=0x7fef340cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39d49700 1 -- 172.21.15.123:0/2262094477 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340cdc50 con 0x7fef3406be70 2023-07-21T19:09:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.954+0000 7fef39d49700 1 --2- 172.21.15.123:0/2262094477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3406be70 0x7fef340cb840 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fef24009850 tx=0x7fef24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a299b11d2611bd5c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef39548700 1 -- 172.21.15.123:0/2262094477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24011830 con 0x7fef3406be70 2023-07-21T19:09:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef39548700 1 -- 172.21.15.123:0/2262094477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24011990 con 0x7fef3406be70 2023-07-21T19:09:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef39548700 1 -- 172.21.15.123:0/2262094477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24011d40 con 0x7fef3406be70 2023-07-21T19:09:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 -- 172.21.15.123:0/2262094477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3406be70 msgr2=0x7fef340cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/2262094477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3406be70 0x7fef340cb840 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fef24009850 tx=0x7fef24009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 -- 172.21.15.123:0/2262094477 shutdown_connections 2023-07-21T19:09:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/2262094477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3406be70 0x7fef340cb840 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 -- 172.21.15.123:0/2262094477 >> 172.21.15.123:0/2262094477 conn(0x7fef340cad30 msgr2=0x7fef340cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 -- 172.21.15.123:0/2262094477 shutdown_connections 2023-07-21T19:09:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 -- 172.21.15.123:0/2262094477 wait complete. 2023-07-21T19:09:14.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 Processor -- start 2023-07-21T19:09:14.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.958+0000 7fef3c7ae700 1 -- start start 2023-07-21T19:09:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef3406be70 0x7fef340ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef3406d860 0x7fef3415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef340c1e00 0x7fef341f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340ac9e0 con 0x7fef340c1e00 2023-07-21T19:09:14.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340abdd0 con 0x7fef3406be70 2023-07-21T19:09:14.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340ac0b0 con 0x7fef3406d860 2023-07-21T19:09:14.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef340c1e00 0x7fef341f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3a54a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef3406be70 0x7fef340ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3a54a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef3406be70 0x7fef340ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:42548/0 (socket says 172.21.15.123:42548) 2023-07-21T19:09:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3a54a700 1 -- 172.21.15.123:0/3426435258 learned_addr learned my addr 172.21.15.123:0/3426435258 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef39d49700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef3406d860 0x7fef3415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 -- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef3406d860 msgr2=0x7fef3415bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef3406d860 0x7fef3415bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 -- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef3406be70 msgr2=0x7fef340ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:14.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef3406be70 0x7fef340ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:14.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 -- 172.21.15.123:0/3426435258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240094b0 con 0x7fef340c1e00 2023-07-21T19:09:14.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3ad4b700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef340c1e00 0x7fef341f2450 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c390 tx=0x7fef2c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c005b60 con 0x7fef340c1e00 2023-07-21T19:09:14.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c005cc0 con 0x7fef340c1e00 2023-07-21T19:09:14.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef340ac390 con 0x7fef340c1e00 2023-07-21T19:09:14.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c007310 con 0x7fef340c1e00 2023-07-21T19:09:14.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.962+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef34153cf0 con 0x7fef340c1e00 2023-07-21T19:09:14.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.966+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef34153e80 con 0x7fef340c1e00 2023-07-21T19:09:14.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.966+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef2c007470 con 0x7fef340c1e00 2023-07-21T19:09:14.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.966+0000 7fef2affd700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef180662f0 0x7fef180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:14.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.970+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fef2c082f60 con 0x7fef340c1e00 2023-07-21T19:09:14.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.970+0000 7fef3a54a700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef180662f0 0x7fef180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:14.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.970+0000 7fef3a54a700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef180662f0 0x7fef180687a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fef3000f3b0 tx=0x7fef30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:14.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:14.974+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fef2c0500b0 con 0x7fef340c1e00 2023-07-21T19:09:15.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.182+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef3404dcb0 con 0x7fef340c1e00 2023-07-21T19:09:15.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.182+0000 7fef2affd700 1 -- 172.21.15.123:0/3426435258 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7fef2c0536d0 con 0x7fef340c1e00 2023-07-21T19:09:15.198 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:15.198 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2624174761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2624174761},{"type":"v1","addr":"172.21.15.123:6835","nonce":2624174761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/835216779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":835216779},{"type":"v1","addr":"172.21.15.123:6837","nonce":835216779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/727601096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":727601096},{"type":"v1","addr":"172.21.15.145:6834","nonce":727601096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:07:47.865751+0000","modified":"2023-07-21T19:08:08.624163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6835/2690918060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":2690918060},{"type":"v1","addr":"172.21.15.145:6835","nonce":2690918060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T19:09:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef180662f0 msgr2=0x7fef180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef180662f0 0x7fef180687a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fef3000f3b0 tx=0x7fef30009040 comp rx=0 tx=0).stop 2023-07-21T19:09:15.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef340c1e00 msgr2=0x7fef341f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef340c1e00 0x7fef341f2450 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c390 tx=0x7fef2c00c6a0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 shutdown_connections 2023-07-21T19:09:15.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fef180662f0 0x7fef180687a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef340c1e00 0x7fef341f2450 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef3406d860 0x7fef3415bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 --2- 172.21.15.123:0/3426435258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef3406be70 0x7fef340ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 >> 172.21.15.123:0/3426435258 conn(0x7fef340cad30 msgr2=0x7fef340703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 shutdown_connections 2023-07-21T19:09:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.186+0000 7fef3c7ae700 1 -- 172.21.15.123:0/3426435258 wait complete. 2023-07-21T19:09:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2023-07-21T19:09:15.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:15.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.370+0000 7f6ff4d84700 1 Processor -- start 2023-07-21T19:09:15.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.370+0000 7f6ff4d84700 1 -- start start 2023-07-21T19:09:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6ff4d84700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ff00c9d90 0x7f6ff00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6ff4d84700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff00b0ef0 con 0x7f6ff015d7f0 2023-07-21T19:09:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6ff4d84700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff00ce9c0 con 0x7f6ff0159f20 2023-07-21T19:09:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6ff4d84700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff00cee50 con 0x7f6ff00c9d90 2023-07-21T19:09:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6fef7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ff00c9d90 0x7f6ff00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6feffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6ff015d7f0 0x7f6ff015dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41150/0 (socket says 172.21.15.123:41150) 2023-07-21T19:09:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6feffff700 1 -- 172.21.15.123:0/1031439039 learned_addr learned my addr 172.21.15.123:0/1031439039 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6fef7fe700 1 -- 172.21.15.123:0/1031439039 >> v1:172.21.15.145:6789/0 conn(0x7f6ff0159f20 legacy=0x7f6ff00caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6fef7fe700 1 -- 172.21.15.123:0/1031439039 >> v1:172.21.15.123:6789/0 conn(0x7f6ff015d7f0 legacy=0x7f6ff015dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6fef7fe700 1 -- 172.21.15.123:0/1031439039 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00ca6a0 con 0x7f6ff00c9d90 2023-07-21T19:09:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6feeffd700 1 -- 172.21.15.123:0/1031439039 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209938568 0 0) 0x7f6ff00b0ef0 con 0x7f6ff015d7f0 2023-07-21T19:09:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6fef7fe700 1 --2- 172.21.15.123:0/1031439039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff00c9d90 0x7f6ff00ca160 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009850 tx=0x7f6fe0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeb327322d4b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:15.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6feeffd700 1 -- 172.21.15.123:0/1031439039 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0011830 con 0x7f6ff00c9d90 2023-07-21T19:09:15.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6feeffd700 1 -- 172.21.15.123:0/1031439039 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0011990 con 0x7f6ff00c9d90 2023-07-21T19:09:15.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.374+0000 7f6feeffd700 1 -- 172.21.15.123:0/1031439039 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0011d20 con 0x7f6ff00c9d90 2023-07-21T19:09:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1031439039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff00c9d90 msgr2=0x7f6ff00ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1031439039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff00c9d90 0x7f6ff00ca160 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009850 tx=0x7f6fe0009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1031439039 shutdown_connections 2023-07-21T19:09:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1031439039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff00c9d90 0x7f6ff00ca160 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1031439039 >> 172.21.15.123:0/1031439039 conn(0x7f6ff006e960 msgr2=0x7f6ff006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1031439039 shutdown_connections 2023-07-21T19:09:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1031439039 wait complete. 2023-07-21T19:09:15.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 Processor -- start 2023-07-21T19:09:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.378+0000 7f6ff4d84700 1 -- start start 2023-07-21T19:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ff00c9d90 0x7f6ff0151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff0159f20 0x7f6ff00c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 0x7f6ff01e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00c4100 con 0x7f6ff015d7f0 2023-07-21T19:09:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00c23a0 con 0x7f6ff0159f20 2023-07-21T19:09:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00c20c0 con 0x7f6ff00c9d90 2023-07-21T19:09:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 0x7f6ff01e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 0x7f6ff01e3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34518/0 (socket says 172.21.15.123:34518) 2023-07-21T19:09:15.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 -- 172.21.15.123:0/1310188011 learned_addr learned my addr 172.21.15.123:0/1310188011 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6fe7fff700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff0159f20 0x7f6ff00c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6fef7fe700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ff00c9d90 0x7f6ff0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 -- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ff00c9d90 msgr2=0x7f6ff0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ff00c9d90 0x7f6ff0151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 -- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff0159f20 msgr2=0x7f6ff00c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff0159f20 0x7f6ff00c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 -- 172.21.15.123:0/1310188011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00094b0 con 0x7f6ff015d7f0 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6feffff700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 0x7f6ff01e3c30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800cb60 tx=0x7f6fe800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800ab50 con 0x7f6ff015d7f0 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe800acb0 con 0x7f6ff015d7f0 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8007310 con 0x7f6ff015d7f0 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff00c4330 con 0x7f6ff015d7f0 2023-07-21T19:09:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.382+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff00c48f0 con 0x7f6ff015d7f0 2023-07-21T19:09:15.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.386+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00c4b10 con 0x7f6ff015d7f0 2023-07-21T19:09:15.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.386+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fe8007470 con 0x7f6ff015d7f0 2023-07-21T19:09:15.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.390+0000 7f6fecff9700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6fd40662f0 0x7f6fd40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.390+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6fe8083c60 con 0x7f6ff015d7f0 2023-07-21T19:09:15.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.390+0000 7f6fef7fe700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6fd40662f0 0x7f6fd40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.390+0000 7f6fef7fe700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6fd40662f0 0x7f6fd40687a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00090b0 tx=0x7f6fe0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:15.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.394+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6fe8050d10 con 0x7f6ff015d7f0 2023-07-21T19:09:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.570+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ff004e500 con 0x7f6ff015d7f0 2023-07-21T19:09:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.574+0000 7f6fecff9700 1 -- 172.21.15.123:0/1310188011 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f6fe8018020 con 0x7f6ff015d7f0 2023-07-21T19:09:15.590 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:15.590 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:08:30.770032+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:07:46.025897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T19:07:46.872387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-21T19:07:50.533523+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:15.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6fd40662f0 msgr2=0x7f6fd40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6fd40662f0 0x7f6fd40687a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00090b0 tx=0x7f6fe0008030 comp rx=0 tx=0).stop 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 msgr2=0x7f6ff01e3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 0x7f6ff01e3c30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800cb60 tx=0x7f6fe800cf20 comp rx=0 tx=0).stop 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 shutdown_connections 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6fd40662f0 0x7f6fd40687a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff0159f20 0x7f6ff00c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ff015d7f0 0x7f6ff01e3c30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 --2- 172.21.15.123:0/1310188011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ff00c9d90 0x7f6ff0151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 >> 172.21.15.123:0/1310188011 conn(0x7f6ff006e960 msgr2=0x7f6ff01522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 shutdown_connections 2023-07-21T19:09:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.578+0000 7f6ff4d84700 1 -- 172.21.15.123:0/1310188011 wait complete. 2023-07-21T19:09:15.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T19:09:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.774+0000 7fc70efc3700 1 Processor -- start 2023-07-21T19:09:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.774+0000 7fc70efc3700 1 -- start start 2023-07-21T19:09:15.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70efc3700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc7080cb180 0x7fc7080ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70efc3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7080ca8a0 con 0x7fc70815ffa0 2023-07-21T19:09:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70efc3700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7080cbcd0 con 0x7fc708160370 2023-07-21T19:09:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70efc3700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080cbf70 con 0x7fc7080cb180 2023-07-21T19:09:15.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70dfc1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc70815ffa0 0x7fc70806d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41158/0 (socket says 172.21.15.123:41158) 2023-07-21T19:09:15.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70dfc1700 1 -- 172.21.15.123:0/419014522 learned_addr learned my addr 172.21.15.123:0/419014522 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:15.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70e7c2700 1 --2- 172.21.15.123:0/419014522 >> v2:172.21.15.145:3300/0 conn(0x7fc7080cb180 0x7fc7080ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70cfbf700 1 -- 172.21.15.123:0/419014522 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637734931 0 0) 0x7fc704001110 con 0x7fc70815ffa0 2023-07-21T19:09:15.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70cfbf700 1 -- 172.21.15.123:0/419014522 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f40035d0 con 0x7fc70815ffa0 2023-07-21T19:09:15.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70e7c2700 1 -- 172.21.15.123:0/419014522 >> v1:172.21.15.145:6789/0 conn(0x7fc708160370 legacy=0x7fc7080caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70cfbf700 1 -- 172.21.15.123:0/419014522 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990086093 0 0) 0x7fc7080cbcd0 con 0x7fc708160370 2023-07-21T19:09:15.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70e7c2700 1 -- 172.21.15.123:0/419014522 >> v1:172.21.15.123:6789/0 conn(0x7fc70815ffa0 legacy=0x7fc70806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.778+0000 7fc70e7c2700 1 -- 172.21.15.123:0/419014522 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080cc250 con 0x7fc7080cb180 2023-07-21T19:09:15.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70e7c2700 1 --2- 172.21.15.123:0/419014522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7080cb180 0x7fc7080ce340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc700009d90 tx=0x7fc70000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4166c520fe962839 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:15.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70cfbf700 1 -- 172.21.15.123:0/419014522 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000e070 con 0x7fc7080cb180 2023-07-21T19:09:15.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70cfbf700 1 -- 172.21.15.123:0/419014522 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700003a40 con 0x7fc7080cb180 2023-07-21T19:09:15.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70cfbf700 1 -- 172.21.15.123:0/419014522 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704001820 con 0x7fc7080cb180 2023-07-21T19:09:15.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 -- 172.21.15.123:0/419014522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7080cb180 msgr2=0x7fc7080ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 --2- 172.21.15.123:0/419014522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7080cb180 0x7fc7080ce340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc700009d90 tx=0x7fc70000b330 comp rx=0 tx=0).stop 2023-07-21T19:09:15.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 -- 172.21.15.123:0/419014522 shutdown_connections 2023-07-21T19:09:15.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 --2- 172.21.15.123:0/419014522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7080cb180 0x7fc7080ce340 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 -- 172.21.15.123:0/419014522 >> 172.21.15.123:0/419014522 conn(0x7fc70806e960 msgr2=0x7fc70806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:15.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 -- 172.21.15.123:0/419014522 shutdown_connections 2023-07-21T19:09:15.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.782+0000 7fc70efc3700 1 -- 172.21.15.123:0/419014522 wait complete. 2023-07-21T19:09:15.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 Processor -- start 2023-07-21T19:09:15.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 -- start start 2023-07-21T19:09:15.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 0x7fc70815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.800 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815ffa0 0x7fc7080c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc708160370 0x7fc7080c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c3be0 con 0x7fc7080cb180 2023-07-21T19:09:15.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c2f60 con 0x7fc70815ffa0 2023-07-21T19:09:15.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70efc3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c3240 con 0x7fc708160370 2023-07-21T19:09:15.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 0x7fc70815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 0x7fc70815c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34522/0 (socket says 172.21.15.123:34522) 2023-07-21T19:09:15.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 -- 172.21.15.123:0/2982848770 learned_addr learned my addr 172.21.15.123:0/2982848770 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:15.802 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70d7c0700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815ffa0 0x7fc7080c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70e7c2700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc708160370 0x7fc7080c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 -- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc708160370 msgr2=0x7fc7080c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc708160370 0x7fc7080c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 -- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815ffa0 msgr2=0x7fc7080c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815ffa0 0x7fc7080c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 -- 172.21.15.123:0/2982848770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700009a70 con 0x7fc7080cb180 2023-07-21T19:09:15.803 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70d7c0700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815ffa0 0x7fc7080c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:15.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc70dfc1700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 0x7fc70815c290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c780 tx=0x7fc70400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:15.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.786+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704004ca0 con 0x7fc7080cb180 2023-07-21T19:09:15.804 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.790+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704004e20 con 0x7fc7080cb180 2023-07-21T19:09:15.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.790+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7080c3520 con 0x7fc7080cb180 2023-07-21T19:09:15.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.790+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704007310 con 0x7fc7080cb180 2023-07-21T19:09:15.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.790+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7080c8270 con 0x7fc7080cb180 2023-07-21T19:09:15.805 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.790+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70804e500 con 0x7fc7080cb180 2023-07-21T19:09:15.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.790+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc704007470 con 0x7fc7080cb180 2023-07-21T19:09:15.808 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.794+0000 7fc6fe7fc700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:15.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.794+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc704083150 con 0x7fc7080cb180 2023-07-21T19:09:15.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.794+0000 7fc70d7c0700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:15.809 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.794+0000 7fc70d7c0700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7080c8530 tx=0x7fc6f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:15.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:15.802+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc704050200 con 0x7fc7080cb180 2023-07-21T19:09:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.014+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7080ca8a0 con 0x7fc7080cb180 2023-07-21T19:09:16.030 INFO:tasks.ceph.mon.a.smithi123.stderr:2023-07-21T19:09:16.014+0000 7fd13f7f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T19:09:16.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.022+0000 7fc6fe7fc700 1 -- 172.21.15.123:0/2982848770 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7080ca8a0 con 0x7fc7080cb180 2023-07-21T19:09:16.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6ec0662f0 msgr2=0x7fc6ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:16.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7080c8530 tx=0x7fc6f8009040 comp rx=0 tx=0).stop 2023-07-21T19:09:16.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 msgr2=0x7fc70815c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:16.042 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 0x7fc70815c290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c780 tx=0x7fc70400cb40 comp rx=0 tx=0).stop 2023-07-21T19:09:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 shutdown_connections 2023-07-21T19:09:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815ffa0 0x7fc7080c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc708160370 0x7fc7080c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 --2- 172.21.15.123:0/2982848770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7080cb180 0x7fc70815c290 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 >> 172.21.15.123:0/2982848770 conn(0x7fc70806e960 msgr2=0x7fc7080caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 shutdown_connections 2023-07-21T19:09:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.026+0000 7fc70efc3700 1 -- 172.21.15.123:0/2982848770 wait complete. 2023-07-21T19:09:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T19:09:16.054 INFO:tasks.ceph.mds.d.smithi145.stderr: -4866> 2023-07-21T19:07:53.534+0000 7f883c7cd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T19:09:16.060 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T19:09:16.117 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2023-07-21T19:09:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.230+0000 7f2c2b1be700 1 Processor -- start 2023-07-21T19:09:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.230+0000 7f2c2b1be700 1 -- start start 2023-07-21T19:09:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.230+0000 7f2c2b1be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c24158a20 0x7f2c240cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.230+0000 7f2c2b1be700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c2406c220 0x7f2c240cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.230+0000 7f2c2b1be700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2406d310 con 0x7f2c240cb820 2023-07-21T19:09:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.230+0000 7f2c2b1be700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2406c700 con 0x7f2c2406c220 2023-07-21T19:09:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2b1be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2406c9e0 con 0x7f2c24158a20 2023-07-21T19:09:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a9bd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2c240cb820 0x7f2c2406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41174/0 (socket says 172.21.15.123:41174) 2023-07-21T19:09:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a9bd700 1 -- 172.21.15.123:0/460382357 learned_addr learned my addr 172.21.15.123:0/460382357 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a1bc700 1 --2- 172.21.15.123:0/460382357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c24158a20 0x7f2c240cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c299bb700 1 --2- 172.21.15.123:0/460382357 >> v2:172.21.15.123:3300/0 conn(0x7f2c2406c220 0x7f2c240cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c291ba700 1 -- 172.21.15.123:0/460382357 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940793896 0 0) 0x7f2c2406d310 con 0x7f2c240cb820 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c291ba700 1 -- 172.21.15.123:0/460382357 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c100057e0 con 0x7f2c240cb820 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a1bc700 1 -- 172.21.15.123:0/460382357 >> v2:172.21.15.123:3300/0 conn(0x7f2c2406c220 msgr2=0x7f2c240cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a1bc700 1 --2- 172.21.15.123:0/460382357 >> v2:172.21.15.123:3300/0 conn(0x7f2c2406c220 0x7f2c240cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a1bc700 1 -- 172.21.15.123:0/460382357 >> v1:172.21.15.123:6789/0 conn(0x7f2c240cb820 legacy=0x7f2c2406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a1bc700 1 -- 172.21.15.123:0/460382357 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2406ccc0 con 0x7f2c24158a20 2023-07-21T19:09:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c299bb700 1 --2- 172.21.15.123:0/460382357 >> v2:172.21.15.123:3300/0 conn(0x7f2c2406c220 0x7f2c240cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c2a1bc700 1 --2- 172.21.15.123:0/460382357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c24158a20 0x7f2c240cb2e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009850 tx=0x7f2c20009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204f0b0dc981bed7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.234+0000 7f2c291ba700 1 -- 172.21.15.123:0/460382357 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20011830 con 0x7f2c24158a20 2023-07-21T19:09:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c291ba700 1 -- 172.21.15.123:0/460382357 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c20011990 con 0x7f2c24158a20 2023-07-21T19:09:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c291ba700 1 -- 172.21.15.123:0/460382357 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20011d40 con 0x7f2c24158a20 2023-07-21T19:09:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 -- 172.21.15.123:0/460382357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c24158a20 msgr2=0x7f2c240cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/460382357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c24158a20 0x7f2c240cb2e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009850 tx=0x7f2c20009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 -- 172.21.15.123:0/460382357 shutdown_connections 2023-07-21T19:09:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/460382357 >> v2:172.21.15.123:3300/0 conn(0x7f2c2406c220 0x7f2c240cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/460382357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c24158a20 0x7f2c240cb2e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 -- 172.21.15.123:0/460382357 >> 172.21.15.123:0/460382357 conn(0x7f2c240afc60 msgr2=0x7f2c240b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 -- 172.21.15.123:0/460382357 shutdown_connections 2023-07-21T19:09:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.238+0000 7f2c2b1be700 1 -- 172.21.15.123:0/460382357 wait complete. 2023-07-21T19:09:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 Processor -- start 2023-07-21T19:09:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 -- start start 2023-07-21T19:09:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c2406c220 0x7f2c241f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c240cb820 0x7f2c2415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 0x7f2c241548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2415aca0 con 0x7f2c24158a20 2023-07-21T19:09:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241f25b0 con 0x7f2c240cb820 2023-07-21T19:09:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2b1be700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241e2830 con 0x7f2c2406c220 2023-07-21T19:09:16.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 0x7f2c241548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 0x7f2c241548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34548/0 (socket says 172.21.15.123:34548) 2023-07-21T19:09:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 -- 172.21.15.123:0/2782257541 learned_addr learned my addr 172.21.15.123:0/2782257541 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c299bb700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c240cb820 0x7f2c2415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a1bc700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c2406c220 0x7f2c241f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 -- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c2406c220 msgr2=0x7f2c241f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c2406c220 0x7f2c241f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 -- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c240cb820 msgr2=0x7f2c2415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c240cb820 0x7f2c2415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 -- 172.21.15.123:0/2782257541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140094b0 con 0x7f2c24158a20 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c2a9bd700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 0x7f2c241548b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00cb40 tx=0x7f2c1c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.242+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c007500 con 0x7f2c24158a20 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c007660 con 0x7f2c24158a20 2023-07-21T19:09:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c200094b0 con 0x7f2c24158a20 2023-07-21T19:09:16.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0079f0 con 0x7f2c24158a20 2023-07-21T19:09:16.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2415a930 con 0x7f2c24158a20 2023-07-21T19:09:16.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c24071860 con 0x7f2c24158a20 2023-07-21T19:09:16.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c1c0113a0 con 0x7f2c24158a20 2023-07-21T19:09:16.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c1affd700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2c08066320 0x7f2c080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:16.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f2c1c083ac0 con 0x7f2c24158a20 2023-07-21T19:09:16.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.246+0000 7f2c2a1bc700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2c08066320 0x7f2c080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:16.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.250+0000 7f2c2a1bc700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2c08066320 0x7f2c080687d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c200090b0 tx=0x7f2c20008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:16.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.250+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2c1c050bb0 con 0x7f2c24158a20 2023-07-21T19:09:16.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:16.470+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2c2404e500 con 0x7f2c24158a20 2023-07-21T19:09:17.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c1affd700 1 -- 172.21.15.123:0/2782257541 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2c1c0541d0 con 0x7f2c24158a20 2023-07-21T19:09:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2c08066320 msgr2=0x7f2c080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2c08066320 0x7f2c080687d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c200090b0 tx=0x7f2c20008030 comp rx=0 tx=0).stop 2023-07-21T19:09:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 msgr2=0x7f2c241548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 0x7f2c241548b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00cb40 tx=0x7f2c1c00cb70 comp rx=0 tx=0).stop 2023-07-21T19:09:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 shutdown_connections 2023-07-21T19:09:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f2c08066320 0x7f2c080687d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c240cb820 0x7f2c2415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c24158a20 0x7f2c241548b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 --2- 172.21.15.123:0/2782257541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c2406c220 0x7f2c241f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 >> 172.21.15.123:0/2782257541 conn(0x7f2c240afc60 msgr2=0x7f2c240cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:17.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 shutdown_connections 2023-07-21T19:09:17.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.030+0000 7f2c2b1be700 1 -- 172.21.15.123:0/2782257541 wait complete. 2023-07-21T19:09:17.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T19:09:17.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 Processor -- start 2023-07-21T19:09:17.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 -- start start 2023-07-21T19:09:17.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78541597a0 0x7f78540c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78540705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7854071560 con 0x7f78540cada0 2023-07-21T19:09:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7854070cc0 con 0x7f78541597a0 2023-07-21T19:09:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.222+0000 7f785359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854070fa0 con 0x7f7854159b70 2023-07-21T19:09:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78541597a0 0x7f78540c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78541597a0 0x7f78540c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34552/0 (socket says 172.21.15.123:34552) 2023-07-21T19:09:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 -- 172.21.15.123:0/152809251 learned_addr learned my addr 172.21.15.123:0/152809251 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f7851d9b700 1 --2- 172.21.15.123:0/152809251 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78540705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 -- 172.21.15.123:0/152809251 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 msgr2=0x7f78540705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 --2- 172.21.15.123:0/152809251 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78540705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 -- 172.21.15.123:0/152809251 >> v1:172.21.15.145:6789/0 conn(0x7f78540cada0 legacy=0x7f78540cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 -- 172.21.15.123:0/152809251 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854071280 con 0x7f78541597a0 2023-07-21T19:09:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785259c700 1 --2- 172.21.15.123:0/152809251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78541597a0 0x7f78540c87a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7844009910 tx=0x7f7844009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9e0e74fb17d70 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785159a700 1 -- 172.21.15.123:0/152809251 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844011830 con 0x7f78541597a0 2023-07-21T19:09:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785159a700 1 -- 172.21.15.123:0/152809251 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844011990 con 0x7f78541597a0 2023-07-21T19:09:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785159a700 1 -- 172.21.15.123:0/152809251 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844011d40 con 0x7f78541597a0 2023-07-21T19:09:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 -- 172.21.15.123:0/152809251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78541597a0 msgr2=0x7f78540c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 --2- 172.21.15.123:0/152809251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78541597a0 0x7f78540c87a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7844009910 tx=0x7f7844009c20 comp rx=0 tx=0).stop 2023-07-21T19:09:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 -- 172.21.15.123:0/152809251 shutdown_connections 2023-07-21T19:09:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 --2- 172.21.15.123:0/152809251 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78540705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 --2- 172.21.15.123:0/152809251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78541597a0 0x7f78540c87a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 -- 172.21.15.123:0/152809251 >> 172.21.15.123:0/152809251 conn(0x7f78540afc60 msgr2=0x7f78540b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 -- 172.21.15.123:0/152809251 shutdown_connections 2023-07-21T19:09:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.226+0000 7f785359e700 1 -- 172.21.15.123:0/152809251 wait complete. 2023-07-21T19:09:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.230+0000 7f785359e700 1 Processor -- start 2023-07-21T19:09:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.230+0000 7f785359e700 1 -- start start 2023-07-21T19:09:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 0x7f7854157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78541597a0 0x7f78541f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78541f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785415da10 con 0x7f78540cada0 2023-07-21T19:09:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785415dcf0 con 0x7f78541597a0 2023-07-21T19:09:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785415dfd0 con 0x7f7854159b70 2023-07-21T19:09:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 0x7f7854157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 0x7f7854157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34564/0 (socket says 172.21.15.123:34564) 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 -- 172.21.15.123:0/1675431283 learned_addr learned my addr 172.21.15.123:0/1675431283 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f7851d9b700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78541597a0 0x7f78541f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f7852d9d700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78541f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 -- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 msgr2=0x7f78541f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78541f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 -- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78541597a0 msgr2=0x7f78541f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78541597a0 0x7f78541f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:17.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 -- 172.21.15.123:0/1675431283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844009570 con 0x7f78540cada0 2023-07-21T19:09:17.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785259c700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 0x7f7854157430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7844000c00 tx=0x7f7844004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:17.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844004590 con 0x7f78540cada0 2023-07-21T19:09:17.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78440036c0 con 0x7f78540cada0 2023-07-21T19:09:17.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844003a70 con 0x7f78540cada0 2023-07-21T19:09:17.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785415e2b0 con 0x7f78540cada0 2023-07-21T19:09:17.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.234+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78540c57c0 con 0x7f78540cada0 2023-07-21T19:09:17.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.238+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785404e500 con 0x7f78540cada0 2023-07-21T19:09:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.238+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7844003bd0 con 0x7f78540cada0 2023-07-21T19:09:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.238+0000 7f7842ffd700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78340662f0 0x7f78340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.238+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f7844021030 con 0x7f78540cada0 2023-07-21T19:09:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.238+0000 7f7851d9b700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78340662f0 0x7f78340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.238+0000 7f7851d9b700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78340662f0 0x7f78340687a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f785415b900 tx=0x7f7848009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:17.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.246+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7844052870 con 0x7f78540cada0 2023-07-21T19:09:17.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:17.418+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f785406dcf0 con 0x7f78540cada0 2023-07-21T19:09:18.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.034+0000 7f7842ffd700 1 -- 172.21.15.123:0/1675431283 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7844055e90 con 0x7f78540cada0 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78340662f0 msgr2=0x7f78340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78340662f0 0x7f78340687a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f785415b900 tx=0x7f7848009240 comp rx=0 tx=0).stop 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 msgr2=0x7f7854157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 0x7f7854157430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7844000c00 tx=0x7f7844004770 comp rx=0 tx=0).stop 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 shutdown_connections 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78340662f0 0x7f78340687a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78541597a0 0x7f78541f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7854159b70 0x7f78541f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 --2- 172.21.15.123:0/1675431283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78540cada0 0x7f7854157430 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 >> 172.21.15.123:0/1675431283 conn(0x7f78540afc60 msgr2=0x7f785415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:18.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 shutdown_connections 2023-07-21T19:09:18.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.038+0000 7f785359e700 1 -- 172.21.15.123:0/1675431283 wait complete. 2023-07-21T19:09:18.057 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2023-07-21T19:09:18.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T19:09:18.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.242+0000 7f50b89ff700 1 Processor -- start 2023-07-21T19:09:18.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.242+0000 7f50b89ff700 1 -- start start 2023-07-21T19:09:18.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b89ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:18.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b89ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f50b41605b0 0x7f50b40ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:18.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b89ff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b40af150 con 0x7f50b40cf410 2023-07-21T19:09:18.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b89ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b415c310 con 0x7f50b41605b0 2023-07-21T19:09:18.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b89ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40cf890 con 0x7f50b415bf40 2023-07-21T19:09:18.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b359e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50b40cf410 0x7f50b40d2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41186/0 (socket says 172.21.15.123:41186) 2023-07-21T19:09:18.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b359e700 1 -- 172.21.15.123:0/942168087 learned_addr learned my addr 172.21.15.123:0/942168087 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:18.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b259c700 1 --2- 172.21.15.123:0/942168087 >> v2:172.21.15.145:3300/0 conn(0x7f50b41605b0 0x7f50b40ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:18.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b2d9d700 1 --2- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:18.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b1d9b700 1 -- 172.21.15.123:0/942168087 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168409032 0 0) 0x7f50b40af150 con 0x7f50b40cf410 2023-07-21T19:09:18.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b1d9b700 1 -- 172.21.15.123:0/942168087 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c0035d0 con 0x7f50b40cf410 2023-07-21T19:09:18.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b259c700 1 -- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 msgr2=0x7f50b40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:18.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b259c700 1 --2- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b40d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b259c700 1 -- 172.21.15.123:0/942168087 >> v1:172.21.15.123:6789/0 conn(0x7f50b40cf410 legacy=0x7f50b40d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:18.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b1d9b700 1 -- 172.21.15.123:0/942168087 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1126181169 0 0) 0x7f509c0035d0 con 0x7f50b40cf410 2023-07-21T19:09:18.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b259c700 1 -- 172.21.15.123:0/942168087 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40d0900 con 0x7f50b41605b0 2023-07-21T19:09:18.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b259c700 1 --2- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b41605b0 0x7f50b40ceed0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009850 tx=0x7f50a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49dc32328757ac75 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:18.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b1d9b700 1 -- 172.21.15.123:0/942168087 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0019f0 con 0x7f50b41605b0 2023-07-21T19:09:18.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b1d9b700 1 -- 172.21.15.123:0/942168087 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8004030 con 0x7f50b41605b0 2023-07-21T19:09:18.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.246+0000 7f50b1d9b700 1 -- 172.21.15.123:0/942168087 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80043e0 con 0x7f50b41605b0 2023-07-21T19:09:18.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 -- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b41605b0 msgr2=0x7f50b40ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:18.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 --2- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b41605b0 0x7f50b40ceed0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009850 tx=0x7f50a8009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:18.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 -- 172.21.15.123:0/942168087 shutdown_connections 2023-07-21T19:09:18.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 --2- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b41605b0 0x7f50b40ceed0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 --2- 172.21.15.123:0/942168087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b40d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 -- 172.21.15.123:0/942168087 >> 172.21.15.123:0/942168087 conn(0x7f50b4060c40 msgr2=0x7f50b409b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:18.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 -- 172.21.15.123:0/942168087 shutdown_connections 2023-07-21T19:09:18.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.250+0000 7f50b89ff700 1 -- 172.21.15.123:0/942168087 wait complete. 2023-07-21T19:09:18.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 Processor -- start 2023-07-21T19:09:18.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 -- start start 2023-07-21T19:09:18.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b40cf410 0x7f50b41e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:18.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b4150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:18.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 0x7f50b4151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:18.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b41e5cc0 con 0x7f50b41605b0 2023-07-21T19:09:18.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40b5390 con 0x7f50b40cf410 2023-07-21T19:09:18.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b89ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40b5670 con 0x7f50b415bf40 2023-07-21T19:09:18.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 0x7f50b4151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:18.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 0x7f50b4151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34578/0 (socket says 172.21.15.123:34578) 2023-07-21T19:09:18.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 -- 172.21.15.123:0/3592089745 learned_addr learned my addr 172.21.15.123:0/3592089745 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:18.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b2d9d700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b40cf410 0x7f50b41e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:18.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b259c700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b4150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:18.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 -- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 msgr2=0x7f50b4150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:18.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b4150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 -- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b40cf410 msgr2=0x7f50b41e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:18.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.254+0000 7f50b359e700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b40cf410 0x7f50b41e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:18.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f50b359e700 1 -- 172.21.15.123:0/3592089745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80094b0 con 0x7f50b41605b0 2023-07-21T19:09:18.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f50b359e700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 0x7f50b4151380 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00cca0 tx=0x7f50ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:18.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00ab70 con 0x7f50b41605b0 2023-07-21T19:09:18.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac00acf0 con 0x7f50b41605b0 2023-07-21T19:09:18.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac007310 con 0x7f50b41605b0 2023-07-21T19:09:18.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4155f90 con 0x7f50b41605b0 2023-07-21T19:09:18.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b40b81f0 con 0x7f50b41605b0 2023-07-21T19:09:18.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.258+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b40b2460 con 0x7f50b41605b0 2023-07-21T19:09:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.262+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50ac007470 con 0x7f50b41605b0 2023-07-21T19:09:18.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.262+0000 7f509b7fe700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f50a0066320 0x7f50a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:18.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.262+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f50ac0839f0 con 0x7f50b41605b0 2023-07-21T19:09:18.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.262+0000 7f50b2d9d700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f50a0066320 0x7f50a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.262+0000 7f50b2d9d700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f50a0066320 0x7f50a00687d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f50b40b4f90 tx=0x7f50a4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:18.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.270+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f50b40b2460 con 0x7f50b41605b0 2023-07-21T19:09:18.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:18.442+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50b41561d0 con 0x7f50b41605b0 2023-07-21T19:09:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.042+0000 7f509b7fe700 1 -- 172.21.15.123:0/3592089745 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f50b41561d0 con 0x7f50b41605b0 2023-07-21T19:09:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f50a0066320 msgr2=0x7f50a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f50a0066320 0x7f50a00687d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f50b40b4f90 tx=0x7f50a4009240 comp rx=0 tx=0).stop 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 msgr2=0x7f50b4151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 0x7f50b4151380 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00cca0 tx=0x7f50ac00a060 comp rx=0 tx=0).stop 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 shutdown_connections 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f50a0066320 0x7f50a00687d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b41605b0 0x7f50b4151380 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50b415bf40 0x7f50b4150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 --2- 172.21.15.123:0/3592089745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b40cf410 0x7f50b41e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 >> 172.21.15.123:0/3592089745 conn(0x7f50b4060c40 msgr2=0x7f50b4158160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 shutdown_connections 2023-07-21T19:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.050+0000 7f50b89ff700 1 -- 172.21.15.123:0/3592089745 wait complete. 2023-07-21T19:09:19.066 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2023-07-21T19:09:19.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-21T19:09:19.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.246+0000 7fe564a4f700 1 Processor -- start 2023-07-21T19:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.246+0000 7fe564a4f700 1 -- start start 2023-07-21T19:09:19.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe564a4f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600b0ee0 0x7fe5600ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe564a4f700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe5600cd090 0x7fe5600d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe564a4f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5600d0610 0x7fe56015f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe564a4f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600cd4e0 con 0x7fe5600d0610 2023-07-21T19:09:19.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe564a4f700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600d1a60 con 0x7fe5600cd090 2023-07-21T19:09:19.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe564a4f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600d1ef0 con 0x7fe5600b0ee0 2023-07-21T19:09:19.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5600d0610 0x7fe56015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5600d0610 0x7fe56015f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34580/0 (socket says 172.21.15.123:34580) 2023-07-21T19:09:19.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 -- 172.21.15.123:0/3430052035 learned_addr learned my addr 172.21.15.123:0/3430052035 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:19.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55f7fe700 1 --2- 172.21.15.123:0/3430052035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600b0ee0 0x7fe5600ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55effd700 1 --2- 172.21.15.123:0/3430052035 >> v2:172.21.15.145:3300/0 conn(0x7fe5600cd090 0x7fe5600d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 -- 172.21.15.123:0/3430052035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600b0ee0 msgr2=0x7fe5600ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:19.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 --2- 172.21.15.123:0/3430052035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600b0ee0 0x7fe5600ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 -- 172.21.15.123:0/3430052035 >> v2:172.21.15.145:3300/0 conn(0x7fe5600cd090 msgr2=0x7fe5600d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 --2- 172.21.15.123:0/3430052035 >> v2:172.21.15.145:3300/0 conn(0x7fe5600cd090 0x7fe5600d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55ffff700 1 -- 172.21.15.123:0/3430052035 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600d0e50 con 0x7fe5600d0610 2023-07-21T19:09:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.250+0000 7fe55effd700 1 --2- 172.21.15.123:0/3430052035 >> v2:172.21.15.145:3300/0 conn(0x7fe5600cd090 0x7fe5600d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe55ffff700 1 --2- 172.21.15.123:0/3430052035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600d0610 0x7fe56015f850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe558009e50 tx=0x7fe55800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd12e15890ca28a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe55e7fc700 1 -- 172.21.15.123:0/3430052035 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800e070 con 0x7fe5600d0610 2023-07-21T19:09:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe55e7fc700 1 -- 172.21.15.123:0/3430052035 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800b8d0 con 0x7fe5600d0610 2023-07-21T19:09:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe55e7fc700 1 -- 172.21.15.123:0/3430052035 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800bc80 con 0x7fe5600d0610 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 -- 172.21.15.123:0/3430052035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600d0610 msgr2=0x7fe56015f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 --2- 172.21.15.123:0/3430052035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600d0610 0x7fe56015f850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe558009e50 tx=0x7fe55800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 -- 172.21.15.123:0/3430052035 shutdown_connections 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 --2- 172.21.15.123:0/3430052035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600d0610 0x7fe56015f850 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 --2- 172.21.15.123:0/3430052035 >> v2:172.21.15.145:3300/0 conn(0x7fe5600cd090 0x7fe5600d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 --2- 172.21.15.123:0/3430052035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600b0ee0 0x7fe5600ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 -- 172.21.15.123:0/3430052035 >> 172.21.15.123:0/3430052035 conn(0x7fe560060c40 msgr2=0x7fe56009b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 -- 172.21.15.123:0/3430052035 shutdown_connections 2023-07-21T19:09:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.254+0000 7fe564a4f700 1 -- 172.21.15.123:0/3430052035 wait complete. 2023-07-21T19:09:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 Processor -- start 2023-07-21T19:09:19.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 -- start start 2023-07-21T19:09:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 0x7fe560151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5600cd090 0x7fe5600b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600d0610 0x7fe5600b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5601f1300 con 0x7fe5600b0ee0 2023-07-21T19:09:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600b7ee0 con 0x7fe5600cd090 2023-07-21T19:09:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe564a4f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600b81c0 con 0x7fe5600d0610 2023-07-21T19:09:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe55f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 0x7fe560151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe55f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 0x7fe560151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34592/0 (socket says 172.21.15.123:34592) 2023-07-21T19:09:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.258+0000 7fe55f7fe700 1 -- 172.21.15.123:0/2185615954 learned_addr learned my addr 172.21.15.123:0/2185615954 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55effd700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5600cd090 0x7fe5600b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55ffff700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600d0610 0x7fe5600b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55f7fe700 1 -- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600d0610 msgr2=0x7fe5600b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55f7fe700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600d0610 0x7fe5600b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55f7fe700 1 -- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5600cd090 msgr2=0x7fe5600b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55f7fe700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5600cd090 0x7fe5600b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55f7fe700 1 -- 172.21.15.123:0/2185615954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540094b0 con 0x7fe5600b0ee0 2023-07-21T19:09:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55effd700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5600cd090 0x7fe5600b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55ffff700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600d0610 0x7fe5600b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe55f7fe700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 0x7fe560151540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe55000e7c0 tx=0x7fe55000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:19.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550013680 con 0x7fe5600b0ee0 2023-07-21T19:09:19.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5500137e0 con 0x7fe5600b0ee0 2023-07-21T19:09:19.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558009b30 con 0x7fe5600b0ee0 2023-07-21T19:09:19.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550013b90 con 0x7fe5600b0ee0 2023-07-21T19:09:19.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56015d6c0 con 0x7fe5600b0ee0 2023-07-21T19:09:19.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.262+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56004e500 con 0x7fe5600b0ee0 2023-07-21T19:09:19.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.266+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe550013cf0 con 0x7fe5600b0ee0 2023-07-21T19:09:19.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.266+0000 7fe547fff700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe54c0662f0 0x7fe54c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:19.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.266+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fe550083d40 con 0x7fe5600b0ee0 2023-07-21T19:09:19.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.266+0000 7fe55effd700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe54c0662f0 0x7fe54c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:19.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.270+0000 7fe55effd700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe54c0662f0 0x7fe54c0687a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe5601f4930 tx=0x7fe554008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:19.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.270+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe550051130 con 0x7fe5600b0ee0 2023-07-21T19:09:19.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:19.466+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5600d13e0 con 0x7fe5600b0ee0 2023-07-21T19:09:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.062+0000 7fe547fff700 1 -- 172.21.15.123:0/2185615954 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7fe5500170d0 con 0x7fe5600b0ee0 2023-07-21T19:09:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe54c0662f0 msgr2=0x7fe54c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe54c0662f0 0x7fe54c0687a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe5601f4930 tx=0x7fe554008040 comp rx=0 tx=0).stop 2023-07-21T19:09:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 msgr2=0x7fe560151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 0x7fe560151540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe55000e7c0 tx=0x7fe55000eb80 comp rx=0 tx=0).stop 2023-07-21T19:09:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 shutdown_connections 2023-07-21T19:09:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe54c0662f0 0x7fe54c0687a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5600cd090 0x7fe5600b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5600d0610 0x7fe5600b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 --2- 172.21.15.123:0/2185615954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5600b0ee0 0x7fe560151540 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 >> 172.21.15.123:0/2185615954 conn(0x7fe560060c40 msgr2=0x7fe5600cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 shutdown_connections 2023-07-21T19:09:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.066+0000 7fe564a4f700 1 -- 172.21.15.123:0/2185615954 wait complete. 2023-07-21T19:09:20.082 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data_ec' removed 2023-07-21T19:09:20.103 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T19:09:20.103 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T19:09:20.104 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T19:09:20.104 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:09:20.105 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T19:09:20.105 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T19:09:20.105 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T19:09:20.106 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:09:20.106 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T19:09:20.106 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T19:09:20.106 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T19:09:20.106 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:09:20.107 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T19:09:20.107 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T19:09:20.107 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T19:09:20.107 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T19:09:20.123 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T19:09:20.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T19:09:20.126 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T19:09:20.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T19:09:20.129 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T19:09:20.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T19:09:20.132 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T19:09:20.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T19:09:20.172 INFO:tasks.ceph.mds.c:Started 2023-07-21T19:09:20.173 DEBUG:teuthology.parallel:result is None 2023-07-21T19:09:20.178 INFO:tasks.ceph.mds.a:Started 2023-07-21T19:09:20.179 DEBUG:teuthology.parallel:result is None 2023-07-21T19:09:20.181 INFO:tasks.ceph.mds.d:Started 2023-07-21T19:09:20.181 DEBUG:teuthology.parallel:result is None 2023-07-21T19:09:20.186 INFO:tasks.ceph.mds.b:Started 2023-07-21T19:09:20.187 DEBUG:teuthology.parallel:result is None 2023-07-21T19:09:20.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T19:09:20.293 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2023-07-21T19:09:20.294 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2023-07-21T19:09:20.301 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2023-07-21T19:09:20.311 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2023-07-21T19:09:20.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.346+0000 7f57a2fd2700 1 Processor -- start 2023-07-21T19:09:20.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.346+0000 7f57a2fd2700 1 -- start start 2023-07-21T19:09:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f579c15ffa0 0x7f579c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c0ca8a0 con 0x7f579c160370 2023-07-21T19:09:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0cbcd0 con 0x7f579c15ffa0 2023-07-21T19:09:20.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0cbf70 con 0x7f579c06dc50 2023-07-21T19:09:20.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f579c15ffa0 0x7f579c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f579c15ffa0 0x7f579c06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34650/0 (socket says 172.21.15.123:34650) 2023-07-21T19:09:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 -- 172.21.15.123:0/2473969896 learned_addr learned my addr 172.21.15.123:0/2473969896 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a17cf700 1 --2- 172.21.15.123:0/2473969896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 -- 172.21.15.123:0/2473969896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 msgr2=0x7f579c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 --2- 172.21.15.123:0/2473969896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 -- 172.21.15.123:0/2473969896 >> v1:172.21.15.145:6789/0 conn(0x7f579c160370 legacy=0x7f579c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 -- 172.21.15.123:0/2473969896 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0cc250 con 0x7f579c15ffa0 2023-07-21T19:09:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a1fd0700 1 --2- 172.21.15.123:0/2473969896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c15ffa0 0x7f579c06d710 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5798009910 tx=0x7f5798009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a13893fe917511 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a0fce700 1 -- 172.21.15.123:0/2473969896 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579800ba60 con 0x7f579c15ffa0 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a0fce700 1 -- 172.21.15.123:0/2473969896 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579800bbc0 con 0x7f579c15ffa0 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a0fce700 1 -- 172.21.15.123:0/2473969896 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798009e60 con 0x7f579c15ffa0 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 -- 172.21.15.123:0/2473969896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c15ffa0 msgr2=0x7f579c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/2473969896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c15ffa0 0x7f579c06d710 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5798009910 tx=0x7f5798009c20 comp rx=0 tx=0).stop 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 -- 172.21.15.123:0/2473969896 shutdown_connections 2023-07-21T19:09:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/2473969896 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/2473969896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c15ffa0 0x7f579c06d710 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.350+0000 7f57a2fd2700 1 -- 172.21.15.123:0/2473969896 >> 172.21.15.123:0/2473969896 conn(0x7f579c06e960 msgr2=0x7f579c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.354+0000 7f57a2fd2700 1 -- 172.21.15.123:0/2473969896 shutdown_connections 2023-07-21T19:09:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.354+0000 7f57a2fd2700 1 -- 172.21.15.123:0/2473969896 wait complete. 2023-07-21T19:09:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.354+0000 7f57a2fd2700 1 Processor -- start 2023-07-21T19:09:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.354+0000 7f57a2fd2700 1 -- start start 2023-07-21T19:09:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f579c15ffa0 0x7f579c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 0x7f579c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0c6120 con 0x7f579c160370 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0c5130 con 0x7f579c15ffa0 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c158fa0 con 0x7f579c06dc50 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 0x7f579c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 0x7f579c158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34654/0 (socket says 172.21.15.123:34654) 2023-07-21T19:09:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 -- 172.21.15.123:0/3890895968 learned_addr learned my addr 172.21.15.123:0/3890895968 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a1fd0700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a17cf700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f579c15ffa0 0x7f579c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 -- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 msgr2=0x7f579c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 -- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f579c15ffa0 msgr2=0x7f579c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f579c15ffa0 0x7f579c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 -- 172.21.15.123:0/3890895968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798009570 con 0x7f579c160370 2023-07-21T19:09:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a17cf700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f579c15ffa0 0x7f579c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a27d1700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 0x7f579c158a60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f579400cc50 tx=0x7f579400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794003c20 con 0x7f579c160370 2023-07-21T19:09:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794003d80 con 0x7f579c160370 2023-07-21T19:09:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400ab60 con 0x7f579c160370 2023-07-21T19:09:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c0c5340 con 0x7f579c160370 2023-07-21T19:09:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c0ae820 con 0x7f579c160370 2023-07-21T19:09:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.358+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c0c5860 con 0x7f579c160370 2023-07-21T19:09:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.362+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f579400acc0 con 0x7f579c160370 2023-07-21T19:09:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.362+0000 7f57927fc700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5780066320 0x7f57800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.362+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5794083970 con 0x7f579c160370 2023-07-21T19:09:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.362+0000 7f57a1fd0700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5780066320 0x7f57800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.366+0000 7f57a1fd0700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5780066320 0x7f57800687d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f5798008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.366+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f579c0c5860 con 0x7f579c160370 2023-07-21T19:09:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:20.554+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f579c0ca8a0 con 0x7f579c160370 2023-07-21T19:09:21.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.074+0000 7f57927fc700 1 -- 172.21.15.123:0/3890895968 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f579c0ca8a0 con 0x7f579c160370 2023-07-21T19:09:21.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5780066320 msgr2=0x7f57800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5780066320 0x7f57800687d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f5798008030 comp rx=0 tx=0).stop 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 msgr2=0x7f579c158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 0x7f579c158a60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f579400cc50 tx=0x7f579400cf60 comp rx=0 tx=0).stop 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 shutdown_connections 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f5780066320 0x7f57800687d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f579c15ffa0 0x7f579c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f579c160370 0x7f579c158a60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 --2- 172.21.15.123:0/3890895968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f579c06dc50 0x7f579c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 >> 172.21.15.123:0/3890895968 conn(0x7f579c06e960 msgr2=0x7f579c0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:21.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.078+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 shutdown_connections 2023-07-21T19:09:21.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.082+0000 7f57a2fd2700 1 -- 172.21.15.123:0/3890895968 wait complete. 2023-07-21T19:09:21.096 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2023-07-21T19:09:21.116 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T19:09:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.282+0000 7f768c289700 1 Processor -- start 2023-07-21T19:09:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.282+0000 7f768c289700 1 -- start start 2023-07-21T19:09:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768c289700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f768415bf20 0x7f76840b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768c289700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768415c2f0 con 0x7f76840d1430 2023-07-21T19:09:21.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768c289700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7684070830 con 0x7f76840b1530 2023-07-21T19:09:21.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768c289700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76840d1830 con 0x7f768415bf20 2023-07-21T19:09:21.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768a826700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f76840d1430 0x7f76840b4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41226/0 (socket says 172.21.15.123:41226) 2023-07-21T19:09:21.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768a826700 1 -- 172.21.15.123:0/339747176 learned_addr learned my addr 172.21.15.123:0/339747176 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:21.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f768a025700 1 --2- 172.21.15.123:0/339747176 >> v2:172.21.15.145:3300/0 conn(0x7f768415bf20 0x7f76840b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292477228 0 0) 0x7f768415c2f0 con 0x7f76840d1430 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76700035d0 con 0x7f76840d1430 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1969489761 0 0) 0x7f76700035d0 con 0x7f76840d1430 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 >> v2:172.21.15.145:3300/0 conn(0x7f768415bf20 msgr2=0x7f76840b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 --2- 172.21.15.123:0/339747176 >> v2:172.21.15.145:3300/0 conn(0x7f768415bf20 0x7f76840b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 >> v1:172.21.15.145:6789/0 conn(0x7f76840b1530 legacy=0x7f76840d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684070b10 con 0x7f76840d1430 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f767c0019f0 con 0x7f76840d1430 2023-07-21T19:09:21.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 >> v1:172.21.15.123:6789/0 conn(0x7f76840d1430 legacy=0x7f76840b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670003a20 0x7f7670003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7670004870 0x7f7670004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7670005220 0x7f767000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767000c100 con 0x7f7670004870 2023-07-21T19:09:21.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767000c270 con 0x7f7670003a20 2023-07-21T19:09:21.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767000c430 con 0x7f7670005220 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.286+0000 7f7689824700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7670004870 0x7f7670004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768a025700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670003a20 0x7f7670003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768a826700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7670005220 0x7f767000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689824700 1 -- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7670005220 msgr2=0x7f767000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689824700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7670005220 0x7f767000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689824700 1 -- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670003a20 msgr2=0x7f7670003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689824700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670003a20 0x7f7670003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689824700 1 -- 172.21.15.123:0/339747176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700035d0 con 0x7f7670004870 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768a826700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7670005220 0x7f767000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768a826700 1 -- 172.21.15.123:0/339747176 reap_dead start 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689824700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7670004870 0x7f7670004ce0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f76740017e0 tx=0x7f76700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db34e5806ebe89fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740052d0 con 0x7f7670004870 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674005430 con 0x7f7670004870 2023-07-21T19:09:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f7689023700 1 -- 172.21.15.123:0/339747176 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740055a0 con 0x7f7670004870 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 -- 172.21.15.123:0/339747176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7670004870 msgr2=0x7f7670004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7670004870 0x7f7670004ce0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f76740017e0 tx=0x7f76700058a0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 -- 172.21.15.123:0/339747176 shutdown_connections 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 --2- 172.21.15.123:0/339747176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7670004870 0x7f7670004ce0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 -- 172.21.15.123:0/339747176 >> 172.21.15.123:0/339747176 conn(0x7f768406fc80 msgr2=0x7f7684070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 -- 172.21.15.123:0/339747176 shutdown_connections 2023-07-21T19:09:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.290+0000 7f768c289700 1 -- 172.21.15.123:0/339747176 wait complete. 2023-07-21T19:09:21.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 Processor -- start 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 -- start start 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670004870 0x7f7684156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 0x7f76840b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76840cb870 0x7f76840cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840cc250 con 0x7f76840b1ff0 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840c6200 con 0x7f7670004870 2023-07-21T19:09:21.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768c289700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76840b2b60 con 0x7f76840cb870 2023-07-21T19:09:21.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 0x7f76840b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 0x7f76840b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34670/0 (socket says 172.21.15.123:34670) 2023-07-21T19:09:21.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 -- 172.21.15.123:0/3882345827 learned_addr learned my addr 172.21.15.123:0/3882345827 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:21.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768a025700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670004870 0x7f7684156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768a826700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76840cb870 0x7f76840cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 -- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76840cb870 msgr2=0x7f76840cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76840cb870 0x7f76840cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 -- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670004870 msgr2=0x7f7684156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670004870 0x7f7684156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 -- 172.21.15.123:0/3882345827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76840b2e40 con 0x7f76840b1ff0 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f768a025700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670004870 0x7f7684156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.294+0000 7f7689824700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 0x7f76840b2460 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7674015040 tx=0x7f7674001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740055a0 con 0x7f76840b1ff0 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674001290 con 0x7f76840b1ff0 2023-07-21T19:09:21.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768415c4e0 con 0x7f76840b1ff0 2023-07-21T19:09:21.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767401d6e0 con 0x7f76840b1ff0 2023-07-21T19:09:21.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768415caa0 con 0x7f76840b1ff0 2023-07-21T19:09:21.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768415cc30 con 0x7f76840b1ff0 2023-07-21T19:09:21.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.298+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7674019040 con 0x7f76840b1ff0 2023-07-21T19:09:21.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.302+0000 7f767affd700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f76680662f0 0x7f76680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.302+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7674084750 con 0x7f76840b1ff0 2023-07-21T19:09:21.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.302+0000 7f768a025700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f76680662f0 0x7f76680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.302+0000 7f768a025700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f76680662f0 0x7f76680687a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76840b5020 tx=0x7f7680008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:21.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.310+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7674051f30 con 0x7f76840b1ff0 2023-07-21T19:09:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.538+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f768404dcb0 con 0x7f76840b1ff0 2023-07-21T19:09:21.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.538+0000 7f767affd700 1 -- 172.21.15.123:0/3882345827 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7674055550 con 0x7f76840b1ff0 2023-07-21T19:09:21.554 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:21.555 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:09:21.555 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2023-07-21T19:09:21.555 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.555 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2023-07-21T19:09:21.556 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQA/17pkzA8VJRAAw09XXzND3lVX9IkScOLiXA==", 2023-07-21T19:09:21.556 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.556 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.556 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-07-21T19:09:21.556 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-07-21T19:09:21.556 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQA/17pkZjJ9OBAAXfUxoDyO3JuFinW0pl+KoQ==", 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.557 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQA/17pk49gmMBAAdddgVbP3DcEq/ZOAjFcZrw==", 2023-07-21T19:09:21.558 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.559 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBA17pkFnbPBxAAxyLpmIcj6hMgDNWUXFzkYg==", 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-07-21T19:09:21.560 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBD17pka9uKNxAAaDPjvrIZWK7VWkM9FvEUdA==", 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2023-07-21T19:09:21.562 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBH17pkzSh+ChAA+6lF5wX5R0UV46/sQuVbLQ==", 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.563 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBK17pkadbjFhAAPosOaNoaECIUrXSzNwpfdA==", 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.564 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBN17pkG0ejJRAA9n8YEThkdIMO7jnKoKxQmg==", 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.565 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBT17pkg1h8NBAA11ldR/LqenYFGqOHLCWdXA==", 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.566 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBX17pkVaAkBxAAmpqYFxw1caext1yztHaklw==", 2023-07-21T19:09:21.567 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.568 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.568 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.568 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.568 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.568 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.568 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBa17pko/UDFRAAm6qfdDBIhm8DyvmQJfWzmQ==", 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.569 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBd17pk97iBIhAAx79tBTrDqc22KR+0BZ5qFA==", 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-07-21T19:09:21.570 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBA17pk2Nr+DhAAZaJDjV8t3ZvDwlb/0Xr4lQ==", 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2023-07-21T19:09:21.572 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBA17pkn3jiGhAArawyzbz/lY2crSl3QuhcIQ==", 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBA17pk2oUSFRAAjX5SyVX1rkd8V3c53yhPZg==", 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2023-07-21T19:09:21.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBA17pkQ4MRIRAAs/FqQg7cdATjre0EcEIfXA==", 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2023-07-21T19:09:21.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQA+17pkydHCNRAA1YAJMuIzdTSDMYQzA8VFRA==", 2023-07-21T19:09:21.576 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.577 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mds", 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBp17pk4i8lLBAAbCsrYaU58fEYwhLd/qEh8A==", 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mds" 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.578 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mgr", 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBp17pknz8lLBAAKmj1Dmsk/eYPMurGpMYXgg==", 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-osd", 2023-07-21T19:09:21.579 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBp17pknEolLBAAXHT3dhDF22eREun8WfwSnw==", 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-osd" 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd", 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBp17pkOlYlLBAAQm/Yt8cZotnsb+ZK5C5V7A==", 2023-07-21T19:09:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBp17pkVWElLBAAHWPXF4fuO5hEORgDuNdxSQ==", 2023-07-21T19:09:21.581 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rgw", 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBp17pkimwlLBAAJQ6YWbJ84wg5q0YVGgUIqw==", 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.582 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQA/17pkDrqIHRAALYOWJm1PpwK0ltE3phHunA==", 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2023-07-21T19:09:21.583 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQA/17pkmAkwFxAAP6fw68BLkvkZvb3rdm8gyg==", 2023-07-21T19:09:21.584 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2023-07-21T19:09:21.585 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f76680662f0 msgr2=0x7f76680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f76680662f0 0x7f76680687a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76840b5020 tx=0x7f7680008040 comp rx=0 tx=0).stop 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 msgr2=0x7f76840b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 0x7f76840b2460 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7674015040 tx=0x7f7674001120 comp rx=0 tx=0).stop 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 shutdown_connections 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f76680662f0 0x7f76680687a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76840cb870 0x7f76840cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76840b1ff0 0x7f76840b2460 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 --2- 172.21.15.123:0/3882345827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7670004870 0x7f7684156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 >> 172.21.15.123:0/3882345827 conn(0x7f768406fc80 msgr2=0x7f76840cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:21.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 shutdown_connections 2023-07-21T19:09:21.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.542+0000 7f768c289700 1 -- 172.21.15.123:0/3882345827 wait complete. 2023-07-21T19:09:21.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-21T19:09:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.746+0000 7f60548b1700 1 Processor -- start 2023-07-21T19:09:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.746+0000 7f60548b1700 1 -- start start 2023-07-21T19:09:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.746+0000 7f60548b1700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f60500afd30 0x7f60500c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.746+0000 7f60548b1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f605006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.746+0000 7f60548b1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60500c97f0 con 0x7f605015c9c0 2023-07-21T19:09:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f60548b1700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500c8900 con 0x7f60500afd30 2023-07-21T19:09:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f60548b1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500c8be0 con 0x7f60500b0100 2023-07-21T19:09:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604ed9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f605015c9c0 0x7f605015ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41228/0 (socket says 172.21.15.123:41228) 2023-07-21T19:09:21.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604ed9d700 1 -- 172.21.15.123:0/3350395803 learned_addr learned my addr 172.21.15.123:0/3350395803 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:21.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604e59c700 1 --2- 172.21.15.123:0/3350395803 >> v2:172.21.15.145:3300/0 conn(0x7f60500afd30 0x7f60500c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f6047fff700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f605006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604dd9b700 1 -- 172.21.15.123:0/3350395803 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070882365 0 0) 0x7f60500c97f0 con 0x7f605015c9c0 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604dd9b700 1 -- 172.21.15.123:0/3350395803 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c0035d0 con 0x7f605015c9c0 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604e59c700 1 -- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 msgr2=0x7f605006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604e59c700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f605006d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604e59c700 1 -- 172.21.15.123:0/3350395803 >> v1:172.21.15.123:6789/0 conn(0x7f605015c9c0 legacy=0x7f605015ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604e59c700 1 -- 172.21.15.123:0/3350395803 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500c8ec0 con 0x7f60500afd30 2023-07-21T19:09:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f6047fff700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f605006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604e59c700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f60500c9c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6040009850 tx=0x7f6040009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d240f36e037f7a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604dd9b700 1 -- 172.21.15.123:0/3350395803 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011830 con 0x7f60500afd30 2023-07-21T19:09:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604dd9b700 1 -- 172.21.15.123:0/3350395803 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040011990 con 0x7f60500afd30 2023-07-21T19:09:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.750+0000 7f604dd9b700 1 -- 172.21.15.123:0/3350395803 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011d40 con 0x7f60500afd30 2023-07-21T19:09:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 -- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 msgr2=0x7f60500c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f60500c9c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6040009850 tx=0x7f6040009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 -- 172.21.15.123:0/3350395803 shutdown_connections 2023-07-21T19:09:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f605006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 --2- 172.21.15.123:0/3350395803 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f60500c9c80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 -- 172.21.15.123:0/3350395803 >> 172.21.15.123:0/3350395803 conn(0x7f60500cad30 msgr2=0x7f60500cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 -- 172.21.15.123:0/3350395803 shutdown_connections 2023-07-21T19:09:21.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 -- 172.21.15.123:0/3350395803 wait complete. 2023-07-21T19:09:21.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 Processor -- start 2023-07-21T19:09:21.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.754+0000 7f60548b1700 1 -- start start 2023-07-21T19:09:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f605015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f60500b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015c9c0 0x7f60500b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605015c310 con 0x7f605015c9c0 2023-07-21T19:09:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501f2070 con 0x7f60500afd30 2023-07-21T19:09:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500acbe0 con 0x7f60500b0100 2023-07-21T19:09:21.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f60500b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f604ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015c9c0 0x7f60500b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f604e59c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f605015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f60500b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:55194/0 (socket says 172.21.15.123:55194) 2023-07-21T19:09:21.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 -- 172.21.15.123:0/1014182819 learned_addr learned my addr 172.21.15.123:0/1014182819 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:21.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 -- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 msgr2=0x7f605015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f605015bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 -- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015c9c0 msgr2=0x7f60500b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:21.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015c9c0 0x7f60500b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:21.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 -- 172.21.15.123:0/1014182819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380094b0 con 0x7f60500b0100 2023-07-21T19:09:21.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6047fff700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f60500b10e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f603800ebe0 tx=0x7f603800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:21.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800c850 con 0x7f60500b0100 2023-07-21T19:09:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800c9b0 con 0x7f60500b0100 2023-07-21T19:09:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800cd40 con 0x7f60500b0100 2023-07-21T19:09:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400094b0 con 0x7f60500b0100 2023-07-21T19:09:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.758+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6050146090 con 0x7f60500b0100 2023-07-21T19:09:21.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.762+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60500ce0b0 con 0x7f60500b0100 2023-07-21T19:09:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.762+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6038013470 con 0x7f60500b0100 2023-07-21T19:09:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.762+0000 7f6046ffd700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60300662f0 0x7f60300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.762+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6038083c90 con 0x7f60500b0100 2023-07-21T19:09:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.762+0000 7f604e59c700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60300662f0 0x7f60300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.766+0000 7f604e59c700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60300662f0 0x7f60300687a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f60400090b0 tx=0x7f604001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:21.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:21.774+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f60380511f0 con 0x7f60500b0100 2023-07-21T19:09:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.002+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f605004dcb0 con 0x7f60500b0100 2023-07-21T19:09:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.014+0000 7f6046ffd700 1 -- 172.21.15.123:0/1014182819 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f60380210a0 con 0x7f60500b0100 2023-07-21T19:09:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60300662f0 msgr2=0x7f60300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60300662f0 0x7f60300687a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f60400090b0 tx=0x7f604001c040 comp rx=0 tx=0).stop 2023-07-21T19:09:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 msgr2=0x7f60500b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f60500b10e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f603800ebe0 tx=0x7f603800eef0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 shutdown_connections 2023-07-21T19:09:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f60300662f0 0x7f60300687a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015c9c0 0x7f60500b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60500b0100 0x7f60500b10e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 --2- 172.21.15.123:0/1014182819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60500afd30 0x7f605015bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 >> 172.21.15.123:0/1014182819 conn(0x7f60500cad30 msgr2=0x7f60500add10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 shutdown_connections 2023-07-21T19:09:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.018+0000 7f60548b1700 1 -- 172.21.15.123:0/1014182819 wait complete. 2023-07-21T19:09:22.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-21T19:09:22.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.210+0000 7fa4c15d5700 1 Processor -- start 2023-07-21T19:09:22.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.210+0000 7fa4c15d5700 1 -- start start 2023-07-21T19:09:22.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4c15d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4bc159c30 0x7fa4bc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4c15d5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0cb680 con 0x7fa4bc06d250 2023-07-21T19:09:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4c15d5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc15e480 con 0x7fa4bc0ce6b0 2023-07-21T19:09:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4c15d5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc06a1c0 con 0x7fa4bc159c30 2023-07-21T19:09:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4bc159c30 0x7fa4bc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4bc159c30 0x7fa4bc06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34692/0 (socket says 172.21.15.123:34692) 2023-07-21T19:09:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 -- 172.21.15.123:0/386134481 learned_addr learned my addr 172.21.15.123:0/386134481 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 -- 172.21.15.123:0/386134481 >> v1:172.21.15.145:6789/0 conn(0x7fa4bc0ce6b0 legacy=0x7fa4bc15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 -- 172.21.15.123:0/386134481 >> v1:172.21.15.123:6789/0 conn(0x7fa4bc06d250 legacy=0x7fa4bc15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 -- 172.21.15.123:0/386134481 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc06b000 con 0x7fa4bc159c30 2023-07-21T19:09:22.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4baffd700 1 --2- 172.21.15.123:0/386134481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc159c30 0x7fa4bc06e960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009910 tx=0x7fa4ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4505278596e988b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:22.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4b9ffb700 1 -- 172.21.15.123:0/386134481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac004230 con 0x7fa4bc159c30 2023-07-21T19:09:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4b9ffb700 1 -- 172.21.15.123:0/386134481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac004390 con 0x7fa4bc159c30 2023-07-21T19:09:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.214+0000 7fa4b9ffb700 1 -- 172.21.15.123:0/386134481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac009e60 con 0x7fa4bc159c30 2023-07-21T19:09:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- 172.21.15.123:0/386134481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc159c30 msgr2=0x7fa4bc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/386134481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc159c30 0x7fa4bc06e960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009910 tx=0x7fa4ac009c20 comp rx=0 tx=0).stop 2023-07-21T19:09:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- 172.21.15.123:0/386134481 shutdown_connections 2023-07-21T19:09:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/386134481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc159c30 0x7fa4bc06e960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- 172.21.15.123:0/386134481 >> 172.21.15.123:0/386134481 conn(0x7fa4bc06fa70 msgr2=0x7fa4bc06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- 172.21.15.123:0/386134481 shutdown_connections 2023-07-21T19:09:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- 172.21.15.123:0/386134481 wait complete. 2023-07-21T19:09:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 Processor -- start 2023-07-21T19:09:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- start start 2023-07-21T19:09:22.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 0x7fa4bc1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4bc0ce6b0 0x7fa4bc157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4bc0b0840 0x7fa4bc154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0b2880 con 0x7fa4bc06d250 2023-07-21T19:09:22.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0b2250 con 0x7fa4bc0b0840 2023-07-21T19:09:22.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4c15d5700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc158340 con 0x7fa4bc0ce6b0 2023-07-21T19:09:22.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4baffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 0x7fa4bc1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4baffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 0x7fa4bc1472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34696/0 (socket says 172.21.15.123:34696) 2023-07-21T19:09:22.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.218+0000 7fa4baffd700 1 -- 172.21.15.123:0/2895113816 learned_addr learned my addr 172.21.15.123:0/2895113816 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:22.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4baffd700 1 -- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4bc0ce6b0 msgr2=0x7fa4bc157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4bb7fe700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4bc0b0840 0x7fa4bc154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4baffd700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4bc0ce6b0 0x7fa4bc157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4baffd700 1 -- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4bc0b0840 msgr2=0x7fa4bc154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4baffd700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4bc0b0840 0x7fa4bc154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4baffd700 1 -- 172.21.15.123:0/2895113816 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac009570 con 0x7fa4bc06d250 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4bb7fe700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4bc0b0840 0x7fa4bc154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:22.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4baffd700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 0x7fa4bc1472a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0610f0 tx=0x7fa4ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:22.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00be00 con 0x7fa4bc06d250 2023-07-21T19:09:22.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac01f070 con 0x7fa4bc06d250 2023-07-21T19:09:22.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc158620 con 0x7fa4bc06d250 2023-07-21T19:09:22.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac003900 con 0x7fa4bc06d250 2023-07-21T19:09:22.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc157ea0 con 0x7fa4bc06d250 2023-07-21T19:09:22.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc1580f0 con 0x7fa4bc06d250 2023-07-21T19:09:22.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.222+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4ac021030 con 0x7fa4bc06d250 2023-07-21T19:09:22.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.226+0000 7fa4a37fe700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a80662f0 0x7fa4a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.226+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa4ac085120 con 0x7fa4bc06d250 2023-07-21T19:09:22.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.226+0000 7fa4ba7fc700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a80662f0 0x7fa4a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.226+0000 7fa4ba7fc700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a80662f0 0x7fa4a80687a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000f60 tx=0x7fa4b0007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:22.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.230+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa4ac052840 con 0x7fa4bc06d250 2023-07-21T19:09:22.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.462+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa4bc1580f0 con 0x7fa4bc06d250 2023-07-21T19:09:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.470+0000 7fa4a37fe700 1 -- 172.21.15.123:0/2895113816 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa4ac055e60 con 0x7fa4bc06d250 2023-07-21T19:09:22.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a80662f0 msgr2=0x7fa4a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a80662f0 0x7fa4a80687a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000f60 tx=0x7fa4b0007a80 comp rx=0 tx=0).stop 2023-07-21T19:09:22.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 msgr2=0x7fa4bc1472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 0x7fa4bc1472a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0610f0 tx=0x7fa4ac004770 comp rx=0 tx=0).stop 2023-07-21T19:09:22.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 shutdown_connections 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fa4a80662f0 0x7fa4a80687a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4bc0b0840 0x7fa4bc154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4bc0ce6b0 0x7fa4bc157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 --2- 172.21.15.123:0/2895113816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4bc06d250 0x7fa4bc1472a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 >> 172.21.15.123:0/2895113816 conn(0x7fa4bc06fa70 msgr2=0x7fa4bc15c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 shutdown_connections 2023-07-21T19:09:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.474+0000 7fa4c15d5700 1 -- 172.21.15.123:0/2895113816 wait complete. 2023-07-21T19:09:22.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-21T19:09:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 Processor -- start 2023-07-21T19:09:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 -- start start 2023-07-21T19:09:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f840caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7f840caf70 0x7f7f8415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f840b0ef0 con 0x7f7f840c9d90 2023-07-21T19:09:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840ce9c0 con 0x7f7f840caf70 2023-07-21T19:09:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8b440700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840cee50 con 0x7f7f84159f20 2023-07-21T19:09:22.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8a43e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7f840c9d90 0x7f7f840ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60088/0 (socket says 172.21.15.123:60088) 2023-07-21T19:09:22.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8a43e700 1 -- 172.21.15.123:0/1445185512 learned_addr learned my addr 172.21.15.123:0/1445185512 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:22.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f89c3d700 1 --2- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f840caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.670+0000 7f7f8ac3f700 1 --2- 172.21.15.123:0/1445185512 >> v2:172.21.15.145:3300/0 conn(0x7f7f840caf70 0x7f7f8415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8943c700 1 -- 172.21.15.123:0/1445185512 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269538149 0 0) 0x7f7f840b0ef0 con 0x7f7f840c9d90 2023-07-21T19:09:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8943c700 1 -- 172.21.15.123:0/1445185512 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f700035d0 con 0x7f7f840c9d90 2023-07-21T19:09:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8ac3f700 1 -- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 msgr2=0x7f7f840caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8ac3f700 1 --2- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f840caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8ac3f700 1 -- 172.21.15.123:0/1445185512 >> v1:172.21.15.123:6789/0 conn(0x7f7f840c9d90 legacy=0x7f7f840ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8ac3f700 1 -- 172.21.15.123:0/1445185512 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840cb4f0 con 0x7f7f840caf70 2023-07-21T19:09:22.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8ac3f700 1 --2- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840caf70 0x7f7f8415d7f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009d90 tx=0x7f7f7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d573dd23fdc0d1a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:22.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8943c700 1 -- 172.21.15.123:0/1445185512 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00e070 con 0x7f7f840caf70 2023-07-21T19:09:22.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8943c700 1 -- 172.21.15.123:0/1445185512 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00bb20 con 0x7f7f840caf70 2023-07-21T19:09:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8943c700 1 -- 172.21.15.123:0/1445185512 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c012430 con 0x7f7f840caf70 2023-07-21T19:09:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 -- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840caf70 msgr2=0x7f7f8415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 --2- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840caf70 0x7f7f8415d7f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009d90 tx=0x7f7f7c00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 -- 172.21.15.123:0/1445185512 shutdown_connections 2023-07-21T19:09:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 --2- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840caf70 0x7f7f8415d7f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 --2- 172.21.15.123:0/1445185512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f840caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 -- 172.21.15.123:0/1445185512 >> 172.21.15.123:0/1445185512 conn(0x7f7f8406e960 msgr2=0x7f7f8406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 -- 172.21.15.123:0/1445185512 shutdown_connections 2023-07-21T19:09:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.674+0000 7f7f8b440700 1 -- 172.21.15.123:0/1445185512 wait complete. 2023-07-21T19:09:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.678+0000 7f7f8b440700 1 Processor -- start 2023-07-21T19:09:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.678+0000 7f7f8b440700 1 -- start start 2023-07-21T19:09:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.678+0000 7f7f8b440700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840c9d90 0x7f7f841405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.678+0000 7f7f8b440700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 0x7f7f840c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f84141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c4f30 con 0x7f7f840caf70 2023-07-21T19:09:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840beb20 con 0x7f7f840c9d90 2023-07-21T19:09:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840bedc0 con 0x7f7f84159f20 2023-07-21T19:09:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 0x7f7f840c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 0x7f7f840c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42808/0 (socket says 172.21.15.123:42808) 2023-07-21T19:09:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 -- 172.21.15.123:0/294456102 learned_addr learned my addr 172.21.15.123:0/294456102 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8a43e700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840c9d90 0x7f7f841405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8ac3f700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f84141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 -- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 msgr2=0x7f7f84141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f84141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 -- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840c9d90 msgr2=0x7f7f841405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840c9d90 0x7f7f841405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 -- 172.21.15.123:0/294456102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009a70 con 0x7f7f840caf70 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8a43e700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840c9d90 0x7f7f841405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f89c3d700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 0x7f7f840c3e60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ea00 tx=0x7f7f7400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74009720 con 0x7f7f840caf70 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400c850 con 0x7f7f840caf70 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400cbc0 con 0x7f7f840caf70 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f84140af0 con 0x7f7f840caf70 2023-07-21T19:09:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f840c4970 con 0x7f7f840caf70 2023-07-21T19:09:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.682+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8404e500 con 0x7f7f840caf70 2023-07-21T19:09:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.686+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f7400cd20 con 0x7f7f840caf70 2023-07-21T19:09:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.686+0000 7f7f7affd700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f680662f0 0x7f7f680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.686+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7f74083fa0 con 0x7f7f840caf70 2023-07-21T19:09:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.686+0000 7f7f8a43e700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f680662f0 0x7f7f680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:22.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.690+0000 7f7f8a43e700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f680662f0 0x7f7f680687a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f800011e0 tx=0x7f7f80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:22.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.694+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7f740b4720 con 0x7f7f840caf70 2023-07-21T19:09:22.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.922+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7f840bef00 con 0x7f7f840caf70 2023-07-21T19:09:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.930+0000 7f7f7affd700 1 -- 172.21.15.123:0/294456102 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7f740550c0 con 0x7f7f840caf70 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f680662f0 msgr2=0x7f7f680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f680662f0 0x7f7f680687a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f800011e0 tx=0x7f7f80009040 comp rx=0 tx=0).stop 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 msgr2=0x7f7f840c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 0x7f7f840c3e60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ea00 tx=0x7f7f7400edc0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 shutdown_connections 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7f680662f0 0x7f7f680687a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f84159f20 0x7f7f84141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f840caf70 0x7f7f840c3e60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 --2- 172.21.15.123:0/294456102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840c9d90 0x7f7f841405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:22.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 >> 172.21.15.123:0/294456102 conn(0x7f7f8406e960 msgr2=0x7f7f8414e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:22.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 shutdown_connections 2023-07-21T19:09:22.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:22.934+0000 7f7f8b440700 1 -- 172.21.15.123:0/294456102 wait complete. 2023-07-21T19:09:22.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-21T19:09:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.134+0000 7f0be1e27700 1 Processor -- start 2023-07-21T19:09:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.134+0000 7f0be1e27700 1 -- start start 2023-07-21T19:09:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0be1e27700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0be1e27700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0b0ef0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0be1e27700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0ce9c0 con 0x7f0bdc0c9d90 2023-07-21T19:09:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0be1e27700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0cee50 con 0x7f0bdc159f20 2023-07-21T19:09:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0be1626700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0bdc0caf70 0x7f0bdc15d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60094/0 (socket says 172.21.15.123:60094) 2023-07-21T19:09:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0be1626700 1 -- 172.21.15.123:0/4225894362 learned_addr learned my addr 172.21.15.123:0/4225894362 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdbfff700 1 --2- 172.21.15.123:0/4225894362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641772665 0 0) 0x7f0bdc0b0ef0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bcc0035d0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383337803 0 0) 0x7f0bdc0ce9c0 con 0x7f0bdc0c9d90 2023-07-21T19:09:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bdc0b0ef0 con 0x7f0bdc0c9d90 2023-07-21T19:09:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 904969560 0 0) 0x7f0bcc0035d0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdbfff700 1 -- 172.21.15.123:0/4225894362 >> v1:172.21.15.145:6789/0 conn(0x7f0bdc0c9d90 legacy=0x7f0bdc0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdbfff700 1 -- 172.21.15.123:0/4225894362 >> v1:172.21.15.123:6789/0 conn(0x7f0bdc0caf70 legacy=0x7f0bdc15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdbfff700 1 -- 172.21.15.123:0/4225894362 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0cb4f0 con 0x7f0bdc159f20 2023-07-21T19:09:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdbfff700 1 --2- 172.21.15.123:0/4225894362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0caa30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009880 tx=0x7f0bc8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827a07eb2955dc4f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40019f0 con 0x7f0bdc159f20 2023-07-21T19:09:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8004030 con 0x7f0bdc159f20 2023-07-21T19:09:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.138+0000 7f0bdb7fe700 1 -- 172.21.15.123:0/4225894362 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80043c0 con 0x7f0bdc159f20 2023-07-21T19:09:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 -- 172.21.15.123:0/4225894362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 msgr2=0x7f0bdc0caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 --2- 172.21.15.123:0/4225894362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0caa30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009880 tx=0x7f0bc8009b90 comp rx=0 tx=0).stop 2023-07-21T19:09:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 -- 172.21.15.123:0/4225894362 shutdown_connections 2023-07-21T19:09:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 --2- 172.21.15.123:0/4225894362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0caa30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 -- 172.21.15.123:0/4225894362 >> 172.21.15.123:0/4225894362 conn(0x7f0bdc06e960 msgr2=0x7f0bdc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 -- 172.21.15.123:0/4225894362 shutdown_connections 2023-07-21T19:09:23.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.142+0000 7f0be1e27700 1 -- 172.21.15.123:0/4225894362 wait complete. 2023-07-21T19:09:23.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 Processor -- start 2023-07-21T19:09:23.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 -- start start 2023-07-21T19:09:23.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bdc0c9d90 0x7f0bdc0c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 0x7f0bdc1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1f2500 con 0x7f0bdc0caf70 2023-07-21T19:09:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c1b90 con 0x7f0bdc0c9d90 2023-07-21T19:09:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1e27700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c1e70 con 0x7f0bdc159f20 2023-07-21T19:09:23.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 0x7f0bdc1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 0x7f0bdc1533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42820/0 (socket says 172.21.15.123:42820) 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 -- 172.21.15.123:0/2969346837 learned_addr learned my addr 172.21.15.123:0/2969346837 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1626700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be0e25700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bdc0c9d90 0x7f0bdc0c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 -- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 msgr2=0x7f0bdc0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 -- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bdc0c9d90 msgr2=0x7f0bdc0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bdc0c9d90 0x7f0bdc0c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 -- 172.21.15.123:0/2969346837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80094b0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0be1626700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.146+0000 7f0bdbfff700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 0x7f0bdc1533b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80097d0 tx=0x7f0bc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.150+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8003d40 con 0x7f0bdc0caf70 2023-07-21T19:09:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.150+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8011630 con 0x7f0bdc0caf70 2023-07-21T19:09:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.150+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc0c2150 con 0x7f0bdc0caf70 2023-07-21T19:09:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.150+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8003ea0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.150+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc1538f0 con 0x7f0bdc0caf70 2023-07-21T19:09:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.150+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0c2670 con 0x7f0bdc0caf70 2023-07-21T19:09:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.154+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0bc8018050 con 0x7f0bdc0caf70 2023-07-21T19:09:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.154+0000 7f0bd97fa700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0bc00662f0 0x7f0bc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.154+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0bc8084560 con 0x7f0bdc0caf70 2023-07-21T19:09:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.154+0000 7f0be0e25700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0bc00662f0 0x7f0bc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.154+0000 7f0be0e25700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0bc00662f0 0x7f0bc00687a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00011e0 tx=0x7f0bd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:23.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.158+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0bdc0c2670 con 0x7f0bdc0caf70 2023-07-21T19:09:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.386+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0bdc0c2670 con 0x7f0bdc0caf70 2023-07-21T19:09:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.398+0000 7f0bd97fa700 1 -- 172.21.15.123:0/2969346837 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0bdc0c2670 con 0x7f0bdc0caf70 2023-07-21T19:09:23.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0bc00662f0 msgr2=0x7f0bc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0bc00662f0 0x7f0bc00687a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00011e0 tx=0x7f0bd0009040 comp rx=0 tx=0).stop 2023-07-21T19:09:23.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 msgr2=0x7f0bdc1533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 0x7f0bdc1533b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80097d0 tx=0x7f0bc8004770 comp rx=0 tx=0).stop 2023-07-21T19:09:23.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 shutdown_connections 2023-07-21T19:09:23.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f0bc00662f0 0x7f0bc00687a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0bdc159f20 0x7f0bdc0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bdc0caf70 0x7f0bdc1533b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 --2- 172.21.15.123:0/2969346837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0bdc0c9d90 0x7f0bdc0c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 >> 172.21.15.123:0/2969346837 conn(0x7f0bdc06e960 msgr2=0x7f0bdc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:23.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 shutdown_connections 2023-07-21T19:09:23.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.402+0000 7f0be1e27700 1 -- 172.21.15.123:0/2969346837 wait complete. 2023-07-21T19:09:23.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-21T19:09:23.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 Processor -- start 2023-07-21T19:09:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 -- start start 2023-07-21T19:09:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f369006f070 0x7f36900cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900cc9c0 con 0x7f369006cd00 2023-07-21T19:09:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369006dab0 con 0x7f369006f070 2023-07-21T19:09:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.598+0000 7f36957bf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369006d210 con 0x7f36901457d0 2023-07-21T19:09:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368e7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f369006cd00 0x7f369006e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60108/0 (socket says 172.21.15.123:60108) 2023-07-21T19:09:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368e7fc700 1 -- 172.21.15.123:0/1520311688 learned_addr learned my addr 172.21.15.123:0/1520311688 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368f7fe700 1 --2- 172.21.15.123:0/1520311688 >> v2:172.21.15.145:3300/0 conn(0x7f369006f070 0x7f36900cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368effd700 1 --2- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368dffb700 1 -- 172.21.15.123:0/1520311688 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044694599 0 0) 0x7f36900cc9c0 con 0x7f369006cd00 2023-07-21T19:09:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368dffb700 1 -- 172.21.15.123:0/1520311688 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36780035d0 con 0x7f369006cd00 2023-07-21T19:09:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368f7fe700 1 -- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 msgr2=0x7f369006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368f7fe700 1 --2- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369006c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368f7fe700 1 -- 172.21.15.123:0/1520311688 >> v1:172.21.15.123:6789/0 conn(0x7f369006cd00 legacy=0x7f369006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368f7fe700 1 -- 172.21.15.123:0/1520311688 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369006d4f0 con 0x7f369006f070 2023-07-21T19:09:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368f7fe700 1 --2- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006f070 0x7f36900cd110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3688009d90 tx=0x7f368800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21846a04728756d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368dffb700 1 -- 172.21.15.123:0/1520311688 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800e070 con 0x7f369006f070 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368dffb700 1 -- 172.21.15.123:0/1520311688 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368800bb20 con 0x7f369006f070 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f368dffb700 1 -- 172.21.15.123:0/1520311688 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688012430 con 0x7f369006f070 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 -- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006f070 msgr2=0x7f36900cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 --2- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006f070 0x7f36900cd110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3688009d90 tx=0x7f368800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 -- 172.21.15.123:0/1520311688 shutdown_connections 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 --2- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006f070 0x7f36900cd110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 --2- 172.21.15.123:0/1520311688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 -- 172.21.15.123:0/1520311688 >> 172.21.15.123:0/1520311688 conn(0x7f3690069800 msgr2=0x7f3690069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 -- 172.21.15.123:0/1520311688 shutdown_connections 2023-07-21T19:09:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.602+0000 7f36957bf700 1 -- 172.21.15.123:0/1520311688 wait complete. 2023-07-21T19:09:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 Processor -- start 2023-07-21T19:09:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 -- start start 2023-07-21T19:09:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 0x7f36900b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 0x7f369013a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369013b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369013e1c0 con 0x7f369006f070 2023-07-21T19:09:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900b21e0 con 0x7f369006cd00 2023-07-21T19:09:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f36957bf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369013d2d0 con 0x7f36901457d0 2023-07-21T19:09:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.606+0000 7f368e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 0x7f369013a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368effd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 0x7f36900b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368effd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 0x7f36900b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:56562/0 (socket says 172.21.15.123:56562) 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368effd700 1 -- 172.21.15.123:0/2297996963 learned_addr learned my addr 172.21.15.123:0/2297996963 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 0x7f369013a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42824/0 (socket says 172.21.15.123:42824) 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368f7fe700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369013b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 -- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 msgr2=0x7f369013b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369013b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 -- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 msgr2=0x7f36900b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 0x7f36900b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 -- 172.21.15.123:0/2297996963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009a70 con 0x7f369006f070 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368effd700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 0x7f36900b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f368e7fc700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 0x7f369013a700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f368400c440 tx=0x7f368400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684005d90 con 0x7f369006f070 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400ce10 con 0x7f369006f070 2023-07-21T19:09:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840072d0 con 0x7f369006f070 2023-07-21T19:09:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369013d5b0 con 0x7f369006f070 2023-07-21T19:09:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.610+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369013db70 con 0x7f369006f070 2023-07-21T19:09:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.614+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369013e370 con 0x7f369006f070 2023-07-21T19:09:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.614+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3684007430 con 0x7f369006f070 2023-07-21T19:09:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.614+0000 7f36777fe700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f367c0662f0 0x7f367c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.614+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3684082910 con 0x7f369006f070 2023-07-21T19:09:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.614+0000 7f368effd700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f367c0662f0 0x7f367c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.614+0000 7f368effd700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f367c0662f0 0x7f367c0687a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f36800113d0 tx=0x7f3680009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.622+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f369013e370 con 0x7f369006f070 2023-07-21T19:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.858+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f369004dcb0 con 0x7f369006f070 2023-07-21T19:09:23.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.866+0000 7f36777fe700 1 -- 172.21.15.123:0/2297996963 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3684050060 con 0x7f369006f070 2023-07-21T19:09:23.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f367c0662f0 msgr2=0x7f367c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f367c0662f0 0x7f367c0687a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f36800113d0 tx=0x7f3680009240 comp rx=0 tx=0).stop 2023-07-21T19:09:23.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 msgr2=0x7f369013a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:23.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 0x7f369013a700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f368400c440 tx=0x7f368400c750 comp rx=0 tx=0).stop 2023-07-21T19:09:23.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 shutdown_connections 2023-07-21T19:09:23.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f367c0662f0 0x7f367c0687a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36901457d0 0x7f369013b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369006f070 0x7f369013a700 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 --2- 172.21.15.123:0/2297996963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f369006cd00 0x7f36900b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:23.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 >> 172.21.15.123:0/2297996963 conn(0x7f3690069800 msgr2=0x7f3690143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:23.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 shutdown_connections 2023-07-21T19:09:23.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:23.870+0000 7f36957bf700 1 -- 172.21.15.123:0/2297996963 wait complete. 2023-07-21T19:09:23.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-21T19:09:24.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 Processor -- start 2023-07-21T19:09:24.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 -- start start 2023-07-21T19:09:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8c9006d860 0x7f8c900cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c9006be70 0x7f8c9006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c900c1e00 0x7f8c900cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c900cc1b0 con 0x7f8c9006be70 2023-07-21T19:09:24.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9006e170 con 0x7f8c9006d860 2023-07-21T19:09:24.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.066+0000 7f8c96220700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900cd690 con 0x7f8c900c1e00 2023-07-21T19:09:24.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c9006be70 0x7f8c9006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c9006be70 0x7f8c9006dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42840/0 (socket says 172.21.15.123:42840) 2023-07-21T19:09:24.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 -- 172.21.15.123:0/2872302292 learned_addr learned my addr 172.21.15.123:0/2872302292 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c8f7fe700 1 --2- 172.21.15.123:0/2872302292 >> v2:172.21.15.145:3300/0 conn(0x7f8c9006d860 0x7f8c900cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c8ffff700 1 --2- 172.21.15.123:0/2872302292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c900c1e00 0x7f8c900cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 -- 172.21.15.123:0/2872302292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c900c1e00 msgr2=0x7f8c900cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 --2- 172.21.15.123:0/2872302292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c900c1e00 0x7f8c900cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 -- 172.21.15.123:0/2872302292 >> v2:172.21.15.145:3300/0 conn(0x7f8c9006d860 msgr2=0x7f8c900cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 --2- 172.21.15.123:0/2872302292 >> v2:172.21.15.145:3300/0 conn(0x7f8c9006d860 0x7f8c900cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 -- 172.21.15.123:0/2872302292 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900cd970 con 0x7f8c9006be70 2023-07-21T19:09:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c86ffd700 1 --2- 172.21.15.123:0/2872302292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9006be70 0x7f8c9006dc30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8c9006c410 tx=0x7f8c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d576e71b8caa2b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c8effd700 1 -- 172.21.15.123:0/2872302292 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800e070 con 0x7f8c9006be70 2023-07-21T19:09:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c8effd700 1 -- 172.21.15.123:0/2872302292 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800b910 con 0x7f8c9006be70 2023-07-21T19:09:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c8effd700 1 -- 172.21.15.123:0/2872302292 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800bcc0 con 0x7f8c9006be70 2023-07-21T19:09:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 -- 172.21.15.123:0/2872302292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9006be70 msgr2=0x7f8c9006dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 --2- 172.21.15.123:0/2872302292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9006be70 0x7f8c9006dc30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8c9006c410 tx=0x7f8c7800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 -- 172.21.15.123:0/2872302292 shutdown_connections 2023-07-21T19:09:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 --2- 172.21.15.123:0/2872302292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c900c1e00 0x7f8c900cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 --2- 172.21.15.123:0/2872302292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9006be70 0x7f8c9006dc30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 --2- 172.21.15.123:0/2872302292 >> v2:172.21.15.145:3300/0 conn(0x7f8c9006d860 0x7f8c900cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 -- 172.21.15.123:0/2872302292 >> 172.21.15.123:0/2872302292 conn(0x7f8c900cad30 msgr2=0x7f8c900cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 -- 172.21.15.123:0/2872302292 shutdown_connections 2023-07-21T19:09:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.070+0000 7f8c96220700 1 -- 172.21.15.123:0/2872302292 wait complete. 2023-07-21T19:09:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 Processor -- start 2023-07-21T19:09:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 -- start start 2023-07-21T19:09:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c9006be70 0x7f8c9014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c9006d860 0x7f8c90144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 0x7f8c900ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9014aef0 con 0x7f8c900c1e00 2023-07-21T19:09:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c90149220 con 0x7f8c9006d860 2023-07-21T19:09:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.074+0000 7f8c96220700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900adf90 con 0x7f8c9006be70 2023-07-21T19:09:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 0x7f8c900ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 0x7f8c900ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42844/0 (socket says 172.21.15.123:42844) 2023-07-21T19:09:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 -- 172.21.15.123:0/1119647399 learned_addr learned my addr 172.21.15.123:0/1119647399 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:24.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8f7fe700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c9006be70 0x7f8c9014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c86ffd700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c9006d860 0x7f8c90144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 -- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c9006be70 msgr2=0x7f8c9014a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c9006be70 0x7f8c9014a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 -- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c9006d860 msgr2=0x7f8c90144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c9006d860 0x7f8c90144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 -- 172.21.15.123:0/1119647399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78009b30 con 0x7f8c900c1e00 2023-07-21T19:09:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8ffff700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 0x7f8c900ae790 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800e7f0 tx=0x7f8c8800eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c880095c0 con 0x7f8c900c1e00 2023-07-21T19:09:24.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88013680 con 0x7f8c900c1e00 2023-07-21T19:09:24.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88013a10 con 0x7f8c900c1e00 2023-07-21T19:09:24.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c901494c0 con 0x7f8c900c1e00 2023-07-21T19:09:24.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c90144ea0 con 0x7f8c900c1e00 2023-07-21T19:09:24.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.078+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9004dcb0 con 0x7f8c900c1e00 2023-07-21T19:09:24.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.082+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c88013b90 con 0x7f8c900c1e00 2023-07-21T19:09:24.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.082+0000 7f8c8cff9700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8c700662f0 0x7f8c700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.082+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8c88083950 con 0x7f8c900c1e00 2023-07-21T19:09:24.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.082+0000 7f8c8f7fe700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8c700662f0 0x7f8c700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.086+0000 7f8c8f7fe700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8c700662f0 0x7f8c700687a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009b70 tx=0x7f8c80009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.090+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8c88054a60 con 0x7f8c900c1e00 2023-07-21T19:09:24.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.318+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8c900c4c10 con 0x7f8c900c1e00 2023-07-21T19:09:24.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.326+0000 7f8c8cff9700 1 -- 172.21.15.123:0/1119647399 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8c880545f0 con 0x7f8c900c1e00 2023-07-21T19:09:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8c700662f0 msgr2=0x7f8c700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8c700662f0 0x7f8c700687a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009b70 tx=0x7f8c80009240 comp rx=0 tx=0).stop 2023-07-21T19:09:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 msgr2=0x7f8c900ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 0x7f8c900ae790 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800e7f0 tx=0x7f8c8800eb00 comp rx=0 tx=0).stop 2023-07-21T19:09:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 shutdown_connections 2023-07-21T19:09:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8c700662f0 0x7f8c700687a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c9006d860 0x7f8c90144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c900c1e00 0x7f8c900ae790 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 --2- 172.21.15.123:0/1119647399 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c9006be70 0x7f8c9014a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 >> 172.21.15.123:0/1119647399 conn(0x7f8c900cad30 msgr2=0x7f8c900ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 shutdown_connections 2023-07-21T19:09:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.334+0000 7f8c96220700 1 -- 172.21.15.123:0/1119647399 wait complete. 2023-07-21T19:09:24.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:24.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.530+0000 7fb9a6d45700 1 Processor -- start 2023-07-21T19:09:24.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.530+0000 7fb9a6d45700 1 -- start start 2023-07-21T19:09:24.546 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.530+0000 7fb9a6d45700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a01669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6d45700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a00af0a0 con 0x7fb9a015bff0 2023-07-21T19:09:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6d45700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a00cf720 con 0x7fb9a00cd240 2023-07-21T19:09:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6d45700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00af2f0 con 0x7fb9a00b0de0 2023-07-21T19:09:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a5d43700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9a015bff0 0x7fb9a00ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60110/0 (socket says 172.21.15.123:60110) 2023-07-21T19:09:24.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a5d43700 1 -- 172.21.15.123:0/4100322391 learned_addr learned my addr 172.21.15.123:0/4100322391 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:24.548 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6544700 1 --2- 172.21.15.123:0/4100322391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a01669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a4d41700 1 -- 172.21.15.123:0/4100322391 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075554860 0 0) 0x7fb9a00af0a0 con 0x7fb9a015bff0 2023-07-21T19:09:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a4d41700 1 -- 172.21.15.123:0/4100322391 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb98c0035d0 con 0x7fb9a015bff0 2023-07-21T19:09:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6544700 1 -- 172.21.15.123:0/4100322391 >> v1:172.21.15.145:6789/0 conn(0x7fb9a00cd240 legacy=0x7fb9a00ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6544700 1 -- 172.21.15.123:0/4100322391 >> v1:172.21.15.123:6789/0 conn(0x7fb9a015bff0 legacy=0x7fb9a00ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6544700 1 -- 172.21.15.123:0/4100322391 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a00af5d0 con 0x7fb9a00b0de0 2023-07-21T19:09:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6544700 1 --2- 172.21.15.123:0/4100322391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a01669d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb998009dc0 tx=0x7fb99800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a56bde1603e9a89 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a4d41700 1 -- 172.21.15.123:0/4100322391 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99800e070 con 0x7fb9a00b0de0 2023-07-21T19:09:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a4d41700 1 -- 172.21.15.123:0/4100322391 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99800bb20 con 0x7fb9a00b0de0 2023-07-21T19:09:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a4d41700 1 -- 172.21.15.123:0/4100322391 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998012430 con 0x7fb9a00b0de0 2023-07-21T19:09:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6d45700 1 -- 172.21.15.123:0/4100322391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 msgr2=0x7fb9a01669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.534+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/4100322391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a01669d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb998009dc0 tx=0x7fb99800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- 172.21.15.123:0/4100322391 shutdown_connections 2023-07-21T19:09:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/4100322391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a01669d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- 172.21.15.123:0/4100322391 >> 172.21.15.123:0/4100322391 conn(0x7fb9a0060c40 msgr2=0x7fb9a009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- 172.21.15.123:0/4100322391 shutdown_connections 2023-07-21T19:09:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- 172.21.15.123:0/4100322391 wait complete. 2023-07-21T19:09:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 Processor -- start 2023-07-21T19:09:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- start start 2023-07-21T19:09:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9a00cd240 0x7fb9a015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 0x7fb9a01f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a015d310 con 0x7fb9a015bff0 2023-07-21T19:09:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a015d590 con 0x7fb9a00cd240 2023-07-21T19:09:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.538+0000 7fb9a6d45700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a015d870 con 0x7fb9a00b0de0 2023-07-21T19:09:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 0x7fb9a01f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 0x7fb9a01f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42850/0 (socket says 172.21.15.123:42850) 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 -- 172.21.15.123:0/1334148703 learned_addr learned my addr 172.21.15.123:0/1334148703 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a5542700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9a00cd240 0x7fb9a015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a5d43700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 -- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 msgr2=0x7fb9a015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 -- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9a00cd240 msgr2=0x7fb9a015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9a00cd240 0x7fb9a015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 -- 172.21.15.123:0/1334148703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998009a70 con 0x7fb9a015bff0 2023-07-21T19:09:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6544700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 0x7fb9a01f0940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb998014040 tx=0x7fb998004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998012430 con 0x7fb9a015bff0 2023-07-21T19:09:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998020070 con 0x7fb9a015bff0 2023-07-21T19:09:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998004280 con 0x7fb9a015bff0 2023-07-21T19:09:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a015db50 con 0x7fb9a015bff0 2023-07-21T19:09:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a01f0e80 con 0x7fb9a015bff0 2023-07-21T19:09:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.542+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a004e500 con 0x7fb9a015bff0 2023-07-21T19:09:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.546+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9980043e0 con 0x7fb9a015bff0 2023-07-21T19:09:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.546+0000 7fb9967fc700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb984066320 0x7fb9840687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.546+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb998022070 con 0x7fb9a015bff0 2023-07-21T19:09:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.546+0000 7fb9a5d43700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb984066320 0x7fb9840687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.550+0000 7fb9a5d43700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb984066320 0x7fb9840687d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0011e0 tx=0x7fb99c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.554+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb998052e40 con 0x7fb9a015bff0 2023-07-21T19:09:24.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.726+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9a015b7a0 con 0x7fb9a015bff0 2023-07-21T19:09:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.726+0000 7fb9967fc700 1 -- 172.21.15.123:0/1334148703 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+14904 (secure 0 0 0) 0x7fb998056460 con 0x7fb9a015bff0 2023-07-21T19:09:24.742 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:24.742 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":39,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:09:21.089630+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb984066320 msgr2=0x7fb9840687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb984066320 0x7fb9840687d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0011e0 tx=0x7fb99c009040 comp rx=0 tx=0).stop 2023-07-21T19:09:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 msgr2=0x7fb9a01f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 0x7fb9a01f0940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb998014040 tx=0x7fb998004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 shutdown_connections 2023-07-21T19:09:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fb984066320 0x7fb9840687d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9a00cd240 0x7fb9a015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a015bff0 0x7fb9a01f0940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 --2- 172.21.15.123:0/1334148703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb9a00b0de0 0x7fb9a015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 >> 172.21.15.123:0/1334148703 conn(0x7fb9a0060c40 msgr2=0x7fb9a00cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 shutdown_connections 2023-07-21T19:09:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.730+0000 7fb9a6d45700 1 -- 172.21.15.123:0/1334148703 wait complete. 2023-07-21T19:09:24.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T19:07:36.002250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T19:07:41.293663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T19:09:24.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T19:09:24.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.926+0000 7f08124f2700 1 Processor -- start 2023-07-21T19:09:24.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.926+0000 7f08124f2700 1 -- start start 2023-07-21T19:09:24.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08124f2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f080c0b0ee0 0x7f080c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08124f2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0cd090 0x7f080c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08124f2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c0cd4e0 con 0x7f080c0d0610 2023-07-21T19:09:24.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08124f2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c0d1a60 con 0x7f080c0b0ee0 2023-07-21T19:09:24.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08124f2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0d1ef0 con 0x7f080c0cd090 2023-07-21T19:09:24.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08114f0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f080c0b0ee0 0x7f080c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f0811cf1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f080c0d0610 0x7f080c15f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60116/0 (socket says 172.21.15.123:60116) 2023-07-21T19:09:24.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f0811cf1700 1 -- 172.21.15.123:0/252393702 learned_addr learned my addr 172.21.15.123:0/252393702 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:24.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f0810cef700 1 --2- 172.21.15.123:0/252393702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0cd090 0x7f080c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08114f0700 1 -- 172.21.15.123:0/252393702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0cd090 msgr2=0x7f080c0d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:24.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08114f0700 1 --2- 172.21.15.123:0/252393702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0cd090 0x7f080c0d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08114f0700 1 -- 172.21.15.123:0/252393702 >> v1:172.21.15.123:6789/0 conn(0x7f080c0d0610 legacy=0x7f080c15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f08114f0700 1 -- 172.21.15.123:0/252393702 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0d0e50 con 0x7f080c0b0ee0 2023-07-21T19:09:24.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.930+0000 7f0803fff700 1 -- 172.21.15.123:0/252393702 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139108366 0 0) 0x7f0804001490 con 0x7f080c0d0610 2023-07-21T19:09:24.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08114f0700 1 --2- 172.21.15.123:0/252393702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0b0ee0 0x7f080c0ccb50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0808009880 tx=0x7f0808009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df8bb0e31a04727 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f0803fff700 1 -- 172.21.15.123:0/252393702 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808011830 con 0x7f080c0b0ee0 2023-07-21T19:09:24.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f0803fff700 1 -- 172.21.15.123:0/252393702 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808011990 con 0x7f080c0b0ee0 2023-07-21T19:09:24.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f0803fff700 1 -- 172.21.15.123:0/252393702 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808011d20 con 0x7f080c0b0ee0 2023-07-21T19:09:24.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 -- 172.21.15.123:0/252393702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0b0ee0 msgr2=0x7f080c0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 --2- 172.21.15.123:0/252393702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0b0ee0 0x7f080c0ccb50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0808009880 tx=0x7f0808009b90 comp rx=0 tx=0).stop 2023-07-21T19:09:24.951 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 -- 172.21.15.123:0/252393702 shutdown_connections 2023-07-21T19:09:24.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 --2- 172.21.15.123:0/252393702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0cd090 0x7f080c0d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 --2- 172.21.15.123:0/252393702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0b0ee0 0x7f080c0ccb50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 -- 172.21.15.123:0/252393702 >> 172.21.15.123:0/252393702 conn(0x7f080c060c40 msgr2=0x7f080c09b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:24.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 -- 172.21.15.123:0/252393702 shutdown_connections 2023-07-21T19:09:24.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.934+0000 7f08124f2700 1 -- 172.21.15.123:0/252393702 wait complete. 2023-07-21T19:09:24.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 Processor -- start 2023-07-21T19:09:24.954 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 -- start start 2023-07-21T19:09:24.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0b0ee0 0x7f080c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f080c0cd090 0x7f080c1f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 0x7f080c1f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0b2130 con 0x7f080c0d0610 2023-07-21T19:09:24.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0b3240 con 0x7f080c0cd090 2023-07-21T19:09:24.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.938+0000 7f08124f2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0b3b50 con 0x7f080c0b0ee0 2023-07-21T19:09:24.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 0x7f080c1f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 0x7f080c1f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42864/0 (socket says 172.21.15.123:42864) 2023-07-21T19:09:24.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 -- 172.21.15.123:0/1496448253 learned_addr learned my addr 172.21.15.123:0/1496448253 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:24.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f08114f0700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0b0ee0 0x7f080c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0810cef700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f080c0cd090 0x7f080c1f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 -- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0b0ee0 msgr2=0x7f080c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0b0ee0 0x7f080c0b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 -- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f080c0cd090 msgr2=0x7f080c1f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:24.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f080c0cd090 0x7f080c1f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:24.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 -- 172.21.15.123:0/1496448253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08080094b0 con 0x7f080c0d0610 2023-07-21T19:09:24.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f08114f0700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0b0ee0 0x7f080c0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:24.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0810cef700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f080c0cd090 0x7f080c1f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:24.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0811cf1700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 0x7f080c1f1840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f080400cca0 tx=0x7f080400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400cea0 con 0x7f080c0d0610 2023-07-21T19:09:24.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400ade0 con 0x7f080c0d0610 2023-07-21T19:09:24.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c0b3e30 con 0x7f080c0d0610 2023-07-21T19:09:24.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804007310 con 0x7f080c0d0610 2023-07-21T19:09:24.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c0b43f0 con 0x7f080c0d0610 2023-07-21T19:09:24.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.942+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c04e500 con 0x7f080c0d0610 2023-07-21T19:09:24.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.946+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0804007470 con 0x7f080c0d0610 2023-07-21T19:09:24.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.946+0000 7f0801ffb700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07f00662f0 0x7f07f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:24.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.946+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0804083900 con 0x7f080c0d0610 2023-07-21T19:09:24.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.946+0000 7f08114f0700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07f00662f0 0x7f07f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:24.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.950+0000 7f08114f0700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07f00662f0 0x7f07f00687a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f08080090b0 tx=0x7f080801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:24.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:24.954+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0804050f80 con 0x7f080c0d0610 2023-07-21T19:09:25.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.122+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f080c0cd4e0 con 0x7f080c0d0610 2023-07-21T19:09:25.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.122+0000 7f0801ffb700 1 -- 172.21.15.123:0/1496448253 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f080c0cd4e0 con 0x7f080c0d0610 2023-07-21T19:09:25.138 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-07-21T19:09:25.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07f00662f0 msgr2=0x7f07f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07f00662f0 0x7f07f00687a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f08080090b0 tx=0x7f080801c040 comp rx=0 tx=0).stop 2023-07-21T19:09:25.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 msgr2=0x7f080c1f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 0x7f080c1f1840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f080400cca0 tx=0x7f080400a340 comp rx=0 tx=0).stop 2023-07-21T19:09:25.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 shutdown_connections 2023-07-21T19:09:25.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f07f00662f0 0x7f07f00687a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f080c0cd090 0x7f080c1f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f080c0d0610 0x7f080c1f1840 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.126+0000 7f08124f2700 1 --2- 172.21.15.123:0/1496448253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f080c0b0ee0 0x7f080c0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.130+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 >> 172.21.15.123:0/1496448253 conn(0x7f080c060c40 msgr2=0x7f080c0ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:25.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.130+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 shutdown_connections 2023-07-21T19:09:25.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.130+0000 7f08124f2700 1 -- 172.21.15.123:0/1496448253 wait complete. 2023-07-21T19:09:25.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T19:09:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.322+0000 7f195759e700 1 Processor -- start 2023-07-21T19:09:25.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.322+0000 7f195759e700 1 -- start start 2023-07-21T19:09:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195759e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f19581603d0 0x7f195806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580cdfb0 con 0x7f1958160000 2023-07-21T19:09:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195759e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580cdcd0 con 0x7f19580cd7f0 2023-07-21T19:09:25.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195759e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1958070e40 con 0x7f19581603d0 2023-07-21T19:09:25.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195659c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1958160000 0x7f19580c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60132/0 (socket says 172.21.15.123:60132) 2023-07-21T19:09:25.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195659c700 1 -- 172.21.15.123:0/4083161519 learned_addr learned my addr 172.21.15.123:0/4083161519 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:25.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f1955d9b700 1 --2- 172.21.15.123:0/4083161519 >> v2:172.21.15.145:3300/0 conn(0x7f19581603d0 0x7f195806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290019635 0 0) 0x7f1948001110 con 0x7f1958160000 2023-07-21T19:09:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19400035d0 con 0x7f1958160000 2023-07-21T19:09:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916411328 0 0) 0x7f19580cdcd0 con 0x7f19580cd7f0 2023-07-21T19:09:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1948001110 con 0x7f19580cd7f0 2023-07-21T19:09:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243917172 0 0) 0x7f19400035d0 con 0x7f1958160000 2023-07-21T19:09:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 >> v2:172.21.15.145:3300/0 conn(0x7f19581603d0 msgr2=0x7f195806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 --2- 172.21.15.123:0/4083161519 >> v2:172.21.15.145:3300/0 conn(0x7f19581603d0 0x7f195806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 >> v1:172.21.15.145:6789/0 conn(0x7f19580cd7f0 legacy=0x7f19580c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958070780 con 0x7f1958160000 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f1948001800 con 0x7f1958160000 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 >> v1:172.21.15.123:6789/0 conn(0x7f1958160000 legacy=0x7f19580c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1940003bb0 0x7f1940003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940004870 0x7f1940004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1940005220 0x7f194000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1958070e40 con 0x7f1940004870 2023-07-21T19:09:25.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194000c080 con 0x7f1940003bb0 2023-07-21T19:09:25.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194000c240 con 0x7f1940005220 2023-07-21T19:09:25.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f1955d9b700 1 --2- 172.21.15.123:0/4083161519 >> v2:172.21.15.145:3300/0 conn(0x7f19581603d0 0x7f195806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:25.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f195659c700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1940003bb0 0x7f1940003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f1955d9b700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940004870 0x7f1940004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.326+0000 7f1956d9d700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1940005220 0x7f194000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 -- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1940003bb0 msgr2=0x7f1940003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1940003bb0 0x7f1940003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 -- 172.21.15.123:0/4083161519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940004870 msgr2=0x7f1940004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940004870 0x7f1940004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 -- 172.21.15.123:0/4083161519 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400035d0 con 0x7f1940005220 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 -- 172.21.15.123:0/4083161519 reap_dead start 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f1956d9d700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1940005220 0x7f194000ba30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f195000c2f0 tx=0x7f19400058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ab59e6aa8b40ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950001f30 con 0x7f1940005220 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1950003a20 con 0x7f1940005220 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195559a700 1 -- 172.21.15.123:0/4083161519 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950003dd0 con 0x7f1940005220 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 -- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1940005220 msgr2=0x7f194000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1940005220 0x7f194000ba30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f195000c2f0 tx=0x7f19400058a0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 -- 172.21.15.123:0/4083161519 shutdown_connections 2023-07-21T19:09:25.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 --2- 172.21.15.123:0/4083161519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1940005220 0x7f194000ba30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 -- 172.21.15.123:0/4083161519 >> 172.21.15.123:0/4083161519 conn(0x7f19580afc60 msgr2=0x7f19580b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:25.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 -- 172.21.15.123:0/4083161519 shutdown_connections 2023-07-21T19:09:25.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.330+0000 7f195759e700 1 -- 172.21.15.123:0/4083161519 wait complete. 2023-07-21T19:09:25.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 Processor -- start 2023-07-21T19:09:25.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 -- start start 2023-07-21T19:09:25.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 0x7f1958164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19580c6c10 0x7f19580adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19580ae050 0x7f195814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580c81d0 con 0x7f1940005220 2023-07-21T19:09:25.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580ae4c0 con 0x7f19580c6c10 2023-07-21T19:09:25.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.334+0000 7f195759e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19580c6780 con 0x7f19580ae050 2023-07-21T19:09:25.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 0x7f1958164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 0x7f1958164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42884/0 (socket says 172.21.15.123:42884) 2023-07-21T19:09:25.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 -- 172.21.15.123:0/200819161 learned_addr learned my addr 172.21.15.123:0/200819161 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f1955d9b700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19580c6c10 0x7f19580adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f1956d9d700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19580ae050 0x7f195814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 -- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19580ae050 msgr2=0x7f195814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19580ae050 0x7f195814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 -- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19580c6c10 msgr2=0x7f19580adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19580c6c10 0x7f19580adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 -- 172.21.15.123:0/200819161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580c7c10 con 0x7f1940005220 2023-07-21T19:09:25.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f1955d9b700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19580c6c10 0x7f19580adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:25.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195659c700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 0x7f1958164680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1948007340 tx=0x7f1948007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:25.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800f870 con 0x7f1940005220 2023-07-21T19:09:25.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194800f9d0 con 0x7f1940005220 2023-07-21T19:09:25.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19580c7ef0 con 0x7f1940005220 2023-07-21T19:09:25.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800fd60 con 0x7f1940005220 2023-07-21T19:09:25.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19580c7080 con 0x7f1940005220 2023-07-21T19:09:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.338+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19580c7240 con 0x7f1940005220 2023-07-21T19:09:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.342+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f194801d460 con 0x7f1940005220 2023-07-21T19:09:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.342+0000 7f1946ffd700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1938066320 0x7f19380687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.342+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1948083a10 con 0x7f1940005220 2023-07-21T19:09:25.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.342+0000 7f1955d9b700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1938066320 0x7f19380687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.342+0000 7f1955d9b700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1938066320 0x7f19380687d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19580c8700 tx=0x7f194c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:25.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.350+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f19480512a0 con 0x7f1940005220 2023-07-21T19:09:25.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.518+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f19580c6270 con 0x7f1940005220 2023-07-21T19:09:25.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f1946ffd700 1 -- 172.21.15.123:0/200819161 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f19580c6270 con 0x7f1940005220 2023-07-21T19:09:25.535 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-07-21T19:09:25.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1938066320 msgr2=0x7f19380687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1938066320 0x7f19380687d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19580c8700 tx=0x7f194c008040 comp rx=0 tx=0).stop 2023-07-21T19:09:25.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 msgr2=0x7f1958164680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 0x7f1958164680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1948007340 tx=0x7f1948007700 comp rx=0 tx=0).stop 2023-07-21T19:09:25.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 shutdown_connections 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f1938066320 0x7f19380687d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19580c6c10 0x7f19580adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19580ae050 0x7f195814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 --2- 172.21.15.123:0/200819161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1940005220 0x7f1958164680 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 >> 172.21.15.123:0/200819161 conn(0x7f19580afc60 msgr2=0x7f19580b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 shutdown_connections 2023-07-21T19:09:25.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.522+0000 7f195759e700 1 -- 172.21.15.123:0/200819161 wait complete. 2023-07-21T19:09:25.559 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T19:09:25.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.714+0000 7f4a02d24700 1 Processor -- start 2023-07-21T19:09:25.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02d24700 1 -- start start 2023-07-21T19:09:25.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02d24700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49fc15ffa0 0x7f49fc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02d24700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f49fc0cb180 0x7f49fc0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02d24700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc0ca8a0 con 0x7f49fc06dc50 2023-07-21T19:09:25.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02d24700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc0cbcd0 con 0x7f49fc15ffa0 2023-07-21T19:09:25.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02d24700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc0cbf70 con 0x7f49fc0cb180 2023-07-21T19:09:25.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01521700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f49fc06dc50 0x7f49fc0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60144/0 (socket says 172.21.15.123:60144) 2023-07-21T19:09:25.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01521700 1 -- 172.21.15.123:0/2087020305 learned_addr learned my addr 172.21.15.123:0/2087020305 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:25.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01d22700 1 --2- 172.21.15.123:0/2087020305 >> v2:172.21.15.123:3300/0 conn(0x7f49fc15ffa0 0x7f49fc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a02523700 1 --2- 172.21.15.123:0/2087020305 >> v2:172.21.15.145:3300/0 conn(0x7f49fc0cb180 0x7f49fc0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a00d20700 1 -- 172.21.15.123:0/2087020305 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201229099 0 0) 0x7f49ec001110 con 0x7f49fc06dc50 2023-07-21T19:09:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01d22700 1 -- 172.21.15.123:0/2087020305 >> v2:172.21.15.145:3300/0 conn(0x7f49fc0cb180 msgr2=0x7f49fc0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01d22700 1 --2- 172.21.15.123:0/2087020305 >> v2:172.21.15.145:3300/0 conn(0x7f49fc0cb180 0x7f49fc0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01d22700 1 -- 172.21.15.123:0/2087020305 >> v1:172.21.15.123:6789/0 conn(0x7f49fc06dc50 legacy=0x7f49fc0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.718+0000 7f4a01d22700 1 -- 172.21.15.123:0/2087020305 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0cc250 con 0x7f49fc15ffa0 2023-07-21T19:09:25.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a01d22700 1 --2- 172.21.15.123:0/2087020305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc06d710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f49fc163c80 tx=0x7f49f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3908c9147b705b3a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:25.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a00d20700 1 -- 172.21.15.123:0/2087020305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8011830 con 0x7f49fc15ffa0 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a00d20700 1 -- 172.21.15.123:0/2087020305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f8011990 con 0x7f49fc15ffa0 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a00d20700 1 -- 172.21.15.123:0/2087020305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8011d40 con 0x7f49fc15ffa0 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 -- 172.21.15.123:0/2087020305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 msgr2=0x7f49fc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 --2- 172.21.15.123:0/2087020305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc06d710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f49fc163c80 tx=0x7f49f8009b30 comp rx=0 tx=0).stop 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 -- 172.21.15.123:0/2087020305 shutdown_connections 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 --2- 172.21.15.123:0/2087020305 >> v2:172.21.15.145:3300/0 conn(0x7f49fc0cb180 0x7f49fc0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 --2- 172.21.15.123:0/2087020305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc06d710 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 -- 172.21.15.123:0/2087020305 >> 172.21.15.123:0/2087020305 conn(0x7f49fc06e960 msgr2=0x7f49fc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 -- 172.21.15.123:0/2087020305 shutdown_connections 2023-07-21T19:09:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.722+0000 7f4a02d24700 1 -- 172.21.15.123:0/2087020305 wait complete. 2023-07-21T19:09:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 Processor -- start 2023-07-21T19:09:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 -- start start 2023-07-21T19:09:25.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc06dc50 0x7f49fc15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0cb180 0x7f49fc0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc15db30 con 0x7f49fc15ffa0 2023-07-21T19:09:25.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0c4760 con 0x7f49fc0cb180 2023-07-21T19:09:25.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02d24700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0c52d0 con 0x7f49fc06dc50 2023-07-21T19:09:25.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42892/0 (socket says 172.21.15.123:42892) 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a01d22700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc06dc50 0x7f49fc15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 -- 172.21.15.123:0/1450502749 learned_addr learned my addr 172.21.15.123:0/1450502749 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a01521700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0cb180 0x7f49fc0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 -- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc06dc50 msgr2=0x7f49fc15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc06dc50 0x7f49fc15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 -- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0cb180 msgr2=0x7f49fc0c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0cb180 0x7f49fc0c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a02523700 1 -- 172.21.15.123:0/1450502749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80094b0 con 0x7f49fc15ffa0 2023-07-21T19:09:25.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.726+0000 7f4a01d22700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc06dc50 0x7f49fc15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:25.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f4a02523700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc0c5db0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f49f4007e60 tx=0x7f49f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:25.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400ed30 con 0x7f49fc15ffa0 2023-07-21T19:09:25.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f4014420 con 0x7f49fc15ffa0 2023-07-21T19:09:25.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40147d0 con 0x7f49fc15ffa0 2023-07-21T19:09:25.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc0c55b0 con 0x7f49fc15ffa0 2023-07-21T19:09:25.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc0c43a0 con 0x7f49fc15ffa0 2023-07-21T19:09:25.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.730+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc0c4530 con 0x7f49fc15ffa0 2023-07-21T19:09:25.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.734+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49f4014930 con 0x7f49fc15ffa0 2023-07-21T19:09:25.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.734+0000 7f49f27fc700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f49e0066320 0x7f49e00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:25.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.734+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f49f4084100 con 0x7f49fc15ffa0 2023-07-21T19:09:25.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.734+0000 7f4a01d22700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f49e0066320 0x7f49e00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:25.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.734+0000 7f4a01d22700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f49e0066320 0x7f49e00687d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f49f80090b0 tx=0x7f49f801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:25.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.742+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f49f4051780 con 0x7f49fc15ffa0 2023-07-21T19:09:25.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.918+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f49fc0c5130 con 0x7f49fc15ffa0 2023-07-21T19:09:25.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.918+0000 7f49f27fc700 1 -- 172.21.15.123:0/1450502749 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7f49fc0c5130 con 0x7f49fc15ffa0 2023-07-21T19:09:25.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-07-21T19:09:25.934 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 2, 2023-07-21T19:09:25.935 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": "rbd" 2023-07-21T19:09:25.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:25.935 INFO:teuthology.orchestra.run.smithi123.stdout:] 2023-07-21T19:09:25.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f49e0066320 msgr2=0x7f49e00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f49e0066320 0x7f49e00687d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f49f80090b0 tx=0x7f49f801c040 comp rx=0 tx=0).stop 2023-07-21T19:09:25.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 msgr2=0x7f49fc0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:25.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc0c5db0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f49f4007e60 tx=0x7f49f400e3c0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 shutdown_connections 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f49e0066320 0x7f49e00687d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0cb180 0x7f49fc0c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49fc15ffa0 0x7f49fc0c5db0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 --2- 172.21.15.123:0/1450502749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc06dc50 0x7f49fc15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 >> 172.21.15.123:0/1450502749 conn(0x7f49fc06e960 msgr2=0x7f49fc0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:25.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 shutdown_connections 2023-07-21T19:09:25.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:25.922+0000 7f4a02d24700 1 -- 172.21.15.123:0/1450502749 wait complete. 2023-07-21T19:09:25.960 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T19:09:25.960 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T19:09:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.126+0000 7f7a835a7700 1 Processor -- start 2023-07-21T19:09:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.126+0000 7f7a835a7700 1 -- start start 2023-07-21T19:09:26.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a835a7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 0x7f7a7c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a835a7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0c8570 con 0x7f7a7c15fdb0 2023-07-21T19:09:26.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a835a7700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c15c9e0 con 0x7f7a7c06e960 2023-07-21T19:09:26.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a835a7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c15d2c0 con 0x7f7a7c15ce70 2023-07-21T19:09:26.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a81b44700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7a7c15fdb0 0x7f7a7c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60154/0 (socket says 172.21.15.123:60154) 2023-07-21T19:09:26.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a81b44700 1 -- 172.21.15.123:0/1097877374 learned_addr learned my addr 172.21.15.123:0/1097877374 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:26.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a80b42700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 0x7f7a7c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482940794 0 0) 0x7f7a7c0c8570 con 0x7f7a7c15fdb0 2023-07-21T19:09:26.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a680035d0 con 0x7f7a7c15fdb0 2023-07-21T19:09:26.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691252981 0 0) 0x7f7a680035d0 con 0x7f7a7c15fdb0 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 msgr2=0x7f7a7c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 0x7f7a7c15f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 >> v1:172.21.15.145:6789/0 conn(0x7f7a7c06e960 legacy=0x7f7a7c06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c160450 con 0x7f7a7c15fdb0 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2974889289 0 0) 0x7f7a740019f0 con 0x7f7a7c15fdb0 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 >> v1:172.21.15.123:6789/0 conn(0x7f7a7c15fdb0 legacy=0x7f7a7c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:26.148 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a68003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 0x7f7a68004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a68004db0 0x7f7a68005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c15d2c0 con 0x7f7a68003a50 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6800bae0 con 0x7f7a68004db0 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.130+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6800bca0 con 0x7f7a7c15ce70 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a68003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81b44700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a68004db0 0x7f7a68005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a80b42700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 0x7f7a68004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 -- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 msgr2=0x7f7a68004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c15ce70 0x7f7a68004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 -- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a68004db0 msgr2=0x7f7a68005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a68004db0 0x7f7a68005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 -- 172.21.15.123:0/1097877374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680035d0 con 0x7f7a68003a50 2023-07-21T19:09:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81343700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a68003e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7a780017e0 tx=0x7f7a680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa7e0ae6e81963f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a780052d0 con 0x7f7a68003a50 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a78005430 con 0x7f7a68003a50 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a73fff700 1 -- 172.21.15.123:0/1097877374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a780055a0 con 0x7f7a68003a50 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a835a7700 1 -- 172.21.15.123:0/1097877374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 msgr2=0x7f7a68003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1097877374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a68003e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7a780017e0 tx=0x7f7a680058a0 comp rx=0 tx=0).stop 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a81b44700 1 -- 172.21.15.123:0/1097877374 reap_dead start 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a835a7700 1 -- 172.21.15.123:0/1097877374 shutdown_connections 2023-07-21T19:09:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a835a7700 1 -- 172.21.15.123:0/1097877374 >> 172.21.15.123:0/1097877374 conn(0x7f7a7c069800 msgr2=0x7f7a7c069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:26.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a835a7700 1 -- 172.21.15.123:0/1097877374 shutdown_connections 2023-07-21T19:09:26.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.134+0000 7f7a835a7700 1 -- 172.21.15.123:0/1097877374 wait complete. 2023-07-21T19:09:26.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.138+0000 7f7a835a7700 1 Processor -- start 2023-07-21T19:09:26.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.138+0000 7f7a835a7700 1 -- start start 2023-07-21T19:09:26.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a7c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a7c149110 0x7f7a7c0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c1582a0 0x7f7a7c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b4850 con 0x7f7a68003a50 2023-07-21T19:09:26.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b1590 con 0x7f7a7c149110 2023-07-21T19:09:26.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c158c50 con 0x7f7a7c1582a0 2023-07-21T19:09:26.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a7c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a7c0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42914/0 (socket says 172.21.15.123:42914) 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 -- 172.21.15.123:0/1337173090 learned_addr learned my addr 172.21.15.123:0/1337173090 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a80b42700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a7c149110 0x7f7a7c0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81b44700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c1582a0 0x7f7a7c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 -- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c1582a0 msgr2=0x7f7a7c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c1582a0 0x7f7a7c158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:26.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 -- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a7c149110 msgr2=0x7f7a7c0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:26.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a7c149110 0x7f7a7c0b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:26.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 -- 172.21.15.123:0/1337173090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0b3bd0 con 0x7f7a68003a50 2023-07-21T19:09:26.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81b44700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c1582a0 0x7f7a7c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:26.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a81343700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a7c0b1050 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7a78001dd0 tx=0x7f7a78001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:26.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a780055a0 con 0x7f7a68003a50 2023-07-21T19:09:26.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a78007240 con 0x7f7a68003a50 2023-07-21T19:09:26.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c0b3eb0 con 0x7f7a68003a50 2023-07-21T19:09:26.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a780075d0 con 0x7f7a68003a50 2023-07-21T19:09:26.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.142+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0b4470 con 0x7f7a68003a50 2023-07-21T19:09:26.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.146+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c04dcb0 con 0x7f7a68003a50 2023-07-21T19:09:26.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.146+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a780036a0 con 0x7f7a68003a50 2023-07-21T19:09:26.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.146+0000 7f7a71ffb700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7a60066320 0x7f7a600687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:26.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.146+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7a78084a70 con 0x7f7a68003a50 2023-07-21T19:09:26.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.146+0000 7f7a80b42700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7a60066320 0x7f7a600687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:26.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.150+0000 7f7a80b42700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7a60066320 0x7f7a600687d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c1573f0 tx=0x7f7a6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:26.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.154+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7a78052210 con 0x7f7a68003a50 2023-07-21T19:09:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:26.330+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7a7c06da70 con 0x7f7a68003a50 2023-07-21T19:09:27.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.122+0000 7f7a71ffb700 1 -- 172.21.15.123:0/1337173090 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a780170b0 con 0x7f7a68003a50 2023-07-21T19:09:27.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.126+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7a60066320 msgr2=0x7f7a600687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.126+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7a60066320 0x7f7a600687d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c1573f0 tx=0x7f7a6c008040 comp rx=0 tx=0).stop 2023-07-21T19:09:27.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.126+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 msgr2=0x7f7a7c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.126+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a7c0b1050 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7a78001dd0 tx=0x7f7a78001120 comp rx=0 tx=0).stop 2023-07-21T19:09:27.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 shutdown_connections 2023-07-21T19:09:27.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f7a60066320 0x7f7a600687d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:27.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a7c149110 0x7f7a7c0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:27.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a7c1582a0 0x7f7a7c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:27.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 --2- 172.21.15.123:0/1337173090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68003a50 0x7f7a7c0b1050 secure :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7a78001dd0 tx=0x7f7a78001120 comp rx=0 tx=0).stop 2023-07-21T19:09:27.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 >> 172.21.15.123:0/1337173090 conn(0x7f7a7c069800 msgr2=0x7f7a7c15eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 shutdown_connections 2023-07-21T19:09:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.130+0000 7f7a835a7700 1 -- 172.21.15.123:0/1337173090 wait complete. 2023-07-21T19:09:27.149 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2023-07-21T19:09:27.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T19:09:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.342+0000 7f78c09c3700 1 Processor -- start 2023-07-21T19:09:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.342+0000 7f78c09c3700 1 -- start start 2023-07-21T19:09:27.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78c09c3700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f78bc1459c0 0x7f78bc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:27.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78c09c3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc145d90 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78c09c3700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0cd650 con 0x7f78bc0d0860 2023-07-21T19:09:27.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78c09c3700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0cd930 con 0x7f78bc1459c0 2023-07-21T19:09:27.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78baffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f78bc0ccbd0 0x7f78bc0d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60164/0 (socket says 172.21.15.123:60164) 2023-07-21T19:09:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78baffd700 1 -- 172.21.15.123:0/1986054652 learned_addr learned my addr 172.21.15.123:0/1986054652 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78bb7fe700 1 --2- 172.21.15.123:0/1986054652 >> v2:172.21.15.145:3300/0 conn(0x7f78bc1459c0 0x7f78bc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839411604 0 0) 0x7f78bc145d90 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a40035d0 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166521340 0 0) 0x7f78bc0cd650 con 0x7f78bc0d0860 2023-07-21T19:09:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc145d90 con 0x7f78bc0d0860 2023-07-21T19:09:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78bb7fe700 1 -- 172.21.15.123:0/1986054652 >> v1:172.21.15.145:6789/0 conn(0x7f78bc0d0860 legacy=0x7f78bc0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78bb7fe700 1 -- 172.21.15.123:0/1986054652 >> v1:172.21.15.123:6789/0 conn(0x7f78bc0ccbd0 legacy=0x7f78bc0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.346+0000 7f78bb7fe700 1 -- 172.21.15.123:0/1986054652 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0cdc10 con 0x7f78bc1459c0 2023-07-21T19:09:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78bb7fe700 1 --2- 172.21.15.123:0/1986054652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0ce6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009840 tx=0x7f78ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2e217cd47a8fb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac005e50 con 0x7f78bc1459c0 2023-07-21T19:09:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac006030 con 0x7f78bc1459c0 2023-07-21T19:09:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78ba7fc700 1 -- 172.21.15.123:0/1986054652 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0063c0 con 0x7f78bc1459c0 2023-07-21T19:09:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 -- 172.21.15.123:0/1986054652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 msgr2=0x7f78bc0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 --2- 172.21.15.123:0/1986054652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0ce6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009840 tx=0x7f78ac009b50 comp rx=0 tx=0).stop 2023-07-21T19:09:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 -- 172.21.15.123:0/1986054652 shutdown_connections 2023-07-21T19:09:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 --2- 172.21.15.123:0/1986054652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0ce6f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 -- 172.21.15.123:0/1986054652 >> 172.21.15.123:0/1986054652 conn(0x7f78bc060c40 msgr2=0x7f78bc09b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 -- 172.21.15.123:0/1986054652 shutdown_connections 2023-07-21T19:09:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.350+0000 7f78c09c3700 1 -- 172.21.15.123:0/1986054652 wait complete. 2023-07-21T19:09:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 Processor -- start 2023-07-21T19:09:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 -- start start 2023-07-21T19:09:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 0x7f78bc0cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78bc0d0860 0x7f78bc1f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0c66c0 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15ae00 con 0x7f78bc1459c0 2023-07-21T19:09:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.354+0000 7f78c09c3700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15b0e0 con 0x7f78bc0d0860 2023-07-21T19:09:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 0x7f78bc0cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 0x7f78bc0cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42922/0 (socket says 172.21.15.123:42922) 2023-07-21T19:09:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 -- 172.21.15.123:0/3672613551 learned_addr learned my addr 172.21.15.123:0/3672613551 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78baffd700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78bc0d0860 0x7f78bc1f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bbfff700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 -- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78bc0d0860 msgr2=0x7f78bc1f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78bc0d0860 0x7f78bc1f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 -- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 msgr2=0x7f78bc0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 -- 172.21.15.123:0/3672613551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009450 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78bb7fe700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 0x7f78bc0cbe10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f78ac013040 tx=0x7f78ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:27.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac006810 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac020070 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc0c6070 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac025670 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.358+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc0cc350 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.362+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc04e500 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.362+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78ac022030 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.366+0000 7f78a3fff700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78a8066320 0x7f78a80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:27.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.366+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f78ac0850b0 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.366+0000 7f78baffd700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78a8066320 0x7f78a80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:27.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.366+0000 7f78baffd700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78a8066320 0x7f78a80687d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0cb980 tx=0x7f78b0007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:27.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.370+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f78ac0526e0 con 0x7f78bc0ccbd0 2023-07-21T19:09:27.557 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:27.542+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f78bc070740 con 0x7f78bc0ccbd0 2023-07-21T19:09:28.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.146+0000 7f78a3fff700 1 -- 172.21.15.123:0/3672613551 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f78ac006970 con 0x7f78bc0ccbd0 2023-07-21T19:09:28.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78a8066320 msgr2=0x7f78a80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:28.168 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78a8066320 0x7f78a80687d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0cb980 tx=0x7f78b0007e20 comp rx=0 tx=0).stop 2023-07-21T19:09:28.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 msgr2=0x7f78bc0cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:28.169 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 0x7f78bc0cbe10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f78ac013040 tx=0x7f78ac004770 comp rx=0 tx=0).stop 2023-07-21T19:09:28.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 shutdown_connections 2023-07-21T19:09:28.170 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f78a8066320 0x7f78a80687d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78bc1459c0 0x7f78bc0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78bc0d0860 0x7f78bc1f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 --2- 172.21.15.123:0/3672613551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78bc0ccbd0 0x7f78bc0cbe10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.154+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 >> 172.21.15.123:0/3672613551 conn(0x7f78bc060c40 msgr2=0x7f78bc0d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:28.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.158+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 shutdown_connections 2023-07-21T19:09:28.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.162+0000 7f78c09c3700 1 -- 172.21.15.123:0/3672613551 wait complete. 2023-07-21T19:09:28.183 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2023-07-21T19:09:28.200 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T19:09:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.358+0000 7f859a02f700 1 Processor -- start 2023-07-21T19:09:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.358+0000 7f859a02f700 1 -- start start 2023-07-21T19:09:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859a02f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f859406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859a02f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85940cd7f0 0x7f85940c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:28.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859a02f700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940cdfb0 con 0x7f8594160000 2023-07-21T19:09:28.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859a02f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8594070e40 con 0x7f85940cd7f0 2023-07-21T19:09:28.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859a02f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940cdcd0 con 0x7f85941603d0 2023-07-21T19:09:28.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85940cd7f0 0x7f85940c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:28.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85940cd7f0 0x7f85940c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42938/0 (socket says 172.21.15.123:42938) 2023-07-21T19:09:28.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 -- 172.21.15.123:0/3246006951 learned_addr learned my addr 172.21.15.123:0/3246006951 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859882c700 1 --2- 172.21.15.123:0/3246006951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f859406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 -- 172.21.15.123:0/3246006951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 msgr2=0x7f859406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 --2- 172.21.15.123:0/3246006951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f859406dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 -- 172.21.15.123:0/3246006951 >> v1:172.21.15.145:6789/0 conn(0x7f8594160000 legacy=0x7f85940c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 -- 172.21.15.123:0/3246006951 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594070780 con 0x7f85940cd7f0 2023-07-21T19:09:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f859982e700 1 --2- 172.21.15.123:0/3246006951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f85940c0d50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f858c009e50 tx=0x7f858c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc36302542503ba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:28.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f858bfff700 1 -- 172.21.15.123:0/3246006951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00e070 con 0x7f85940cd7f0 2023-07-21T19:09:28.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f858bfff700 1 -- 172.21.15.123:0/3246006951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00b9c0 con 0x7f85940cd7f0 2023-07-21T19:09:28.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.362+0000 7f858bfff700 1 -- 172.21.15.123:0/3246006951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00bd70 con 0x7f85940cd7f0 2023-07-21T19:09:28.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 -- 172.21.15.123:0/3246006951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 msgr2=0x7f85940c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:28.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 --2- 172.21.15.123:0/3246006951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f85940c0d50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f858c009e50 tx=0x7f858c00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:28.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 -- 172.21.15.123:0/3246006951 shutdown_connections 2023-07-21T19:09:28.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 --2- 172.21.15.123:0/3246006951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f85940c0d50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 --2- 172.21.15.123:0/3246006951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f859406dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 -- 172.21.15.123:0/3246006951 >> 172.21.15.123:0/3246006951 conn(0x7f85940afc60 msgr2=0x7f85940b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:28.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 -- 172.21.15.123:0/3246006951 shutdown_connections 2023-07-21T19:09:28.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.366+0000 7f859a02f700 1 -- 172.21.15.123:0/3246006951 wait complete. 2023-07-21T19:09:28.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 Processor -- start 2023-07-21T19:09:28.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 -- start start 2023-07-21T19:09:28.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f8594152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:28.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8594160000 0x7f85940c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:28.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f85940aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c6340 con 0x7f85940cd7f0 2023-07-21T19:09:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c6590 con 0x7f8594160000 2023-07-21T19:09:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859a02f700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c6870 con 0x7f85941603d0 2023-07-21T19:09:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f8594152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f8594152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42944/0 (socket says 172.21.15.123:42944) 2023-07-21T19:09:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 -- 172.21.15.123:0/1650201984 learned_addr learned my addr 172.21.15.123:0/1650201984 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859882c700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8594160000 0x7f85940c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859982e700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f85940aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 -- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 msgr2=0x7f85940aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f85940aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 -- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8594160000 msgr2=0x7f85940c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8594160000 0x7f85940c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859902d700 1 -- 172.21.15.123:0/1650201984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c009b30 con 0x7f85940cd7f0 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.370+0000 7f859982e700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f85940aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f859902d700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f8594152ee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f859000c500 tx=0x7f859000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900052d0 con 0x7f85940cd7f0 2023-07-21T19:09:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590005430 con 0x7f85940cd7f0 2023-07-21T19:09:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940c6b50 con 0x7f85940cd7f0 2023-07-21T19:09:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900055a0 con 0x7f85940cd7f0 2023-07-21T19:09:28.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940c7ff0 con 0x7f85940cd7f0 2023-07-21T19:09:28.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.374+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85940c7070 con 0x7f85940cd7f0 2023-07-21T19:09:28.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.378+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85900038e0 con 0x7f85940cd7f0 2023-07-21T19:09:28.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.378+0000 7f8589ffb700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f85780662f0 0x7f85780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.378+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f8590083150 con 0x7f85940cd7f0 2023-07-21T19:09:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.378+0000 7f859882c700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f85780662f0 0x7f85780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.382+0000 7f859882c700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f85780662f0 0x7f85780687a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85940c7870 tx=0x7f8584008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:28.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.386+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f85940c7070 con 0x7f85940cd7f0 2023-07-21T19:09:28.606 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:28.590+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f85940ce780 con 0x7f85940cd7f0 2023-07-21T19:09:29.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.146+0000 7f8589ffb700 1 -- 172.21.15.123:0/1650201984 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f85940ce780 con 0x7f85940cd7f0 2023-07-21T19:09:29.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.162+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f85780662f0 msgr2=0x7f85780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.162+0000 7f859a02f700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f85780662f0 0x7f85780687a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85940c7870 tx=0x7f8584008040 comp rx=0 tx=0).stop 2023-07-21T19:09:29.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.166+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 msgr2=0x7f8594152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.166+0000 7f859a02f700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f8594152ee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f859000c500 tx=0x7f859000c810 comp rx=0 tx=0).stop 2023-07-21T19:09:29.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.170+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 shutdown_connections 2023-07-21T19:09:29.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.170+0000 7f859a02f700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f85780662f0 0x7f85780687a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.178+0000 7f859a02f700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8594160000 0x7f85940c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.178+0000 7f859a02f700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85941603d0 0x7f85940aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.178+0000 7f859a02f700 1 --2- 172.21.15.123:0/1650201984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85940cd7f0 0x7f8594152ee0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.178+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 >> 172.21.15.123:0/1650201984 conn(0x7f85940afc60 msgr2=0x7f859415e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:29.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.178+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 shutdown_connections 2023-07-21T19:09:29.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.182+0000 7f859a02f700 1 -- 172.21.15.123:0/1650201984 wait complete. 2023-07-21T19:09:29.199 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 6 and data pool 7 2023-07-21T19:09:29.218 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:29.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.366+0000 7fecca66b700 1 Processor -- start 2023-07-21T19:09:29.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecca66b700 1 -- start start 2023-07-21T19:09:29.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecca66b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecca66b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40ca8a0 con 0x7fecc415ffa0 2023-07-21T19:09:29.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecca66b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40cbcd0 con 0x7fecc4160370 2023-07-21T19:09:29.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecca66b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40cbf70 con 0x7fecc40cb180 2023-07-21T19:09:29.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecc9669700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fecc415ffa0 0x7fecc406d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60176/0 (socket says 172.21.15.123:60176) 2023-07-21T19:09:29.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecc9669700 1 -- 172.21.15.123:0/2104447402 learned_addr learned my addr 172.21.15.123:0/2104447402 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:29.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecc9e6a700 1 --2- 172.21.15.123:0/2104447402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836724874 0 0) 0x7fecc0001110 con 0x7fecc415ffa0 2023-07-21T19:09:29.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb00035d0 con 0x7fecc415ffa0 2023-07-21T19:09:29.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386888630 0 0) 0x7fecc40cbcd0 con 0x7fecc4160370 2023-07-21T19:09:29.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc0001110 con 0x7fecc4160370 2023-07-21T19:09:29.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecc9e6a700 1 -- 172.21.15.123:0/2104447402 >> v1:172.21.15.145:6789/0 conn(0x7fecc4160370 legacy=0x7fecc40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecc9e6a700 1 -- 172.21.15.123:0/2104447402 >> v1:172.21.15.123:6789/0 conn(0x7fecc415ffa0 legacy=0x7fecc406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.370+0000 7fecc9e6a700 1 -- 172.21.15.123:0/2104447402 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40cc250 con 0x7fecc40cb180 2023-07-21T19:09:29.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecc9e6a700 1 --2- 172.21.15.123:0/2104447402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40ce340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009dc0 tx=0x7fecbc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ccd0259bb7821ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:29.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00e070 con 0x7fecc40cb180 2023-07-21T19:09:29.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00bb20 con 0x7fecc40cb180 2023-07-21T19:09:29.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecbbfff700 1 -- 172.21.15.123:0/2104447402 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc012430 con 0x7fecc40cb180 2023-07-21T19:09:29.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 -- 172.21.15.123:0/2104447402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 msgr2=0x7fecc40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 --2- 172.21.15.123:0/2104447402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40ce340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009dc0 tx=0x7fecbc00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:29.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 -- 172.21.15.123:0/2104447402 shutdown_connections 2023-07-21T19:09:29.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 --2- 172.21.15.123:0/2104447402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40ce340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 -- 172.21.15.123:0/2104447402 >> 172.21.15.123:0/2104447402 conn(0x7fecc406e960 msgr2=0x7fecc406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:29.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 -- 172.21.15.123:0/2104447402 shutdown_connections 2023-07-21T19:09:29.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.374+0000 7fecca66b700 1 -- 172.21.15.123:0/2104447402 wait complete. 2023-07-21T19:09:29.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 Processor -- start 2023-07-21T19:09:29.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 -- start start 2023-07-21T19:09:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 0x7fecc414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fecc4160370 0x7fecc40c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c3d40 con 0x7fecc415ffa0 2023-07-21T19:09:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c83f0 con 0x7fecc4160370 2023-07-21T19:09:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecca66b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc415ce80 con 0x7fecc40cb180 2023-07-21T19:09:29.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 0x7fecc414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 0x7fecc414f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42948/0 (socket says 172.21.15.123:42948) 2023-07-21T19:09:29.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 -- 172.21.15.123:0/1448815720 learned_addr learned my addr 172.21.15.123:0/1448815720 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc9669700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc9e6a700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fecc4160370 0x7fecc40c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 -- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 msgr2=0x7fecc40c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 -- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fecc4160370 msgr2=0x7fecc40c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fecc4160370 0x7fecc40c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.378+0000 7fecc8e68700 1 -- 172.21.15.123:0/1448815720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009a70 con 0x7fecc415ffa0 2023-07-21T19:09:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecc8e68700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 0x7fecc414f580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fecb400c500 tx=0x7fecb400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb40052d0 con 0x7fecc415ffa0 2023-07-21T19:09:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4005450 con 0x7fecc415ffa0 2023-07-21T19:09:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc40c3130 con 0x7fecc415ffa0 2023-07-21T19:09:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb40038e0 con 0x7fecc415ffa0 2023-07-21T19:09:29.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc40c36f0 con 0x7fecc415ffa0 2023-07-21T19:09:29.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc40c3ef0 con 0x7fecc415ffa0 2023-07-21T19:09:29.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.382+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fecb4003a40 con 0x7fecc415ffa0 2023-07-21T19:09:29.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.386+0000 7fecb9ffb700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feca80662f0 0x7feca80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.386+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fecb4083240 con 0x7fecc415ffa0 2023-07-21T19:09:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.386+0000 7fecc9669700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feca80662f0 0x7feca80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.386+0000 7fecc9669700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feca80662f0 0x7feca80687a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:29.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.394+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fecc40c3ef0 con 0x7fecc415ffa0 2023-07-21T19:09:29.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.566+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecc404e500 con 0x7fecc415ffa0 2023-07-21T19:09:29.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.566+0000 7fecb9ffb700 1 -- 172.21.15.123:0/1448815720 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18573 (secure 0 0 0) 0x7fecb40504e0 con 0x7fecc415ffa0 2023-07-21T19:09:29.583 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:29.583 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":42,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:09:28.598027+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:09:26.398083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T19:09:27.611205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feca80662f0 msgr2=0x7feca80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feca80662f0 0x7feca80687a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc0007de0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 msgr2=0x7fecc414f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 0x7fecc414f580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fecb400c500 tx=0x7fecb400c810 comp rx=0 tx=0).stop 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 shutdown_connections 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7feca80662f0 0x7feca80687a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fecc4160370 0x7fecc40c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecc415ffa0 0x7fecc414f580 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 --2- 172.21.15.123:0/1448815720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fecc40cb180 0x7fecc40c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 >> 172.21.15.123:0/1448815720 conn(0x7fecc406e960 msgr2=0x7fecc40caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 shutdown_connections 2023-07-21T19:09:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.570+0000 7fecca66b700 1 -- 172.21.15.123:0/1448815720 wait complete. 2023-07-21T19:09:29.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:29.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 Processor -- start 2023-07-21T19:09:29.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 -- start start 2023-07-21T19:09:29.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680cd240 0x7f8d680ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d680ceff0 0x7f8d680afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d680af0a0 con 0x7f8d6815bff0 2023-07-21T19:09:29.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680cf470 con 0x7f8d680ceff0 2023-07-21T19:09:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6759e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680cf720 con 0x7f8d680cd240 2023-07-21T19:09:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6659c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8d6815bff0 0x7f8d680ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60178/0 (socket says 172.21.15.123:60178) 2023-07-21T19:09:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.762+0000 7f8d6659c700 1 -- 172.21.15.123:0/1637814793 learned_addr learned my addr 172.21.15.123:0/1637814793 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d66d9d700 1 --2- 172.21.15.123:0/1637814793 >> v2:172.21.15.123:3300/0 conn(0x7f8d680ceff0 0x7f8d680afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d5ffff700 1 --2- 172.21.15.123:0/1637814793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680cd240 0x7f8d680ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d65d9b700 1 -- 172.21.15.123:0/1637814793 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961858170 0 0) 0x7f8d680af0a0 con 0x7f8d6815bff0 2023-07-21T19:09:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d65d9b700 1 -- 172.21.15.123:0/1637814793 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d540035d0 con 0x7f8d6815bff0 2023-07-21T19:09:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d65d9b700 1 -- 172.21.15.123:0/1637814793 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494817748 0 0) 0x7f8d540035d0 con 0x7f8d6815bff0 2023-07-21T19:09:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d66d9d700 1 -- 172.21.15.123:0/1637814793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680cd240 msgr2=0x7f8d680ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d66d9d700 1 --2- 172.21.15.123:0/1637814793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680cd240 0x7f8d680ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d66d9d700 1 -- 172.21.15.123:0/1637814793 >> v1:172.21.15.123:6789/0 conn(0x7f8d6815bff0 legacy=0x7f8d680ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d66d9d700 1 -- 172.21.15.123:0/1637814793 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680af2f0 con 0x7f8d680ceff0 2023-07-21T19:09:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d66d9d700 1 --2- 172.21.15.123:0/1637814793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d680ceff0 0x7f8d680afdd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485c817e4102393e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d65d9b700 1 -- 172.21.15.123:0/1637814793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000e070 con 0x7f8d680ceff0 2023-07-21T19:09:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d65d9b700 1 -- 172.21.15.123:0/1637814793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60003a40 con 0x7f8d680ceff0 2023-07-21T19:09:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d65d9b700 1 -- 172.21.15.123:0/1637814793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58001670 con 0x7f8d680ceff0 2023-07-21T19:09:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 -- 172.21.15.123:0/1637814793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d680ceff0 msgr2=0x7f8d680afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 --2- 172.21.15.123:0/1637814793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d680ceff0 0x7f8d680afdd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d6000b330 comp rx=0 tx=0).stop 2023-07-21T19:09:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 -- 172.21.15.123:0/1637814793 shutdown_connections 2023-07-21T19:09:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 --2- 172.21.15.123:0/1637814793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d680ceff0 0x7f8d680afdd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 --2- 172.21.15.123:0/1637814793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680cd240 0x7f8d680ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 -- 172.21.15.123:0/1637814793 >> 172.21.15.123:0/1637814793 conn(0x7f8d68060c40 msgr2=0x7f8d6809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 -- 172.21.15.123:0/1637814793 shutdown_connections 2023-07-21T19:09:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.766+0000 7f8d6759e700 1 -- 172.21.15.123:0/1637814793 wait complete. 2023-07-21T19:09:29.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.770+0000 7f8d6759e700 1 Processor -- start 2023-07-21T19:09:29.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.770+0000 7f8d6759e700 1 -- start start 2023-07-21T19:09:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d680cd240 0x7f8d680c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680ceff0 0x7f8d68158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 0x7f8d6815df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681587a0 con 0x7f8d6815bff0 2023-07-21T19:09:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680ca610 con 0x7f8d680cd240 2023-07-21T19:09:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680ca8f0 con 0x7f8d680ceff0 2023-07-21T19:09:29.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 0x7f8d6815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 0x7f8d6815df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42974/0 (socket says 172.21.15.123:42974) 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 -- 172.21.15.123:0/3923290967 learned_addr learned my addr 172.21.15.123:0/3923290967 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d5ffff700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680ceff0 0x7f8d68158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6659c700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d680cd240 0x7f8d680c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 -- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680ceff0 msgr2=0x7f8d68158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680ceff0 0x7f8d68158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 -- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d680cd240 msgr2=0x7f8d680c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d680cd240 0x7f8d680c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 -- 172.21.15.123:0/3923290967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60009a70 con 0x7f8d6815bff0 2023-07-21T19:09:29.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d66d9d700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 0x7f8d6815df50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8d680b50d0 tx=0x7f8d60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:29.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60009410 con 0x7f8d6815bff0 2023-07-21T19:09:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d600044e0 con 0x7f8d6815bff0 2023-07-21T19:09:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d680cabd0 con 0x7f8d6815bff0 2023-07-21T19:09:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60004890 con 0x7f8d6815bff0 2023-07-21T19:09:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.774+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d680cb190 con 0x7f8d6815bff0 2023-07-21T19:09:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.778+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6804e500 con 0x7f8d6815bff0 2023-07-21T19:09:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.778+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d60012430 con 0x7f8d6815bff0 2023-07-21T19:09:29.794 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.782+0000 7f8d5effd700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8d480662f0 0x7f8d480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:29.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.782+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8d60085d00 con 0x7f8d6815bff0 2023-07-21T19:09:29.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.782+0000 7f8d6659c700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8d480662f0 0x7f8d480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.782+0000 7f8d6659c700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8d480662f0 0x7f8d480687a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d580011e0 tx=0x7f8d58007bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:29.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.786+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8d60053050 con 0x7f8d6815bff0 2023-07-21T19:09:29.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.962+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d680d1620 con 0x7f8d6815bff0 2023-07-21T19:09:29.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.962+0000 7f8d5effd700 1 -- 172.21.15.123:0/3923290967 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18573 (secure 0 0 0) 0x7f8d60056670 con 0x7f8d6815bff0 2023-07-21T19:09:29.978 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:29.978 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":42,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:09:28.598027+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:09:26.398083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T19:09:27.611205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:29.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8d480662f0 msgr2=0x7f8d480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8d480662f0 0x7f8d480687a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d580011e0 tx=0x7f8d58007bc0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 msgr2=0x7f8d6815df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:29.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 0x7f8d6815df50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8d680b50d0 tx=0x7f8d60004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 shutdown_connections 2023-07-21T19:09:29.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f8d480662f0 0x7f8d480687a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d6815bff0 0x7f8d6815df50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d680ceff0 0x7f8d68158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 --2- 172.21.15.123:0/3923290967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d680cd240 0x7f8d680c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:29.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 >> 172.21.15.123:0/3923290967 conn(0x7f8d68060c40 msgr2=0x7f8d680afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:29.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 shutdown_connections 2023-07-21T19:09:29.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:29.966+0000 7f8d6759e700 1 -- 172.21.15.123:0/3923290967 wait complete. 2023-07-21T19:09:30.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T19:09:30.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.166+0000 7f4c951ae700 1 Processor -- start 2023-07-21T19:09:30.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.166+0000 7f4c951ae700 1 -- start start 2023-07-21T19:09:30.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c951ae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c9015df10 0x7f4c9015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:30.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c951ae700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c900afd80 0x7f4c900711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:30.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c951ae700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c90070a30 con 0x7f4c900716e0 2023-07-21T19:09:30.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c951ae700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9015e830 con 0x7f4c900afd80 2023-07-21T19:09:30.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c951ae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b0210 con 0x7f4c9015df10 2023-07-21T19:09:30.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c900afd80 0x7f4c900711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:30.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8f59e700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f4c900716e0 0x7f4c900c8950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.123:53260/0 (socket says 172.21.15.123:53260) 2023-07-21T19:09:30.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c900afd80 0x7f4c900711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:56722/0 (socket says 172.21.15.123:56722) 2023-07-21T19:09:30.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8f59e700 1 -- 172.21.15.123:0/1739867453 learned_addr learned my addr 172.21.15.123:0/1739867453 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:30.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8ed9d700 1 --2- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c9015df10 0x7f4c9015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:30.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 -- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c9015df10 msgr2=0x7f4c9015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:30.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 --2- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c9015df10 0x7f4c9015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:30.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 -- 172.21.15.123:0/1739867453 >> v1:172.21.15.145:6789/0 conn(0x7f4c900716e0 legacy=0x7f4c900c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:30.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 -- 172.21.15.123:0/1739867453 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900b04f0 con 0x7f4c900afd80 2023-07-21T19:09:30.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8e59c700 1 --2- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900afd80 0x7f4c900711a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009850 tx=0x7f4c84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b17b79197cc3aa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:30.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8dd9b700 1 -- 172.21.15.123:0/1739867453 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84011830 con 0x7f4c900afd80 2023-07-21T19:09:30.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8dd9b700 1 -- 172.21.15.123:0/1739867453 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84011990 con 0x7f4c900afd80 2023-07-21T19:09:30.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.170+0000 7f4c8dd9b700 1 -- 172.21.15.123:0/1739867453 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84011d40 con 0x7f4c900afd80 2023-07-21T19:09:30.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 -- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900afd80 msgr2=0x7f4c900711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:30.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 --2- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900afd80 0x7f4c900711a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009850 tx=0x7f4c84009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:30.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 -- 172.21.15.123:0/1739867453 shutdown_connections 2023-07-21T19:09:30.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 --2- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900afd80 0x7f4c900711a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:30.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 --2- 172.21.15.123:0/1739867453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c9015df10 0x7f4c9015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:30.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 -- 172.21.15.123:0/1739867453 >> 172.21.15.123:0/1739867453 conn(0x7f4c900cad80 msgr2=0x7f4c900cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:30.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 -- 172.21.15.123:0/1739867453 shutdown_connections 2023-07-21T19:09:30.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.174+0000 7f4c951ae700 1 -- 172.21.15.123:0/1739867453 wait complete. 2023-07-21T19:09:30.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 Processor -- start 2023-07-21T19:09:30.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 -- start start 2023-07-21T19:09:30.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900716e0 0x7f4c900b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:30.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c900afd80 0x7f4c900cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:30.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 0x7f4c9015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:30.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c90154e40 con 0x7f4c900cbed0 2023-07-21T19:09:30.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b1b30 con 0x7f4c900716e0 2023-07-21T19:09:30.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b1e10 con 0x7f4c900afd80 2023-07-21T19:09:30.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 0x7f4c9015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:30.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 0x7f4c9015a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42984/0 (socket says 172.21.15.123:42984) 2023-07-21T19:09:30.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 -- 172.21.15.123:0/3961384941 learned_addr learned my addr 172.21.15.123:0/3961384941 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8e59c700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c900afd80 0x7f4c900cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8ed9d700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900716e0 0x7f4c900b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 -- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c900afd80 msgr2=0x7f4c900cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c900afd80 0x7f4c900cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 -- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900716e0 msgr2=0x7f4c900b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900716e0 0x7f4c900b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:30.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 -- 172.21.15.123:0/3961384941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c840094b0 con 0x7f4c900cbed0 2023-07-21T19:09:30.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c8f59e700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 0x7f4c9015a100 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800cbc0 tx=0x7f4c8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:30.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88007480 con 0x7f4c900cbed0 2023-07-21T19:09:30.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c880075e0 con 0x7f4c900cbed0 2023-07-21T19:09:30.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900b20f0 con 0x7f4c900cbed0 2023-07-21T19:09:30.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88007950 con 0x7f4c900cbed0 2023-07-21T19:09:30.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.178+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c900b26b0 con 0x7f4c900cbed0 2023-07-21T19:09:30.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.182+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900b28a0 con 0x7f4c900cbed0 2023-07-21T19:09:30.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.182+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c88012400 con 0x7f4c900cbed0 2023-07-21T19:09:30.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.182+0000 7f4c777fe700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4c7c0662f0 0x7f4c7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:30.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.182+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4c88083840 con 0x7f4c900cbed0 2023-07-21T19:09:30.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.182+0000 7f4c8ed9d700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4c7c0662f0 0x7f4c7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:30.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.186+0000 7f4c8ed9d700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4c7c0662f0 0x7f4c7c0687a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009b50 tx=0x7f4c80009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:30.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.190+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4c88050b00 con 0x7f4c900cbed0 2023-07-21T19:09:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:30.398+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c9004dcb0 con 0x7f4c900cbed0 2023-07-21T19:09:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.190+0000 7f4c777fe700 1 -- 172.21.15.123:0/3961384941 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c880170b0 con 0x7f4c900cbed0 2023-07-21T19:09:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.190+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4c7c0662f0 msgr2=0x7f4c7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.190+0000 7f4c951ae700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4c7c0662f0 0x7f4c7c0687a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009b50 tx=0x7f4c80009240 comp rx=0 tx=0).stop 2023-07-21T19:09:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.190+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 msgr2=0x7f4c9015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.190+0000 7f4c951ae700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 0x7f4c9015a100 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800cbc0 tx=0x7f4c8800cbf0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.190+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 shutdown_connections 2023-07-21T19:09:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f4c7c0662f0 0x7f4c7c0687a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c900cbed0 0x7f4c9015a100 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c900afd80 0x7f4c900cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 --2- 172.21.15.123:0/3961384941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c900716e0 0x7f4c900b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 >> 172.21.15.123:0/3961384941 conn(0x7f4c900cad80 msgr2=0x7f4c9015b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:31.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 shutdown_connections 2023-07-21T19:09:31.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.194+0000 7f4c951ae700 1 -- 172.21.15.123:0/3961384941 wait complete. 2023-07-21T19:09:31.230 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T19:09:31.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T19:09:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.398+0000 7f8685240700 1 Processor -- start 2023-07-21T19:09:31.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.398+0000 7f8685240700 1 -- start start 2023-07-21T19:09:31.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8680159c60 0x7f868006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:31.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86800b0770 0x7f8680070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868006da00 con 0x7f86800cab00 2023-07-21T19:09:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868006dce0 con 0x7f86800b0770 2023-07-21T19:09:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868006dfc0 con 0x7f8680159c60 2023-07-21T19:09:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86800b0770 0x7f8680070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86800b0770 0x7f8680070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42996/0 (socket says 172.21.15.123:42996) 2023-07-21T19:09:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 -- 172.21.15.123:0/2737931469 learned_addr learned my addr 172.21.15.123:0/2737931469 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867ffff700 1 --2- 172.21.15.123:0/2737931469 >> v2:172.21.15.145:3300/0 conn(0x7f8680159c60 0x7f868006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 -- 172.21.15.123:0/2737931469 >> v2:172.21.15.145:3300/0 conn(0x7f8680159c60 msgr2=0x7f868006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 --2- 172.21.15.123:0/2737931469 >> v2:172.21.15.145:3300/0 conn(0x7f8680159c60 0x7f868006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 -- 172.21.15.123:0/2737931469 >> v1:172.21.15.145:6789/0 conn(0x7f86800cab00 legacy=0x7f86800c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 -- 172.21.15.123:0/2737931469 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800705e0 con 0x7f86800b0770 2023-07-21T19:09:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867f7fe700 1 --2- 172.21.15.123:0/2737931469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f8680070de0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f868006bbd0 tx=0x7f8674009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557927f5b479cd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867effd700 1 -- 172.21.15.123:0/2737931469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674011830 con 0x7f86800b0770 2023-07-21T19:09:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867effd700 1 -- 172.21.15.123:0/2737931469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674011990 con 0x7f86800b0770 2023-07-21T19:09:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f867effd700 1 -- 172.21.15.123:0/2737931469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674011d20 con 0x7f86800b0770 2023-07-21T19:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 -- 172.21.15.123:0/2737931469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 msgr2=0x7f8680070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.402+0000 7f8685240700 1 --2- 172.21.15.123:0/2737931469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f8680070de0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f868006bbd0 tx=0x7f8674009bf0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 -- 172.21.15.123:0/2737931469 shutdown_connections 2023-07-21T19:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 --2- 172.21.15.123:0/2737931469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f8680070de0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 --2- 172.21.15.123:0/2737931469 >> v2:172.21.15.145:3300/0 conn(0x7f8680159c60 0x7f868006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 -- 172.21.15.123:0/2737931469 >> 172.21.15.123:0/2737931469 conn(0x7f86800afc60 msgr2=0x7f86800b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 -- 172.21.15.123:0/2737931469 shutdown_connections 2023-07-21T19:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 -- 172.21.15.123:0/2737931469 wait complete. 2023-07-21T19:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 Processor -- start 2023-07-21T19:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.406+0000 7f8685240700 1 -- start start 2023-07-21T19:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f86800ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86800cab00 0x7f86800c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8680159c60 0x7f86800c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86800c2ec0 con 0x7f86800b0770 2023-07-21T19:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86800c31a0 con 0x7f86800cab00 2023-07-21T19:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86800c3480 con 0x7f8680159c60 2023-07-21T19:09:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f86800ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f86800ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43010/0 (socket says 172.21.15.123:43010) 2023-07-21T19:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 -- 172.21.15.123:0/3253114879 learned_addr learned my addr 172.21.15.123:0/3253114879 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867f7fe700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86800cab00 0x7f86800c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8684a3f700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8680159c60 0x7f86800c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 -- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8680159c60 msgr2=0x7f86800c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8680159c60 0x7f86800c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 -- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86800cab00 msgr2=0x7f86800c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86800cab00 0x7f86800c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 -- 172.21.15.123:0/3253114879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009570 con 0x7f86800b0770 2023-07-21T19:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867ffff700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f86800ae4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f867000e840 tx=0x7f867000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700095a0 con 0x7f86800b0770 2023-07-21T19:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867000c690 con 0x7f86800b0770 2023-07-21T19:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000ca00 con 0x7f86800b0770 2023-07-21T19:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86800c3760 con 0x7f86800b0770 2023-07-21T19:09:31.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86800aea20 con 0x7f86800b0770 2023-07-21T19:09:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.410+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86800aec10 con 0x7f86800b0770 2023-07-21T19:09:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.414+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f867000cb60 con 0x7f86800b0770 2023-07-21T19:09:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.414+0000 7f867cff9700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f866c0662f0 0x7f866c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.414+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8670083e30 con 0x7f86800b0770 2023-07-21T19:09:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.414+0000 7f867f7fe700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f866c0662f0 0x7f866c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.418+0000 7f867f7fe700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f866c0662f0 0x7f866c0687a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8674000c00 tx=0x7f8674008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:31.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.422+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8670054bf0 con 0x7f86800b0770 2023-07-21T19:09:31.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:31.630+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f868004e500 con 0x7f86800b0770 2023-07-21T19:09:32.110 INFO:tasks.ceph.mds.d.smithi145.stderr:2023-07-21T19:09:32.092+0000 7fb20f215700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T19:09:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.558+0000 7f867cff9700 1 -- 172.21.15.123:0/3253114879 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86700170c0 con 0x7f86800b0770 2023-07-21T19:09:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f866c0662f0 msgr2=0x7f866c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f866c0662f0 0x7f866c0687a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8674000c00 tx=0x7f8674008030 comp rx=0 tx=0).stop 2023-07-21T19:09:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 msgr2=0x7f86800ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f86800ae4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f867000e840 tx=0x7f867000ec00 comp rx=0 tx=0).stop 2023-07-21T19:09:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 shutdown_connections 2023-07-21T19:09:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f866c0662f0 0x7f866c0687a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86800cab00 0x7f86800c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8680159c60 0x7f86800c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 --2- 172.21.15.123:0/3253114879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86800b0770 0x7f86800ae4e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 >> 172.21.15.123:0/3253114879 conn(0x7f86800afc60 msgr2=0x7f86800ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 shutdown_connections 2023-07-21T19:09:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.562+0000 7f8685240700 1 -- 172.21.15.123:0/3253114879 wait complete. 2023-07-21T19:09:32.597 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T19:09:32.597 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:09:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 Processor -- start 2023-07-21T19:09:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 -- start start 2023-07-21T19:09:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc198071000 0x7fc19815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc1980caa20 0x7fc1980cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19815d230 con 0x7fc1981599d0 2023-07-21T19:09:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1980cde10 con 0x7fc1980caa20 2023-07-21T19:09:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.758+0000 7fc19d83e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1980cb380 con 0x7fc198071000 2023-07-21T19:09:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1977fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc1980caa20 0x7fc1980cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc196ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc1981599d0 0x7fc1980c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52094/0 (socket says 172.21.15.123:52094) 2023-07-21T19:09:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc196ffd700 1 -- 172.21.15.123:0/2554299771 learned_addr learned my addr 172.21.15.123:0/2554299771 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc18e7fc700 1 --2- 172.21.15.123:0/2554299771 >> v2:172.21.15.145:3300/0 conn(0x7fc198071000 0x7fc19815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1977fe700 1 -- 172.21.15.123:0/2554299771 >> v2:172.21.15.145:3300/0 conn(0x7fc198071000 msgr2=0x7fc19815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1977fe700 1 --2- 172.21.15.123:0/2554299771 >> v2:172.21.15.145:3300/0 conn(0x7fc198071000 0x7fc19815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1977fe700 1 -- 172.21.15.123:0/2554299771 >> v1:172.21.15.123:6789/0 conn(0x7fc1981599d0 legacy=0x7fc1980c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1977fe700 1 -- 172.21.15.123:0/2554299771 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1980cd520 con 0x7fc1980caa20 2023-07-21T19:09:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1967fc700 1 -- 172.21.15.123:0/2554299771 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572341965 0 0) 0x7fc19815d230 con 0x7fc1981599d0 2023-07-21T19:09:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1977fe700 1 --2- 172.21.15.123:0/2554299771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980cae40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc19806aa70 tx=0x7fc190009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15961e8e0f07d6d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1967fc700 1 -- 172.21.15.123:0/2554299771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190011830 con 0x7fc1980caa20 2023-07-21T19:09:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1967fc700 1 -- 172.21.15.123:0/2554299771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190011990 con 0x7fc1980caa20 2023-07-21T19:09:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc1967fc700 1 -- 172.21.15.123:0/2554299771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190011d20 con 0x7fc1980caa20 2023-07-21T19:09:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 -- 172.21.15.123:0/2554299771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 msgr2=0x7fc1980cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 --2- 172.21.15.123:0/2554299771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980cae40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc19806aa70 tx=0x7fc190009b30 comp rx=0 tx=0).stop 2023-07-21T19:09:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 -- 172.21.15.123:0/2554299771 shutdown_connections 2023-07-21T19:09:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 --2- 172.21.15.123:0/2554299771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980cae40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 --2- 172.21.15.123:0/2554299771 >> v2:172.21.15.145:3300/0 conn(0x7fc198071000 0x7fc19815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 -- 172.21.15.123:0/2554299771 >> 172.21.15.123:0/2554299771 conn(0x7fc19806e960 msgr2=0x7fc19806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 -- 172.21.15.123:0/2554299771 shutdown_connections 2023-07-21T19:09:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.762+0000 7fc19d83e700 1 -- 172.21.15.123:0/2554299771 wait complete. 2023-07-21T19:09:32.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.766+0000 7fc19d83e700 1 Processor -- start 2023-07-21T19:09:32.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 -- start start 2023-07-21T19:09:32.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc198071000 0x7fc1980b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:32.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:32.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1981599d0 0x7fc1980b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:32.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980b3110 con 0x7fc1980caa20 2023-07-21T19:09:32.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980b18e0 con 0x7fc1981599d0 2023-07-21T19:09:32.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc19d83e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980b0090 con 0x7fc198071000 2023-07-21T19:09:32.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:32.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47414/0 (socket says 172.21.15.123:47414) 2023-07-21T19:09:32.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 -- 172.21.15.123:0/4065404244 learned_addr learned my addr 172.21.15.123:0/4065404244 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:32.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc1977fe700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1981599d0 0x7fc1980b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc196ffd700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc198071000 0x7fc1980b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 -- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc198071000 msgr2=0x7fc1980b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc198071000 0x7fc1980b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 -- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1981599d0 msgr2=0x7fc1980b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1981599d0 0x7fc1980b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 -- 172.21.15.123:0/4065404244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900094b0 con 0x7fc1980caa20 2023-07-21T19:09:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc18e7fc700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980b0360 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc18000e840 tx=0x7fc18000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.770+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800095a0 con 0x7fc1980caa20 2023-07-21T19:09:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.774+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1980b1b30 con 0x7fc1980caa20 2023-07-21T19:09:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.774+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180013680 con 0x7fc1980caa20 2023-07-21T19:09:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.774+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800139f0 con 0x7fc1980caa20 2023-07-21T19:09:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.774+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1980b20f0 con 0x7fc1980caa20 2023-07-21T19:09:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.774+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19804e500 con 0x7fc1980caa20 2023-07-21T19:09:32.791 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.778+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc180013b50 con 0x7fc1980caa20 2023-07-21T19:09:32.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.778+0000 7fc194ff9700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc1780662f0 0x7fc1780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:32.792 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.778+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc180083d50 con 0x7fc1980caa20 2023-07-21T19:09:32.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.778+0000 7fc196ffd700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc1780662f0 0x7fc1780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:32.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.778+0000 7fc196ffd700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc1780662f0 0x7fc1780687a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc1880012e0 tx=0x7fc188001990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:32.801 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.786+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc180087030 con 0x7fc1980caa20 2023-07-21T19:09:33.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.998+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1980c8300 con 0x7fc1980caa20 2023-07-21T19:09:33.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:32.998+0000 7fc194ff9700 1 -- 172.21.15.123:0/4065404244 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fc180054aa0 con 0x7fc1980caa20 2023-07-21T19:09:33.014 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:33.014 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5590,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1040218701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1040218701},{"type":"v1","addr":"172.21.15.145:6835","nonce":1040218701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/3115729738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":3115729738},{"type":"v1","addr":"172.21.15.123:6837","nonce":3115729738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1069533413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1069533413},{"type":"v1","addr":"172.21.15.123:6836","nonce":1069533413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:09:28.598376+0000","modified":"2023-07-21T19:09:32.552983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.145:6833/2403302730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2403302730},{"type":"v1","addr":"172.21.15.145:6833","nonce":2403302730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T19:09:33.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc1780662f0 msgr2=0x7fc1780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc1780662f0 0x7fc1780687a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc1880012e0 tx=0x7fc188001990 comp rx=0 tx=0).stop 2023-07-21T19:09:33.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 msgr2=0x7fc1980b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980b0360 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc18000e840 tx=0x7fc18000eb50 comp rx=0 tx=0).stop 2023-07-21T19:09:33.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 shutdown_connections 2023-07-21T19:09:33.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc1780662f0 0x7fc1780687a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1981599d0 0x7fc1980b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1980caa20 0x7fc1980b0360 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 --2- 172.21.15.123:0/4065404244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc198071000 0x7fc1980b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 >> 172.21.15.123:0/4065404244 conn(0x7fc19806e960 msgr2=0x7fc1980ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:33.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 shutdown_connections 2023-07-21T19:09:33.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.002+0000 7fc19d83e700 1 -- 172.21.15.123:0/4065404244 wait complete. 2023-07-21T19:09:33.019 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 18 2023-07-21T19:09:33.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T19:09:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.194+0000 7f654c953700 1 Processor -- start 2023-07-21T19:09:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.194+0000 7f654c953700 1 -- start start 2023-07-21T19:09:33.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654c953700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f654815bff0 0x7f65480ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654c953700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f65480cf1c0 0x7f65480afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654c953700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65480cd4c0 con 0x7f65480cd070 2023-07-21T19:09:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654c953700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65480af0a0 con 0x7f65480cf1c0 2023-07-21T19:09:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654c953700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480cf720 con 0x7f654815bff0 2023-07-21T19:09:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f65480cf1c0 0x7f65480afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f6546d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f654815bff0 0x7f65480ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f65480cf1c0 0x7f65480afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.123:57424/0 (socket says 172.21.15.123:57424) 2023-07-21T19:09:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 -- 172.21.15.123:0/1449832594 learned_addr learned my addr 172.21.15.123:0/1449832594 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f6546d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f654815bff0 0x7f65480ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47840/0 (socket says 172.21.15.123:47840) 2023-07-21T19:09:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 -- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f654815bff0 msgr2=0x7f65480ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 --2- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f654815bff0 0x7f65480ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 -- 172.21.15.123:0/1449832594 >> v1:172.21.15.145:6789/0 conn(0x7f65480cd070 legacy=0x7f65480ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 -- 172.21.15.123:0/1449832594 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480af2f0 con 0x7f65480cf1c0 2023-07-21T19:09:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654759e700 1 --2- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65480cf1c0 0x7f65480afdd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6540009e50 tx=0x7f654000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd609dad2eaaafb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.198+0000 7f654659c700 1 -- 172.21.15.123:0/1449832594 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000e070 con 0x7f65480cf1c0 2023-07-21T19:09:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654659c700 1 -- 172.21.15.123:0/1449832594 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654000b910 con 0x7f65480cf1c0 2023-07-21T19:09:33.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654659c700 1 -- 172.21.15.123:0/1449832594 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000bcc0 con 0x7f65480cf1c0 2023-07-21T19:09:33.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 -- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65480cf1c0 msgr2=0x7f65480afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 --2- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65480cf1c0 0x7f65480afdd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6540009e50 tx=0x7f654000b330 comp rx=0 tx=0).stop 2023-07-21T19:09:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 -- 172.21.15.123:0/1449832594 shutdown_connections 2023-07-21T19:09:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 --2- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65480cf1c0 0x7f65480afdd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 --2- 172.21.15.123:0/1449832594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f654815bff0 0x7f65480ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 -- 172.21.15.123:0/1449832594 >> 172.21.15.123:0/1449832594 conn(0x7f6548060c40 msgr2=0x7f654809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 -- 172.21.15.123:0/1449832594 shutdown_connections 2023-07-21T19:09:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.202+0000 7f654c953700 1 -- 172.21.15.123:0/1449832594 wait complete. 2023-07-21T19:09:33.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 Processor -- start 2023-07-21T19:09:33.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 -- start start 2023-07-21T19:09:33.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65480cd070 0x7f65480c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 0x7f65481f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f654815bff0 0x7f65481f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480b5560 con 0x7f65480cf1c0 2023-07-21T19:09:33.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480b5800 con 0x7f654815bff0 2023-07-21T19:09:33.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654c953700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480b5ae0 con 0x7f65480cd070 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 0x7f65481f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 0x7f65481f8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47426/0 (socket says 172.21.15.123:47426) 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 -- 172.21.15.123:0/1610536875 learned_addr learned my addr 172.21.15.123:0/1610536875 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f654759e700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f654815bff0 0x7f65481f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f6546d9d700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65480cd070 0x7f65480c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 -- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65480cd070 msgr2=0x7f65480c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65480cd070 0x7f65480c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 -- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f654815bff0 msgr2=0x7f65481f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f654815bff0 0x7f65481f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.206+0000 7f653ffff700 1 -- 172.21.15.123:0/1610536875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540009b30 con 0x7f65480cf1c0 2023-07-21T19:09:33.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f653ffff700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 0x7f65481f8a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f653000c500 tx=0x7f653000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300052d0 con 0x7f65480cf1c0 2023-07-21T19:09:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480b5dc0 con 0x7f65480cf1c0 2023-07-21T19:09:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530005430 con 0x7f65480cf1c0 2023-07-21T19:09:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300055a0 con 0x7f65480cf1c0 2023-07-21T19:09:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65480b3030 con 0x7f65480cf1c0 2023-07-21T19:09:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65480b62e0 con 0x7f65480cf1c0 2023-07-21T19:09:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.210+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65300038e0 con 0x7f65480cf1c0 2023-07-21T19:09:33.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.214+0000 7f653f7fe700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066320 0x7f65280687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.214+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6530083070 con 0x7f65480cf1c0 2023-07-21T19:09:33.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.214+0000 7f6546d9d700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066320 0x7f65280687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.214+0000 7f6546d9d700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066320 0x7f65280687d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6538009b50 tx=0x7f6538009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:33.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.218+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f65480b62e0 con 0x7f65480cf1c0 2023-07-21T19:09:33.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.394+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65480cd4c0 con 0x7f65480cf1c0 2023-07-21T19:09:33.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.398+0000 7f653f7fe700 1 -- 172.21.15.123:0/1610536875 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18560 (secure 0 0 0) 0x7f65480cd4c0 con 0x7f65480cf1c0 2023-07-21T19:09:33.413 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:33.413 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":43,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","created":"2023-07-21T19:07:21.739186+0000","modified":"2023-07-21T19:09:30.166229+0000","last_up_change":"2023-07-21T19:07:34.194744+0000","last_in_change":"2023-07-21T19:07:24.786122+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T19:07:36.002250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T19:07:41.293663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-21T19:09:26.398083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-21T19:09:27.611205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f667b60f-dcc9-4c58-b935-8f2debd82358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6801","nonce":2879105086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6803","nonce":2879105086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6807","nonce":2879105086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2879105086},{"type":"v1","addr":"172.21.15.123:6805","nonce":2879105086}]},"public_addr":"172.21.15.123:6801/2879105086","cluster_addr":"172.21.15.123:6803/2879105086","heartbeat_back_addr":"172.21.15.123:6807/2879105086","heartbeat_front_addr":"172.21.15.123:6805/2879105086","state":["exists","up"]},{"osd":1,"uuid":"f1458d7c-7efe-44ff-90b7-7f119ac4cf47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6809","nonce":2209387933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6811","nonce":2209387933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6815","nonce":2209387933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2209387933},{"type":"v1","addr":"172.21.15.123:6813","nonce":2209387933}]},"public_addr":"172.21.15.123:6809/2209387933","cluster_addr":"172.21.15.123:6811/2209387933","heartbeat_back_addr":"172.21.15.123:6815/2209387933","heartbeat_front_addr":"172.21.15.123:6813/2209387933","state":["exists","up"]},{"osd":2,"uuid":"4afb00a6-d01f-486b-acd1-276f46ba44ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6817","nonce":2633526095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6819","nonce":2633526095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6823","nonce":2633526095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2633526095},{"type":"v1","addr":"172.21.15.123:6821","nonce":2633526095}]},"public_addr":"172.21.15.123:6817/2633526095","cluster_addr":"172.21.15.123:6819/2633526095","heartbeat_back_addr":"172.21.15.123:6823/2633526095","heartbeat_front_addr":"172.21.15.123:6821/2633526095","state":["exists","up"]},{"osd":3,"uuid":"fa388f0a-64ed-4f6e-866f-2014cff8cf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6825","nonce":3573584440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6827","nonce":3573584440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6831","nonce":3573584440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3573584440},{"type":"v1","addr":"172.21.15.123:6829","nonce":3573584440}]},"public_addr":"172.21.15.123:6825/3573584440","cluster_addr":"172.21.15.123:6827/3573584440","heartbeat_back_addr":"172.21.15.123:6831/3573584440","heartbeat_front_addr":"172.21.15.123:6829/3573584440","state":["exists","up"]},{"osd":4,"uuid":"fb5f5b5d-c689-4d76-9d94-2a5746b45af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6806","nonce":1441391469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6809","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6812","nonce":1441391469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6819","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6821","nonce":1441391469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1441391469},{"type":"v1","addr":"172.21.15.145:6816","nonce":1441391469}]},"public_addr":"172.21.15.145:6806/1441391469","cluster_addr":"172.21.15.145:6812/1441391469","heartbeat_back_addr":"172.21.15.145:6821/1441391469","heartbeat_front_addr":"172.21.15.145:6816/1441391469","state":["exists","up"]},{"osd":5,"uuid":"57d8b14b-b9d4-4cca-b0e2-f0c3b6b0ef15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6808","nonce":4212871842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6813","nonce":4212871842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6823","nonce":4212871842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4212871842},{"type":"v1","addr":"172.21.15.145:6820","nonce":4212871842}]},"public_addr":"172.21.15.145:6808/4212871842","cluster_addr":"172.21.15.145:6813/4212871842","heartbeat_back_addr":"172.21.15.145:6823/4212871842","heartbeat_front_addr":"172.21.15.145:6820/4212871842","state":["exists","up"]},{"osd":6,"uuid":"c794a195-8e96-441e-a326-56fc3bc0eac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6801","nonce":2645113531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6804","nonce":2645113531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6818","nonce":2645113531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":2645113531},{"type":"v1","addr":"172.21.15.145:6811","nonce":2645113531}]},"public_addr":"172.21.15.145:6801/2645113531","cluster_addr":"172.21.15.145:6804/2645113531","heartbeat_back_addr":"172.21.15.145:6818/2645113531","heartbeat_front_addr":"172.21.15.145:6811/2645113531","state":["exists","up"]},{"osd":7,"uuid":"a49730d4-a3f9-4a85-85b3-3077b536c7b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6825","nonce":2662407435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6827","nonce":2662407435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6831","nonce":2662407435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2662407435},{"type":"v1","addr":"172.21.15.145:6829","nonce":2662407435}]},"public_addr":"172.21.15.145:6825/2662407435","cluster_addr":"172.21.15.145:6827/2662407435","heartbeat_back_addr":"172.21.15.145:6831/2662407435","heartbeat_front_addr":"172.21.15.145:6829/2662407435","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.382413+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.573050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.601697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.529672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.499805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.544860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.567341+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T19:07:30.798485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T19:09:33.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066320 msgr2=0x7f65280687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066320 0x7f65280687d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6538009b50 tx=0x7f6538009240 comp rx=0 tx=0).stop 2023-07-21T19:09:33.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 msgr2=0x7f65481f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 0x7f65481f8a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f653000c500 tx=0x7f653000c810 comp rx=0 tx=0).stop 2023-07-21T19:09:33.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 shutdown_connections 2023-07-21T19:09:33.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f6528066320 0x7f65280687d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f654815bff0 0x7f65481f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65480cf1c0 0x7f65481f8a70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 --2- 172.21.15.123:0/1610536875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65480cd070 0x7f65480c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 >> 172.21.15.123:0/1610536875 conn(0x7f6548060c40 msgr2=0x7f65480d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:33.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 shutdown_connections 2023-07-21T19:09:33.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.402+0000 7f654c953700 1 -- 172.21.15.123:0/1610536875 wait complete. 2023-07-21T19:09:33.437 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T19:09:33.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T19:09:33.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.598+0000 7fe1ea9bf700 1 Processor -- start 2023-07-21T19:09:33.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1ea9bf700 1 -- start start 2023-07-21T19:09:33.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1ea9bf700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe1e406d860 0x7fe1e40cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1ea9bf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40cc1b0 con 0x7fe1e40c1e00 2023-07-21T19:09:33.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1ea9bf700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40cd690 con 0x7fe1e406be70 2023-07-21T19:09:33.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1ea9bf700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40cd970 con 0x7fe1e406d860 2023-07-21T19:09:33.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e8f5c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe1e40c1e00 0x7fe1e40cc640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52098/0 (socket says 172.21.15.123:52098) 2023-07-21T19:09:33.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e8f5c700 1 -- 172.21.15.123:0/2746890194 learned_addr learned my addr 172.21.15.123:0/2746890194 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:33.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e3fff700 1 --2- 172.21.15.123:0/2746890194 >> v2:172.21.15.145:3300/0 conn(0x7fe1e406d860 0x7fe1e40cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e37fe700 1 -- 172.21.15.123:0/2746890194 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501318281 0 0) 0x7fe1e40cc1b0 con 0x7fe1e40c1e00 2023-07-21T19:09:33.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e37fe700 1 -- 172.21.15.123:0/2746890194 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d00035d0 con 0x7fe1e40c1e00 2023-07-21T19:09:33.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e3fff700 1 -- 172.21.15.123:0/2746890194 >> v1:172.21.15.145:6789/0 conn(0x7fe1e406be70 legacy=0x7fe1e406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e3fff700 1 -- 172.21.15.123:0/2746890194 >> v1:172.21.15.123:6789/0 conn(0x7fe1e40c1e00 legacy=0x7fe1e40cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.602+0000 7fe1e3fff700 1 -- 172.21.15.123:0/2746890194 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40cdc50 con 0x7fe1e406d860 2023-07-21T19:09:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1e3fff700 1 --2- 172.21.15.123:0/2746890194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e406d860 0x7fe1e40cb840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009d90 tx=0x7fe1d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56c6fa296788ec1b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1e37fe700 1 -- 172.21.15.123:0/2746890194 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400e070 con 0x7fe1e406d860 2023-07-21T19:09:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1e37fe700 1 -- 172.21.15.123:0/2746890194 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d400bb20 con 0x7fe1e406d860 2023-07-21T19:09:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1e37fe700 1 -- 172.21.15.123:0/2746890194 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4012430 con 0x7fe1e406d860 2023-07-21T19:09:33.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/2746890194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e406d860 msgr2=0x7fe1e40cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/2746890194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e406d860 0x7fe1e40cb840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009d90 tx=0x7fe1d400b330 comp rx=0 tx=0).stop 2023-07-21T19:09:33.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/2746890194 shutdown_connections 2023-07-21T19:09:33.621 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/2746890194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e406d860 0x7fe1e40cb840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/2746890194 >> 172.21.15.123:0/2746890194 conn(0x7fe1e40cad30 msgr2=0x7fe1e40cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:33.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/2746890194 shutdown_connections 2023-07-21T19:09:33.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.606+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/2746890194 wait complete. 2023-07-21T19:09:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 Processor -- start 2023-07-21T19:09:33.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 -- start start 2023-07-21T19:09:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406be70 0x7fe1e414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 0x7fe1e4158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e40c1e00 0x7fe1e40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c7260 con 0x7fe1e406d860 2023-07-21T19:09:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e414e8b0 con 0x7fe1e40c1e00 2023-07-21T19:09:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1ea9bf700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c61e0 con 0x7fe1e406be70 2023-07-21T19:09:33.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1db7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 0x7fe1e4158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1db7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 0x7fe1e4158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47434/0 (socket says 172.21.15.123:47434) 2023-07-21T19:09:33.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1db7fe700 1 -- 172.21.15.123:0/3876060584 learned_addr learned my addr 172.21.15.123:0/3876060584 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:33.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1e8f5c700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e40c1e00 0x7fe1e40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.610+0000 7fe1e3fff700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406be70 0x7fe1e414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1db7fe700 1 -- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406be70 msgr2=0x7fe1e414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1db7fe700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406be70 0x7fe1e414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1db7fe700 1 -- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e40c1e00 msgr2=0x7fe1e40ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1db7fe700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e40c1e00 0x7fe1e40ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1db7fe700 1 -- 172.21.15.123:0/3876060584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d4009a70 con 0x7fe1e406d860 2023-07-21T19:09:33.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1db7fe700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 0x7fe1e4158900 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c500 tx=0x7fe1cc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:33.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0052d0 con 0x7fe1e406d860 2023-07-21T19:09:33.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc005430 con 0x7fe1e406d860 2023-07-21T19:09:33.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40c64c0 con 0x7fe1e406d860 2023-07-21T19:09:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0055a0 con 0x7fe1e406d860 2023-07-21T19:09:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40c6a80 con 0x7fe1e406d860 2023-07-21T19:09:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.614+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e404dcb0 con 0x7fe1e406d860 2023-07-21T19:09:33.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.618+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1cc0038e0 con 0x7fe1e406d860 2023-07-21T19:09:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.618+0000 7fe1e17fa700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1c4066320 0x7fe1c40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.618+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe1cc0832a0 con 0x7fe1e406d860 2023-07-21T19:09:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.618+0000 7fe1e3fff700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1c4066320 0x7fe1c40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.622+0000 7fe1e3fff700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1c4066320 0x7fe1c40687d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4014040 tx=0x7fe1d4011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.622+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe1cc050540 con 0x7fe1e406d860 2023-07-21T19:09:33.806 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.790+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 --> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1e40cdf30 con 0x7fe1c4066320 2023-07-21T19:09:33.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.802+0000 7fe1e17fa700 1 -- 172.21.15.123:0/3876060584 <== mgr.4104 v2:172.21.15.123:6832/1650121890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309023 (secure 0 0 0) 0x7fe1d4003d50 con 0x7fe1c4066320 2023-07-21T19:09:33.823 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1c4066320 msgr2=0x7fe1c40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1c4066320 0x7fe1c40687d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4014040 tx=0x7fe1d4011000 comp rx=0 tx=0).stop 2023-07-21T19:09:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 msgr2=0x7fe1e4158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 0x7fe1e4158900 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c500 tx=0x7fe1cc00c810 comp rx=0 tx=0).stop 2023-07-21T19:09:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 shutdown_connections 2023-07-21T19:09:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fe1c4066320 0x7fe1c40687d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e40c1e00 0x7fe1e40ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e406d860 0x7fe1e4158900 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 --2- 172.21.15.123:0/3876060584 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406be70 0x7fe1e414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 >> 172.21.15.123:0/3876060584 conn(0x7fe1e40cad30 msgr2=0x7fe1e40ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 shutdown_connections 2023-07-21T19:09:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:33.810+0000 7fe1ea9bf700 1 -- 172.21.15.123:0/3876060584 wait complete. 2023-07-21T19:09:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-07-21T19:09:33.848 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-07-21T19:09:31.915862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224720,"kb_used_data":5008,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750000,"statfs":{"total":773094113280,"available":772864000000,"internally_reserved":0,"allocated":5128192,"data_stored":2917368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788956"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191196+0000","last_change":"2023-07-21T19:09:29.178742+0000","last_active":"2023-07-21T19:09:29.191196+0000","last_peered":"2023-07-21T19:09:29.191196+0000","last_clean":"2023-07-21T19:09:29.191196+0000","last_became_active":"2023-07-21T19:09:29.178411+0000","last_became_peered":"2023-07-21T19:09:29.178411+0000","last_unstale":"2023-07-21T19:09:29.191196+0000","last_undegraded":"2023-07-21T19:09:29.191196+0000","last_fullsized":"2023-07-21T19:09:29.191196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:13:14.276357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190701+0000","last_change":"2023-07-21T19:09:29.182718+0000","last_active":"2023-07-21T19:09:29.190701+0000","last_peered":"2023-07-21T19:09:29.190701+0000","last_clean":"2023-07-21T19:09:29.190701+0000","last_became_active":"2023-07-21T19:09:29.182394+0000","last_became_peered":"2023-07-21T19:09:29.182394+0000","last_unstale":"2023-07-21T19:09:29.190701+0000","last_undegraded":"2023-07-21T19:09:29.190701+0000","last_fullsized":"2023-07-21T19:09:29.190701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:37.895956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.177588+0000","last_change":"2023-07-21T19:09:29.168884+0000","last_active":"2023-07-21T19:09:29.177588+0000","last_peered":"2023-07-21T19:09:29.177588+0000","last_clean":"2023-07-21T19:09:29.177588+0000","last_became_active":"2023-07-21T19:09:29.168615+0000","last_became_peered":"2023-07-21T19:09:29.168615+0000","last_unstale":"2023-07-21T19:09:29.177588+0000","last_undegraded":"2023-07-21T19:09:29.177588+0000","last_fullsized":"2023-07-21T19:09:29.177588+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:11.032020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185611+0000","last_change":"2023-07-21T19:09:29.178955+0000","last_active":"2023-07-21T19:09:29.185611+0000","last_peered":"2023-07-21T19:09:29.185611+0000","last_clean":"2023-07-21T19:09:29.185611+0000","last_became_active":"2023-07-21T19:09:29.178599+0000","last_became_peered":"2023-07-21T19:09:29.178599+0000","last_unstale":"2023-07-21T19:09:29.185611+0000","last_undegraded":"2023-07-21T19:09:29.185611+0000","last_fullsized":"2023-07-21T19:09:29.185611+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:10.654538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190740+0000","last_change":"2023-07-21T19:09:29.180724+0000","last_active":"2023-07-21T19:09:29.190740+0000","last_peered":"2023-07-21T19:09:29.190740+0000","last_clean":"2023-07-21T19:09:29.190740+0000","last_became_active":"2023-07-21T19:09:29.180449+0000","last_became_peered":"2023-07-21T19:09:29.180449+0000","last_unstale":"2023-07-21T19:09:29.190740+0000","last_undegraded":"2023-07-21T19:09:29.190740+0000","last_fullsized":"2023-07-21T19:09:29.190740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:03.877635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187455+0000","last_change":"2023-07-21T19:09:29.183485+0000","last_active":"2023-07-21T19:09:29.187455+0000","last_peered":"2023-07-21T19:09:29.187455+0000","last_clean":"2023-07-21T19:09:29.187455+0000","last_became_active":"2023-07-21T19:09:29.183075+0000","last_became_peered":"2023-07-21T19:09:29.183075+0000","last_unstale":"2023-07-21T19:09:29.187455+0000","last_undegraded":"2023-07-21T19:09:29.187455+0000","last_fullsized":"2023-07-21T19:09:29.187455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:12:27.095182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191243+0000","last_change":"2023-07-21T19:09:29.181177+0000","last_active":"2023-07-21T19:09:29.191243+0000","last_peered":"2023-07-21T19:09:29.191243+0000","last_clean":"2023-07-21T19:09:29.191243+0000","last_became_active":"2023-07-21T19:09:29.180881+0000","last_became_peered":"2023-07-21T19:09:29.180881+0000","last_unstale":"2023-07-21T19:09:29.191243+0000","last_undegraded":"2023-07-21T19:09:29.191243+0000","last_fullsized":"2023-07-21T19:09:29.191243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:34.055455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190872+0000","last_change":"2023-07-21T19:09:29.187237+0000","last_active":"2023-07-21T19:09:29.190872+0000","last_peered":"2023-07-21T19:09:29.190872+0000","last_clean":"2023-07-21T19:09:29.190872+0000","last_became_active":"2023-07-21T19:09:29.185591+0000","last_became_peered":"2023-07-21T19:09:29.185591+0000","last_unstale":"2023-07-21T19:09:29.190872+0000","last_undegraded":"2023-07-21T19:09:29.190872+0000","last_fullsized":"2023-07-21T19:09:29.190872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:48:30.095724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181792+0000","last_change":"2023-07-21T19:09:29.169031+0000","last_active":"2023-07-21T19:09:29.181792+0000","last_peered":"2023-07-21T19:09:29.181792+0000","last_clean":"2023-07-21T19:09:29.181792+0000","last_became_active":"2023-07-21T19:09:29.168734+0000","last_became_peered":"2023-07-21T19:09:29.168734+0000","last_unstale":"2023-07-21T19:09:29.181792+0000","last_undegraded":"2023-07-21T19:09:29.181792+0000","last_fullsized":"2023-07-21T19:09:29.181792+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:59.468564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.186483+0000","last_change":"2023-07-21T19:09:29.179790+0000","last_active":"2023-07-21T19:09:29.186483+0000","last_peered":"2023-07-21T19:09:29.186483+0000","last_clean":"2023-07-21T19:09:29.186483+0000","last_became_active":"2023-07-21T19:09:29.179419+0000","last_became_peered":"2023-07-21T19:09:29.179419+0000","last_unstale":"2023-07-21T19:09:29.186483+0000","last_undegraded":"2023-07-21T19:09:29.186483+0000","last_fullsized":"2023-07-21T19:09:29.186483+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:05:42.019660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182042+0000","last_change":"2023-07-21T19:09:29.169017+0000","last_active":"2023-07-21T19:09:29.182042+0000","last_peered":"2023-07-21T19:09:29.182042+0000","last_clean":"2023-07-21T19:09:29.182042+0000","last_became_active":"2023-07-21T19:09:29.168712+0000","last_became_peered":"2023-07-21T19:09:29.168712+0000","last_unstale":"2023-07-21T19:09:29.182042+0000","last_undegraded":"2023-07-21T19:09:29.182042+0000","last_fullsized":"2023-07-21T19:09:29.182042+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:53.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182012+0000","last_change":"2023-07-21T19:09:29.175439+0000","last_active":"2023-07-21T19:09:29.182012+0000","last_peered":"2023-07-21T19:09:29.182012+0000","last_clean":"2023-07-21T19:09:29.182012+0000","last_became_active":"2023-07-21T19:09:29.175198+0000","last_became_peered":"2023-07-21T19:09:29.175198+0000","last_unstale":"2023-07-21T19:09:29.182012+0000","last_undegraded":"2023-07-21T19:09:29.182012+0000","last_fullsized":"2023-07-21T19:09:29.182012+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:15:53.667235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188151+0000","last_change":"2023-07-21T19:09:29.185170+0000","last_active":"2023-07-21T19:09:29.188151+0000","last_peered":"2023-07-21T19:09:29.188151+0000","last_clean":"2023-07-21T19:09:29.188151+0000","last_became_active":"2023-07-21T19:09:29.184769+0000","last_became_peered":"2023-07-21T19:09:29.184769+0000","last_unstale":"2023-07-21T19:09:29.188151+0000","last_undegraded":"2023-07-21T19:09:29.188151+0000","last_fullsized":"2023-07-21T19:09:29.188151+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:00.340466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181955+0000","last_change":"2023-07-21T19:09:29.169451+0000","last_active":"2023-07-21T19:09:29.181955+0000","last_peered":"2023-07-21T19:09:29.181955+0000","last_clean":"2023-07-21T19:09:29.181955+0000","last_became_active":"2023-07-21T19:09:29.169156+0000","last_became_peered":"2023-07-21T19:09:29.169156+0000","last_unstale":"2023-07-21T19:09:29.181955+0000","last_undegraded":"2023-07-21T19:09:29.181955+0000","last_fullsized":"2023-07-21T19:09:29.181955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:50.125895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185276+0000","last_change":"2023-07-21T19:09:29.182087+0000","last_active":"2023-07-21T19:09:29.185276+0000","last_peered":"2023-07-21T19:09:29.185276+0000","last_clean":"2023-07-21T19:09:29.185276+0000","last_became_active":"2023-07-21T19:09:29.181831+0000","last_became_peered":"2023-07-21T19:09:29.181831+0000","last_unstale":"2023-07-21T19:09:29.185276+0000","last_undegraded":"2023-07-21T19:09:29.185276+0000","last_fullsized":"2023-07-21T19:09:29.185276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:41.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192203+0000","last_change":"2023-07-21T19:09:29.188313+0000","last_active":"2023-07-21T19:09:29.192203+0000","last_peered":"2023-07-21T19:09:29.192203+0000","last_clean":"2023-07-21T19:09:29.192203+0000","last_became_active":"2023-07-21T19:09:29.185092+0000","last_became_peered":"2023-07-21T19:09:29.185092+0000","last_unstale":"2023-07-21T19:09:29.192203+0000","last_undegraded":"2023-07-21T19:09:29.192203+0000","last_fullsized":"2023-07-21T19:09:29.192203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:33.700361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.164151+0000","last_change":"2023-07-21T19:09:29.161246+0000","last_active":"2023-07-21T19:09:29.164151+0000","last_peered":"2023-07-21T19:09:29.164151+0000","last_clean":"2023-07-21T19:09:29.164151+0000","last_became_active":"2023-07-21T19:09:29.160977+0000","last_became_peered":"2023-07-21T19:09:29.160977+0000","last_unstale":"2023-07-21T19:09:29.164151+0000","last_undegraded":"2023-07-21T19:09:29.164151+0000","last_fullsized":"2023-07-21T19:09:29.164151+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:46:46.136748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190783+0000","last_change":"2023-07-21T19:09:29.186599+0000","last_active":"2023-07-21T19:09:29.190783+0000","last_peered":"2023-07-21T19:09:29.190783+0000","last_clean":"2023-07-21T19:09:29.190783+0000","last_became_active":"2023-07-21T19:09:29.186108+0000","last_became_peered":"2023-07-21T19:09:29.186108+0000","last_unstale":"2023-07-21T19:09:29.190783+0000","last_undegraded":"2023-07-21T19:09:29.190783+0000","last_fullsized":"2023-07-21T19:09:29.190783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:06.190198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191984+0000","last_change":"2023-07-21T19:09:29.187434+0000","last_active":"2023-07-21T19:09:29.191984+0000","last_peered":"2023-07-21T19:09:29.191984+0000","last_clean":"2023-07-21T19:09:29.191984+0000","last_became_active":"2023-07-21T19:09:29.185131+0000","last_became_peered":"2023-07-21T19:09:29.185131+0000","last_unstale":"2023-07-21T19:09:29.191984+0000","last_undegraded":"2023-07-21T19:09:29.191984+0000","last_fullsized":"2023-07-21T19:09:29.191984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:09:08.746077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192306+0000","last_change":"2023-07-21T19:09:29.189639+0000","last_active":"2023-07-21T19:09:29.192306+0000","last_peered":"2023-07-21T19:09:29.192306+0000","last_clean":"2023-07-21T19:09:29.192306+0000","last_became_active":"2023-07-21T19:09:29.189172+0000","last_became_peered":"2023-07-21T19:09:29.189172+0000","last_unstale":"2023-07-21T19:09:29.192306+0000","last_undegraded":"2023-07-21T19:09:29.192306+0000","last_fullsized":"2023-07-21T19:09:29.192306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:49:25.956629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185517+0000","last_change":"2023-07-21T19:09:29.181091+0000","last_active":"2023-07-21T19:09:29.185517+0000","last_peered":"2023-07-21T19:09:29.185517+0000","last_clean":"2023-07-21T19:09:29.185517+0000","last_became_active":"2023-07-21T19:09:29.179353+0000","last_became_peered":"2023-07-21T19:09:29.179353+0000","last_unstale":"2023-07-21T19:09:29.185517+0000","last_undegraded":"2023-07-21T19:09:29.185517+0000","last_fullsized":"2023-07-21T19:09:29.185517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:10.139361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185303+0000","last_change":"2023-07-21T19:09:29.180323+0000","last_active":"2023-07-21T19:09:29.185303+0000","last_peered":"2023-07-21T19:09:29.185303+0000","last_clean":"2023-07-21T19:09:29.185303+0000","last_became_active":"2023-07-21T19:09:29.180058+0000","last_became_peered":"2023-07-21T19:09:29.180058+0000","last_unstale":"2023-07-21T19:09:29.185303+0000","last_undegraded":"2023-07-21T19:09:29.185303+0000","last_fullsized":"2023-07-21T19:09:29.185303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:42.375445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192088+0000","last_change":"2023-07-21T19:09:29.187210+0000","last_active":"2023-07-21T19:09:29.192088+0000","last_peered":"2023-07-21T19:09:29.192088+0000","last_clean":"2023-07-21T19:09:29.192088+0000","last_became_active":"2023-07-21T19:09:29.185248+0000","last_became_peered":"2023-07-21T19:09:29.185248+0000","last_unstale":"2023-07-21T19:09:29.192088+0000","last_undegraded":"2023-07-21T19:09:29.192088+0000","last_fullsized":"2023-07-21T19:09:29.192088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:45:13.551045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188050+0000","last_change":"2023-07-21T19:09:29.179726+0000","last_active":"2023-07-21T19:09:29.188050+0000","last_peered":"2023-07-21T19:09:29.188050+0000","last_clean":"2023-07-21T19:09:29.188050+0000","last_became_active":"2023-07-21T19:09:29.179312+0000","last_became_peered":"2023-07-21T19:09:29.179312+0000","last_unstale":"2023-07-21T19:09:29.188050+0000","last_undegraded":"2023-07-21T19:09:29.188050+0000","last_fullsized":"2023-07-21T19:09:29.188050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:38:32.081489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192178+0000","last_change":"2023-07-21T19:09:29.188356+0000","last_active":"2023-07-21T19:09:29.192178+0000","last_peered":"2023-07-21T19:09:29.192178+0000","last_clean":"2023-07-21T19:09:29.192178+0000","last_became_active":"2023-07-21T19:09:29.184208+0000","last_became_peered":"2023-07-21T19:09:29.184208+0000","last_unstale":"2023-07-21T19:09:29.192178+0000","last_undegraded":"2023-07-21T19:09:29.192178+0000","last_fullsized":"2023-07-21T19:09:29.192178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:26.984220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.186798+0000","last_change":"2023-07-21T19:09:29.184084+0000","last_active":"2023-07-21T19:09:29.186798+0000","last_peered":"2023-07-21T19:09:29.186798+0000","last_clean":"2023-07-21T19:09:29.186798+0000","last_became_active":"2023-07-21T19:09:29.183832+0000","last_became_peered":"2023-07-21T19:09:29.183832+0000","last_unstale":"2023-07-21T19:09:29.186798+0000","last_undegraded":"2023-07-21T19:09:29.186798+0000","last_fullsized":"2023-07-21T19:09:29.186798+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:17.676308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.177604+0000","last_change":"2023-07-21T19:09:29.169936+0000","last_active":"2023-07-21T19:09:29.177604+0000","last_peered":"2023-07-21T19:09:29.177604+0000","last_clean":"2023-07-21T19:09:29.177604+0000","last_became_active":"2023-07-21T19:09:29.169660+0000","last_became_peered":"2023-07-21T19:09:29.169660+0000","last_unstale":"2023-07-21T19:09:29.177604+0000","last_undegraded":"2023-07-21T19:09:29.177604+0000","last_fullsized":"2023-07-21T19:09:29.177604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:02.542413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181993+0000","last_change":"2023-07-21T19:09:29.175398+0000","last_active":"2023-07-21T19:09:29.181993+0000","last_peered":"2023-07-21T19:09:29.181993+0000","last_clean":"2023-07-21T19:09:29.181993+0000","last_became_active":"2023-07-21T19:09:29.175108+0000","last_became_peered":"2023-07-21T19:09:29.175108+0000","last_unstale":"2023-07-21T19:09:29.181993+0000","last_undegraded":"2023-07-21T19:09:29.181993+0000","last_fullsized":"2023-07-21T19:09:29.181993+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:20.405125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.189891+0000","last_change":"2023-07-21T19:09:29.183097+0000","last_active":"2023-07-21T19:09:29.189891+0000","last_peered":"2023-07-21T19:09:29.189891+0000","last_clean":"2023-07-21T19:09:29.189891+0000","last_became_active":"2023-07-21T19:09:29.182853+0000","last_became_peered":"2023-07-21T19:09:29.182853+0000","last_unstale":"2023-07-21T19:09:29.189891+0000","last_undegraded":"2023-07-21T19:09:29.189891+0000","last_fullsized":"2023-07-21T19:09:29.189891+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:54.243004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185175+0000","last_change":"2023-07-21T19:09:29.179966+0000","last_active":"2023-07-21T19:09:29.185175+0000","last_peered":"2023-07-21T19:09:29.185175+0000","last_clean":"2023-07-21T19:09:29.185175+0000","last_became_active":"2023-07-21T19:09:29.179656+0000","last_became_peered":"2023-07-21T19:09:29.179656+0000","last_unstale":"2023-07-21T19:09:29.185175+0000","last_undegraded":"2023-07-21T19:09:29.185175+0000","last_fullsized":"2023-07-21T19:09:29.185175+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:41:26.631589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187403+0000","last_change":"2023-07-21T19:09:29.182716+0000","last_active":"2023-07-21T19:09:29.187403+0000","last_peered":"2023-07-21T19:09:29.187403+0000","last_clean":"2023-07-21T19:09:29.187403+0000","last_became_active":"2023-07-21T19:09:29.182410+0000","last_became_peered":"2023-07-21T19:09:29.182410+0000","last_unstale":"2023-07-21T19:09:29.187403+0000","last_undegraded":"2023-07-21T19:09:29.187403+0000","last_fullsized":"2023-07-21T19:09:29.187403+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:34.055455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.174790+0000","last_change":"2023-07-21T19:09:29.168153+0000","last_active":"2023-07-21T19:09:29.174790+0000","last_peered":"2023-07-21T19:09:29.174790+0000","last_clean":"2023-07-21T19:09:29.174790+0000","last_became_active":"2023-07-21T19:09:29.167853+0000","last_became_peered":"2023-07-21T19:09:29.167853+0000","last_unstale":"2023-07-21T19:09:29.174790+0000","last_undegraded":"2023-07-21T19:09:29.174790+0000","last_fullsized":"2023-07-21T19:09:29.174790+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:11.785960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.183433+0000","last_change":"2023-07-21T19:09:29.173947+0000","last_active":"2023-07-21T19:09:29.183433+0000","last_peered":"2023-07-21T19:09:29.183433+0000","last_clean":"2023-07-21T19:09:29.183433+0000","last_became_active":"2023-07-21T19:09:29.173667+0000","last_became_peered":"2023-07-21T19:09:29.173667+0000","last_unstale":"2023-07-21T19:09:29.183433+0000","last_undegraded":"2023-07-21T19:09:29.183433+0000","last_fullsized":"2023-07-21T19:09:29.183433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:13.372886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191322+0000","last_change":"2023-07-21T19:09:28.163677+0000","last_active":"2023-07-21T19:09:29.191322+0000","last_peered":"2023-07-21T19:09:29.191322+0000","last_clean":"2023-07-21T19:09:29.191322+0000","last_became_active":"2023-07-21T19:09:28.163399+0000","last_became_peered":"2023-07-21T19:09:28.163399+0000","last_unstale":"2023-07-21T19:09:29.191322+0000","last_undegraded":"2023-07-21T19:09:29.191322+0000","last_fullsized":"2023-07-21T19:09:29.191322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:42.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190086+0000","last_change":"2023-07-21T19:09:29.180756+0000","last_active":"2023-07-21T19:09:29.190086+0000","last_peered":"2023-07-21T19:09:29.190086+0000","last_clean":"2023-07-21T19:09:29.190086+0000","last_became_active":"2023-07-21T19:09:29.180487+0000","last_became_peered":"2023-07-21T19:09:29.180487+0000","last_unstale":"2023-07-21T19:09:29.190086+0000","last_undegraded":"2023-07-21T19:09:29.190086+0000","last_fullsized":"2023-07-21T19:09:29.190086+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:15:04.561340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.177050+0000","last_change":"2023-07-21T19:09:28.164641+0000","last_active":"2023-07-21T19:09:29.177050+0000","last_peered":"2023-07-21T19:09:29.177050+0000","last_clean":"2023-07-21T19:09:29.177050+0000","last_became_active":"2023-07-21T19:09:28.164363+0000","last_became_peered":"2023-07-21T19:09:28.164363+0000","last_unstale":"2023-07-21T19:09:29.177050+0000","last_undegraded":"2023-07-21T19:09:29.177050+0000","last_fullsized":"2023-07-21T19:09:29.177050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:52:47.591863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181059+0000","last_change":"2023-07-21T19:09:29.174551+0000","last_active":"2023-07-21T19:09:29.181059+0000","last_peered":"2023-07-21T19:09:29.181059+0000","last_clean":"2023-07-21T19:09:29.181059+0000","last_became_active":"2023-07-21T19:09:29.173573+0000","last_became_peered":"2023-07-21T19:09:29.173573+0000","last_unstale":"2023-07-21T19:09:29.181059+0000","last_undegraded":"2023-07-21T19:09:29.181059+0000","last_fullsized":"2023-07-21T19:09:29.181059+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:51:32.224491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.180816+0000","last_change":"2023-07-21T19:09:28.171467+0000","last_active":"2023-07-21T19:09:29.180816+0000","last_peered":"2023-07-21T19:09:29.180816+0000","last_clean":"2023-07-21T19:09:29.180816+0000","last_became_active":"2023-07-21T19:09:28.171173+0000","last_became_peered":"2023-07-21T19:09:28.171173+0000","last_unstale":"2023-07-21T19:09:29.180816+0000","last_undegraded":"2023-07-21T19:09:29.180816+0000","last_fullsized":"2023-07-21T19:09:29.180816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:44:11.689198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190643+0000","last_change":"2023-07-21T19:09:29.181342+0000","last_active":"2023-07-21T19:09:29.190643+0000","last_peered":"2023-07-21T19:09:29.190643+0000","last_clean":"2023-07-21T19:09:29.190643+0000","last_became_active":"2023-07-21T19:09:29.181017+0000","last_became_peered":"2023-07-21T19:09:29.181017+0000","last_unstale":"2023-07-21T19:09:29.190643+0000","last_undegraded":"2023-07-21T19:09:29.190643+0000","last_fullsized":"2023-07-21T19:09:29.190643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:59.468564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.183607+0000","last_change":"2023-07-21T19:09:28.170668+0000","last_active":"2023-07-21T19:09:29.183607+0000","last_peered":"2023-07-21T19:09:29.183607+0000","last_clean":"2023-07-21T19:09:29.183607+0000","last_became_active":"2023-07-21T19:09:28.170401+0000","last_became_peered":"2023-07-21T19:09:28.170401+0000","last_unstale":"2023-07-21T19:09:29.183607+0000","last_undegraded":"2023-07-21T19:09:29.183607+0000","last_fullsized":"2023-07-21T19:09:29.183607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:07.104316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182952+0000","last_change":"2023-07-21T19:09:29.177382+0000","last_active":"2023-07-21T19:09:29.182952+0000","last_peered":"2023-07-21T19:09:29.182952+0000","last_clean":"2023-07-21T19:09:29.182952+0000","last_became_active":"2023-07-21T19:09:29.177052+0000","last_became_peered":"2023-07-21T19:09:29.177052+0000","last_unstale":"2023-07-21T19:09:29.182952+0000","last_undegraded":"2023-07-21T19:09:29.182952+0000","last_fullsized":"2023-07-21T19:09:29.182952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:53.103649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187601+0000","last_change":"2023-07-21T19:09:28.173168+0000","last_active":"2023-07-21T19:09:29.187601+0000","last_peered":"2023-07-21T19:09:29.187601+0000","last_clean":"2023-07-21T19:09:29.187601+0000","last_became_active":"2023-07-21T19:09:28.172894+0000","last_became_peered":"2023-07-21T19:09:28.172894+0000","last_unstale":"2023-07-21T19:09:29.187601+0000","last_undegraded":"2023-07-21T19:09:29.187601+0000","last_fullsized":"2023-07-21T19:09:29.187601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:52:28.299963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182136+0000","last_change":"2023-07-21T19:09:29.173082+0000","last_active":"2023-07-21T19:09:29.182136+0000","last_peered":"2023-07-21T19:09:29.182136+0000","last_clean":"2023-07-21T19:09:29.182136+0000","last_became_active":"2023-07-21T19:09:29.172845+0000","last_became_peered":"2023-07-21T19:09:29.172845+0000","last_unstale":"2023-07-21T19:09:29.182136+0000","last_undegraded":"2023-07-21T19:09:29.182136+0000","last_fullsized":"2023-07-21T19:09:29.182136+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:12.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181799+0000","last_change":"2023-07-21T19:09:28.163753+0000","last_active":"2023-07-21T19:09:29.181799+0000","last_peered":"2023-07-21T19:09:29.181799+0000","last_clean":"2023-07-21T19:09:29.181799+0000","last_became_active":"2023-07-21T19:09:28.163486+0000","last_became_peered":"2023-07-21T19:09:28.163486+0000","last_unstale":"2023-07-21T19:09:29.181799+0000","last_undegraded":"2023-07-21T19:09:29.181799+0000","last_fullsized":"2023-07-21T19:09:29.181799+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:45.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190765+0000","last_change":"2023-07-21T19:09:29.185765+0000","last_active":"2023-07-21T19:09:29.190765+0000","last_peered":"2023-07-21T19:09:29.190765+0000","last_clean":"2023-07-21T19:09:29.190765+0000","last_became_active":"2023-07-21T19:09:29.185481+0000","last_became_peered":"2023-07-21T19:09:29.185481+0000","last_unstale":"2023-07-21T19:09:29.190765+0000","last_undegraded":"2023-07-21T19:09:29.190765+0000","last_fullsized":"2023-07-21T19:09:29.190765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:16.337588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155680+0000","last_change":"2023-07-21T19:09:28.170199+0000","last_active":"2023-07-21T19:09:29.155680+0000","last_peered":"2023-07-21T19:09:29.155680+0000","last_clean":"2023-07-21T19:09:29.155680+0000","last_became_active":"2023-07-21T19:09:28.169814+0000","last_became_peered":"2023-07-21T19:09:28.169814+0000","last_unstale":"2023-07-21T19:09:29.155680+0000","last_undegraded":"2023-07-21T19:09:29.155680+0000","last_fullsized":"2023-07-21T19:09:29.155680+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:48.818391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192103+0000","last_change":"2023-07-21T19:09:29.187785+0000","last_active":"2023-07-21T19:09:29.192103+0000","last_peered":"2023-07-21T19:09:29.192103+0000","last_clean":"2023-07-21T19:09:29.192103+0000","last_became_active":"2023-07-21T19:09:29.187449+0000","last_became_peered":"2023-07-21T19:09:29.187449+0000","last_unstale":"2023-07-21T19:09:29.192103+0000","last_undegraded":"2023-07-21T19:09:29.192103+0000","last_fullsized":"2023-07-21T19:09:29.192103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:48:31.466517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.160518+0000","last_change":"2023-07-21T19:09:28.172099+0000","last_active":"2023-07-21T19:09:29.160518+0000","last_peered":"2023-07-21T19:09:29.160518+0000","last_clean":"2023-07-21T19:09:29.160518+0000","last_became_active":"2023-07-21T19:09:28.171660+0000","last_became_peered":"2023-07-21T19:09:28.171660+0000","last_unstale":"2023-07-21T19:09:29.160518+0000","last_undegraded":"2023-07-21T19:09:29.160518+0000","last_fullsized":"2023-07-21T19:09:29.160518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:44:11.689198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190764+0000","last_change":"2023-07-21T19:09:29.186386+0000","last_active":"2023-07-21T19:09:29.190764+0000","last_peered":"2023-07-21T19:09:29.190764+0000","last_clean":"2023-07-21T19:09:29.190764+0000","last_became_active":"2023-07-21T19:09:29.185733+0000","last_became_peered":"2023-07-21T19:09:29.185733+0000","last_unstale":"2023-07-21T19:09:29.190764+0000","last_undegraded":"2023-07-21T19:09:29.190764+0000","last_fullsized":"2023-07-21T19:09:29.190764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:56.328014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.159438+0000","last_change":"2023-07-21T19:09:28.167294+0000","last_active":"2023-07-21T19:09:29.159438+0000","last_peered":"2023-07-21T19:09:29.159438+0000","last_clean":"2023-07-21T19:09:29.159438+0000","last_became_active":"2023-07-21T19:09:28.167020+0000","last_became_peered":"2023-07-21T19:09:28.167020+0000","last_unstale":"2023-07-21T19:09:29.159438+0000","last_undegraded":"2023-07-21T19:09:29.159438+0000","last_fullsized":"2023-07-21T19:09:29.159438+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:53:10.662686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191477+0000","last_change":"2023-07-21T19:09:29.183609+0000","last_active":"2023-07-21T19:09:29.191477+0000","last_peered":"2023-07-21T19:09:29.191477+0000","last_clean":"2023-07-21T19:09:29.191477+0000","last_became_active":"2023-07-21T19:09:29.183240+0000","last_became_peered":"2023-07-21T19:09:29.183240+0000","last_unstale":"2023-07-21T19:09:29.191477+0000","last_undegraded":"2023-07-21T19:09:29.191477+0000","last_fullsized":"2023-07-21T19:09:29.191477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:27.009165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.162272+0000","last_change":"2023-07-21T19:09:28.173396+0000","last_active":"2023-07-21T19:09:29.162272+0000","last_peered":"2023-07-21T19:09:29.162272+0000","last_clean":"2023-07-21T19:09:29.162272+0000","last_became_active":"2023-07-21T19:09:28.173109+0000","last_became_peered":"2023-07-21T19:09:28.173109+0000","last_unstale":"2023-07-21T19:09:29.162272+0000","last_undegraded":"2023-07-21T19:09:29.162272+0000","last_fullsized":"2023-07-21T19:09:29.162272+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:28.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.184925+0000","last_change":"2023-07-21T19:09:29.178659+0000","last_active":"2023-07-21T19:09:29.184925+0000","last_peered":"2023-07-21T19:09:29.184925+0000","last_clean":"2023-07-21T19:09:29.184925+0000","last_became_active":"2023-07-21T19:09:29.178411+0000","last_became_peered":"2023-07-21T19:09:29.178411+0000","last_unstale":"2023-07-21T19:09:29.184925+0000","last_undegraded":"2023-07-21T19:09:29.184925+0000","last_fullsized":"2023-07-21T19:09:29.184925+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:33:49.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190173+0000","last_change":"2023-07-21T19:09:28.170969+0000","last_active":"2023-07-21T19:09:29.190173+0000","last_peered":"2023-07-21T19:09:29.190173+0000","last_clean":"2023-07-21T19:09:29.190173+0000","last_became_active":"2023-07-21T19:09:28.170476+0000","last_became_peered":"2023-07-21T19:09:28.170476+0000","last_unstale":"2023-07-21T19:09:29.190173+0000","last_undegraded":"2023-07-21T19:09:29.190173+0000","last_fullsized":"2023-07-21T19:09:29.190173+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:40.684947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191303+0000","last_change":"2023-07-21T19:09:29.182812+0000","last_active":"2023-07-21T19:09:29.191303+0000","last_peered":"2023-07-21T19:09:29.191303+0000","last_clean":"2023-07-21T19:09:29.191303+0000","last_became_active":"2023-07-21T19:09:29.180858+0000","last_became_peered":"2023-07-21T19:09:29.180858+0000","last_unstale":"2023-07-21T19:09:29.191303+0000","last_undegraded":"2023-07-21T19:09:29.191303+0000","last_fullsized":"2023-07-21T19:09:29.191303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:57:40.914280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.194271+0000","last_change":"2023-07-21T19:09:28.167672+0000","last_active":"2023-07-21T19:09:29.194271+0000","last_peered":"2023-07-21T19:09:29.194271+0000","last_clean":"2023-07-21T19:09:29.194271+0000","last_became_active":"2023-07-21T19:09:28.167386+0000","last_became_peered":"2023-07-21T19:09:28.167386+0000","last_unstale":"2023-07-21T19:09:29.194271+0000","last_undegraded":"2023-07-21T19:09:29.194271+0000","last_fullsized":"2023-07-21T19:09:29.194271+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:39:21.248471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192038+0000","last_change":"2023-07-21T19:09:29.186758+0000","last_active":"2023-07-21T19:09:29.192038+0000","last_peered":"2023-07-21T19:09:29.192038+0000","last_clean":"2023-07-21T19:09:29.192038+0000","last_became_active":"2023-07-21T19:09:29.185023+0000","last_became_peered":"2023-07-21T19:09:29.185023+0000","last_unstale":"2023-07-21T19:09:29.192038+0000","last_undegraded":"2023-07-21T19:09:29.192038+0000","last_fullsized":"2023-07-21T19:09:29.192038+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:23.591211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188682+0000","last_change":"2023-07-21T19:09:28.171134+0000","last_active":"2023-07-21T19:09:29.188682+0000","last_peered":"2023-07-21T19:09:29.188682+0000","last_clean":"2023-07-21T19:09:29.188682+0000","last_became_active":"2023-07-21T19:09:28.170483+0000","last_became_peered":"2023-07-21T19:09:28.170483+0000","last_unstale":"2023-07-21T19:09:29.188682+0000","last_undegraded":"2023-07-21T19:09:29.188682+0000","last_fullsized":"2023-07-21T19:09:29.188682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:42.984648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182154+0000","last_change":"2023-07-21T19:09:29.174593+0000","last_active":"2023-07-21T19:09:29.182154+0000","last_peered":"2023-07-21T19:09:29.182154+0000","last_clean":"2023-07-21T19:09:29.182154+0000","last_became_active":"2023-07-21T19:09:29.174324+0000","last_became_peered":"2023-07-21T19:09:29.174324+0000","last_unstale":"2023-07-21T19:09:29.182154+0000","last_undegraded":"2023-07-21T19:09:29.182154+0000","last_fullsized":"2023-07-21T19:09:29.182154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:14.111231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.161955+0000","last_change":"2023-07-21T19:09:28.170229+0000","last_active":"2023-07-21T19:09:29.161955+0000","last_peered":"2023-07-21T19:09:29.161955+0000","last_clean":"2023-07-21T19:09:29.161955+0000","last_became_active":"2023-07-21T19:09:28.169899+0000","last_became_peered":"2023-07-21T19:09:28.169899+0000","last_unstale":"2023-07-21T19:09:29.161955+0000","last_undegraded":"2023-07-21T19:09:29.161955+0000","last_fullsized":"2023-07-21T19:09:29.161955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:42.984648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185203+0000","last_change":"2023-07-21T19:09:29.179907+0000","last_active":"2023-07-21T19:09:29.185203+0000","last_peered":"2023-07-21T19:09:29.185203+0000","last_clean":"2023-07-21T19:09:29.185203+0000","last_became_active":"2023-07-21T19:09:29.179115+0000","last_became_peered":"2023-07-21T19:09:29.179115+0000","last_unstale":"2023-07-21T19:09:29.185203+0000","last_undegraded":"2023-07-21T19:09:29.185203+0000","last_fullsized":"2023-07-21T19:09:29.185203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:19:10.636385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.169067+0000","last_change":"2023-07-21T19:09:28.174380+0000","last_active":"2023-07-21T19:09:29.169067+0000","last_peered":"2023-07-21T19:09:29.169067+0000","last_clean":"2023-07-21T19:09:29.169067+0000","last_became_active":"2023-07-21T19:09:28.174094+0000","last_became_peered":"2023-07-21T19:09:28.174094+0000","last_unstale":"2023-07-21T19:09:29.169067+0000","last_undegraded":"2023-07-21T19:09:29.169067+0000","last_fullsized":"2023-07-21T19:09:29.169067+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:13:13.262298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191430+0000","last_change":"2023-07-21T19:09:29.183360+0000","last_active":"2023-07-21T19:09:29.191430+0000","last_peered":"2023-07-21T19:09:29.191430+0000","last_clean":"2023-07-21T19:09:29.191430+0000","last_became_active":"2023-07-21T19:09:29.182902+0000","last_became_peered":"2023-07-21T19:09:29.182902+0000","last_unstale":"2023-07-21T19:09:29.191430+0000","last_undegraded":"2023-07-21T19:09:29.191430+0000","last_fullsized":"2023-07-21T19:09:29.191430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:03.877635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.194681+0000","last_change":"2023-07-21T19:09:28.171923+0000","last_active":"2023-07-21T19:09:29.194681+0000","last_peered":"2023-07-21T19:09:29.194681+0000","last_clean":"2023-07-21T19:09:29.194681+0000","last_became_active":"2023-07-21T19:09:28.170697+0000","last_became_peered":"2023-07-21T19:09:28.170697+0000","last_unstale":"2023-07-21T19:09:29.194681+0000","last_undegraded":"2023-07-21T19:09:29.194681+0000","last_fullsized":"2023-07-21T19:09:29.194681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:12.358826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.178130+0000","last_change":"2023-07-21T19:09:29.173344+0000","last_active":"2023-07-21T19:09:29.178130+0000","last_peered":"2023-07-21T19:09:29.178130+0000","last_clean":"2023-07-21T19:09:29.178130+0000","last_became_active":"2023-07-21T19:09:29.173089+0000","last_became_peered":"2023-07-21T19:09:29.173089+0000","last_unstale":"2023-07-21T19:09:29.178130+0000","last_undegraded":"2023-07-21T19:09:29.178130+0000","last_fullsized":"2023-07-21T19:09:29.178130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:23.591211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187753+0000","last_change":"2023-07-21T19:09:28.168735+0000","last_active":"2023-07-21T19:09:29.187753+0000","last_peered":"2023-07-21T19:09:29.187753+0000","last_clean":"2023-07-21T19:09:29.187753+0000","last_became_active":"2023-07-21T19:09:28.168480+0000","last_became_peered":"2023-07-21T19:09:28.168480+0000","last_unstale":"2023-07-21T19:09:29.187753+0000","last_undegraded":"2023-07-21T19:09:29.187753+0000","last_fullsized":"2023-07-21T19:09:29.187753+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:17.703519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.183351+0000","last_change":"2023-07-21T19:09:29.179089+0000","last_active":"2023-07-21T19:09:29.183351+0000","last_peered":"2023-07-21T19:09:29.183351+0000","last_clean":"2023-07-21T19:09:29.183351+0000","last_became_active":"2023-07-21T19:09:29.178801+0000","last_became_peered":"2023-07-21T19:09:29.178801+0000","last_unstale":"2023-07-21T19:09:29.183351+0000","last_undegraded":"2023-07-21T19:09:29.183351+0000","last_fullsized":"2023-07-21T19:09:29.183351+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:24:33.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.184289+0000","last_change":"2023-07-21T19:09:28.166748+0000","last_active":"2023-07-21T19:09:29.184289+0000","last_peered":"2023-07-21T19:09:29.184289+0000","last_clean":"2023-07-21T19:09:29.184289+0000","last_became_active":"2023-07-21T19:09:28.166179+0000","last_became_peered":"2023-07-21T19:09:28.166179+0000","last_unstale":"2023-07-21T19:09:29.184289+0000","last_undegraded":"2023-07-21T19:09:29.184289+0000","last_fullsized":"2023-07-21T19:09:29.184289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:15.622376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.180975+0000","last_change":"2023-07-21T19:09:29.176350+0000","last_active":"2023-07-21T19:09:29.180975+0000","last_peered":"2023-07-21T19:09:29.180975+0000","last_clean":"2023-07-21T19:09:29.180975+0000","last_became_active":"2023-07-21T19:09:29.176058+0000","last_became_peered":"2023-07-21T19:09:29.176058+0000","last_unstale":"2023-07-21T19:09:29.180975+0000","last_undegraded":"2023-07-21T19:09:29.180975+0000","last_fullsized":"2023-07-21T19:09:29.180975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:18.717579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185925+0000","last_change":"2023-07-21T19:09:28.170577+0000","last_active":"2023-07-21T19:09:29.185925+0000","last_peered":"2023-07-21T19:09:29.185925+0000","last_clean":"2023-07-21T19:09:29.185925+0000","last_became_active":"2023-07-21T19:09:28.170189+0000","last_became_peered":"2023-07-21T19:09:28.170189+0000","last_unstale":"2023-07-21T19:09:29.185925+0000","last_undegraded":"2023-07-21T19:09:29.185925+0000","last_fullsized":"2023-07-21T19:09:29.185925+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:37.559394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191965+0000","last_change":"2023-07-21T19:09:29.187247+0000","last_active":"2023-07-21T19:09:29.191965+0000","last_peered":"2023-07-21T19:09:29.191965+0000","last_clean":"2023-07-21T19:09:29.191965+0000","last_became_active":"2023-07-21T19:09:29.184618+0000","last_became_peered":"2023-07-21T19:09:29.184618+0000","last_unstale":"2023-07-21T19:09:29.191965+0000","last_undegraded":"2023-07-21T19:09:29.191965+0000","last_fullsized":"2023-07-21T19:09:29.191965+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:15:22.023926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.160559+0000","last_change":"2023-07-21T19:09:28.164471+0000","last_active":"2023-07-21T19:09:29.160559+0000","last_peered":"2023-07-21T19:09:29.160559+0000","last_clean":"2023-07-21T19:09:29.160559+0000","last_became_active":"2023-07-21T19:09:28.164200+0000","last_became_peered":"2023-07-21T19:09:28.164200+0000","last_unstale":"2023-07-21T19:09:29.160559+0000","last_undegraded":"2023-07-21T19:09:29.160559+0000","last_fullsized":"2023-07-21T19:09:29.160559+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:11:54.867975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190128+0000","last_change":"2023-07-21T19:09:29.186291+0000","last_active":"2023-07-21T19:09:29.190128+0000","last_peered":"2023-07-21T19:09:29.190128+0000","last_clean":"2023-07-21T19:09:29.190128+0000","last_became_active":"2023-07-21T19:09:29.185971+0000","last_became_peered":"2023-07-21T19:09:29.185971+0000","last_unstale":"2023-07-21T19:09:29.190128+0000","last_undegraded":"2023-07-21T19:09:29.190128+0000","last_fullsized":"2023-07-21T19:09:29.190128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:27.009165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187697+0000","last_change":"2023-07-21T19:09:28.168266+0000","last_active":"2023-07-21T19:09:29.187697+0000","last_peered":"2023-07-21T19:09:29.187697+0000","last_clean":"2023-07-21T19:09:29.187697+0000","last_became_active":"2023-07-21T19:09:28.167951+0000","last_became_peered":"2023-07-21T19:09:28.167951+0000","last_unstale":"2023-07-21T19:09:29.187697+0000","last_undegraded":"2023-07-21T19:09:29.187697+0000","last_fullsized":"2023-07-21T19:09:29.187697+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:57:39.900220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188746+0000","last_change":"2023-07-21T19:09:29.178801+0000","last_active":"2023-07-21T19:09:29.188746+0000","last_peered":"2023-07-21T19:09:29.188746+0000","last_clean":"2023-07-21T19:09:29.188746+0000","last_became_active":"2023-07-21T19:09:29.178551+0000","last_became_peered":"2023-07-21T19:09:29.178551+0000","last_unstale":"2023-07-21T19:09:29.188746+0000","last_undegraded":"2023-07-21T19:09:29.188746+0000","last_fullsized":"2023-07-21T19:09:29.188746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:53.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155965+0000","last_change":"2023-07-21T19:09:28.164341+0000","last_active":"2023-07-21T19:09:29.155965+0000","last_peered":"2023-07-21T19:09:29.155965+0000","last_clean":"2023-07-21T19:09:29.155965+0000","last_became_active":"2023-07-21T19:09:28.164085+0000","last_became_peered":"2023-07-21T19:09:28.164085+0000","last_unstale":"2023-07-21T19:09:29.155965+0000","last_undegraded":"2023-07-21T19:09:29.155965+0000","last_fullsized":"2023-07-21T19:09:29.155965+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:46:47.040863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181550+0000","last_change":"2023-07-21T19:09:29.177143+0000","last_active":"2023-07-21T19:09:29.181550+0000","last_peered":"2023-07-21T19:09:29.181550+0000","last_clean":"2023-07-21T19:09:29.181550+0000","last_became_active":"2023-07-21T19:09:29.176846+0000","last_became_peered":"2023-07-21T19:09:29.176846+0000","last_unstale":"2023-07-21T19:09:29.181550+0000","last_undegraded":"2023-07-21T19:09:29.181550+0000","last_fullsized":"2023-07-21T19:09:29.181550+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:23.232840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.158702+0000","last_change":"2023-07-21T19:09:28.175230+0000","last_active":"2023-07-21T19:09:29.158702+0000","last_peered":"2023-07-21T19:09:29.158702+0000","last_clean":"2023-07-21T19:09:29.158702+0000","last_became_active":"2023-07-21T19:09:28.174742+0000","last_became_peered":"2023-07-21T19:09:28.174742+0000","last_unstale":"2023-07-21T19:09:29.158702+0000","last_undegraded":"2023-07-21T19:09:29.158702+0000","last_fullsized":"2023-07-21T19:09:29.158702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:19.781293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181927+0000","last_change":"2023-07-21T19:09:29.169015+0000","last_active":"2023-07-21T19:09:29.181927+0000","last_peered":"2023-07-21T19:09:29.181927+0000","last_clean":"2023-07-21T19:09:29.181927+0000","last_became_active":"2023-07-21T19:09:29.168748+0000","last_became_peered":"2023-07-21T19:09:29.168748+0000","last_unstale":"2023-07-21T19:09:29.181927+0000","last_undegraded":"2023-07-21T19:09:29.181927+0000","last_fullsized":"2023-07-21T19:09:29.181927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:43.278238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165435+0000","last_change":"2023-07-21T19:09:28.170054+0000","last_active":"2023-07-21T19:09:29.165435+0000","last_peered":"2023-07-21T19:09:29.165435+0000","last_clean":"2023-07-21T19:09:29.165435+0000","last_became_active":"2023-07-21T19:09:28.169745+0000","last_became_peered":"2023-07-21T19:09:28.169745+0000","last_unstale":"2023-07-21T19:09:29.165435+0000","last_undegraded":"2023-07-21T19:09:29.165435+0000","last_fullsized":"2023-07-21T19:09:29.165435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:32.398781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182946+0000","last_change":"2023-07-21T19:09:29.176121+0000","last_active":"2023-07-21T19:09:29.182946+0000","last_peered":"2023-07-21T19:09:29.182946+0000","last_clean":"2023-07-21T19:09:29.182946+0000","last_became_active":"2023-07-21T19:09:29.175849+0000","last_became_peered":"2023-07-21T19:09:29.175849+0000","last_unstale":"2023-07-21T19:09:29.182946+0000","last_undegraded":"2023-07-21T19:09:29.182946+0000","last_fullsized":"2023-07-21T19:09:29.182946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:13:08.635685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165835+0000","last_change":"2023-07-21T19:09:28.170078+0000","last_active":"2023-07-21T19:09:29.165835+0000","last_peered":"2023-07-21T19:09:29.165835+0000","last_clean":"2023-07-21T19:09:29.165835+0000","last_became_active":"2023-07-21T19:09:28.169766+0000","last_became_peered":"2023-07-21T19:09:28.169766+0000","last_unstale":"2023-07-21T19:09:29.165835+0000","last_undegraded":"2023-07-21T19:09:29.165835+0000","last_fullsized":"2023-07-21T19:09:29.165835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:48.739861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165501+0000","last_change":"2023-07-21T19:07:42.363227+0000","last_active":"2023-07-21T19:09:29.165501+0000","last_peered":"2023-07-21T19:09:29.165501+0000","last_clean":"2023-07-21T19:09:29.165501+0000","last_became_active":"2023-07-21T19:07:42.362873+0000","last_became_peered":"2023-07-21T19:07:42.362873+0000","last_unstale":"2023-07-21T19:09:29.165501+0000","last_undegraded":"2023-07-21T19:09:29.165501+0000","last_fullsized":"2023-07-21T19:09:29.165501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:47:39.173333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190160+0000","last_change":"2023-07-21T19:09:29.185366+0000","last_active":"2023-07-21T19:09:29.190160+0000","last_peered":"2023-07-21T19:09:29.190160+0000","last_clean":"2023-07-21T19:09:29.190160+0000","last_became_active":"2023-07-21T19:09:29.179032+0000","last_became_peered":"2023-07-21T19:09:29.179032+0000","last_unstale":"2023-07-21T19:09:29.190160+0000","last_undegraded":"2023-07-21T19:09:29.190160+0000","last_fullsized":"2023-07-21T19:09:29.190160+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:51.334988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.153765+0000","last_change":"2023-07-21T19:09:28.164950+0000","last_active":"2023-07-21T19:09:29.153765+0000","last_peered":"2023-07-21T19:09:29.153765+0000","last_clean":"2023-07-21T19:09:29.153765+0000","last_became_active":"2023-07-21T19:09:28.164660+0000","last_became_peered":"2023-07-21T19:09:28.164660+0000","last_unstale":"2023-07-21T19:09:29.153765+0000","last_undegraded":"2023-07-21T19:09:29.153765+0000","last_fullsized":"2023-07-21T19:09:29.153765+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:41.025414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155468+0000","last_change":"2023-07-21T19:07:42.367585+0000","last_active":"2023-07-21T19:09:29.155468+0000","last_peered":"2023-07-21T19:09:29.155468+0000","last_clean":"2023-07-21T19:09:29.155468+0000","last_became_active":"2023-07-21T19:07:42.367246+0000","last_became_peered":"2023-07-21T19:07:42.367246+0000","last_unstale":"2023-07-21T19:09:29.155468+0000","last_undegraded":"2023-07-21T19:09:29.155468+0000","last_fullsized":"2023-07-21T19:09:29.155468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:06.564330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.179159+0000","last_change":"2023-07-21T19:09:29.169039+0000","last_active":"2023-07-21T19:09:29.179159+0000","last_peered":"2023-07-21T19:09:29.179159+0000","last_clean":"2023-07-21T19:09:29.179159+0000","last_became_active":"2023-07-21T19:09:29.168753+0000","last_became_peered":"2023-07-21T19:09:29.168753+0000","last_unstale":"2023-07-21T19:09:29.179159+0000","last_undegraded":"2023-07-21T19:09:29.179159+0000","last_fullsized":"2023-07-21T19:09:29.179159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:12:14.885142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155738+0000","last_change":"2023-07-21T19:09:28.163863+0000","last_active":"2023-07-21T19:09:29.155738+0000","last_peered":"2023-07-21T19:09:29.155738+0000","last_clean":"2023-07-21T19:09:29.155738+0000","last_became_active":"2023-07-21T19:09:28.163594+0000","last_became_peered":"2023-07-21T19:09:28.163594+0000","last_unstale":"2023-07-21T19:09:29.155738+0000","last_undegraded":"2023-07-21T19:09:29.155738+0000","last_fullsized":"2023-07-21T19:09:29.155738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:28.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.166834+0000","last_change":"2023-07-21T19:07:42.365391+0000","last_active":"2023-07-21T19:09:29.166834+0000","last_peered":"2023-07-21T19:09:29.166834+0000","last_clean":"2023-07-21T19:09:29.166834+0000","last_became_active":"2023-07-21T19:07:42.364406+0000","last_became_peered":"2023-07-21T19:07:42.364406+0000","last_unstale":"2023-07-21T19:09:29.166834+0000","last_undegraded":"2023-07-21T19:09:29.166834+0000","last_fullsized":"2023-07-21T19:09:29.166834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:41.746238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181538+0000","last_change":"2023-07-21T19:09:29.173077+0000","last_active":"2023-07-21T19:09:29.181538+0000","last_peered":"2023-07-21T19:09:29.181538+0000","last_clean":"2023-07-21T19:09:29.181538+0000","last_became_active":"2023-07-21T19:09:29.172809+0000","last_became_peered":"2023-07-21T19:09:29.172809+0000","last_unstale":"2023-07-21T19:09:29.181538+0000","last_undegraded":"2023-07-21T19:09:29.181538+0000","last_fullsized":"2023-07-21T19:09:29.181538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:14.808883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.160827+0000","last_change":"2023-07-21T19:09:28.176023+0000","last_active":"2023-07-21T19:09:29.160827+0000","last_peered":"2023-07-21T19:09:29.160827+0000","last_clean":"2023-07-21T19:09:29.160827+0000","last_became_active":"2023-07-21T19:09:28.175763+0000","last_became_peered":"2023-07-21T19:09:28.175763+0000","last_unstale":"2023-07-21T19:09:29.160827+0000","last_undegraded":"2023-07-21T19:09:29.160827+0000","last_fullsized":"2023-07-21T19:09:29.160827+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:38:52.333567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.154602+0000","last_change":"2023-07-21T19:07:42.367917+0000","last_active":"2023-07-21T19:09:29.154602+0000","last_peered":"2023-07-21T19:09:29.154602+0000","last_clean":"2023-07-21T19:09:29.154602+0000","last_became_active":"2023-07-21T19:07:42.367308+0000","last_became_peered":"2023-07-21T19:07:42.367308+0000","last_unstale":"2023-07-21T19:09:29.154602+0000","last_undegraded":"2023-07-21T19:09:29.154602+0000","last_fullsized":"2023-07-21T19:09:29.154602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:34.012056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192064+0000","last_change":"2023-07-21T19:09:29.188044+0000","last_active":"2023-07-21T19:09:29.192064+0000","last_peered":"2023-07-21T19:09:29.192064+0000","last_clean":"2023-07-21T19:09:29.192064+0000","last_became_active":"2023-07-21T19:09:29.187722+0000","last_became_peered":"2023-07-21T19:09:29.187722+0000","last_unstale":"2023-07-21T19:09:29.192064+0000","last_undegraded":"2023-07-21T19:09:29.192064+0000","last_fullsized":"2023-07-21T19:09:29.192064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:19:21.045563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.163764+0000","last_change":"2023-07-21T19:09:28.165530+0000","last_active":"2023-07-21T19:09:29.163764+0000","last_peered":"2023-07-21T19:09:29.163764+0000","last_clean":"2023-07-21T19:09:29.163764+0000","last_became_active":"2023-07-21T19:09:28.164845+0000","last_became_peered":"2023-07-21T19:09:28.164845+0000","last_unstale":"2023-07-21T19:09:29.163764+0000","last_undegraded":"2023-07-21T19:09:29.163764+0000","last_fullsized":"2023-07-21T19:09:29.163764+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:07.104316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.156058+0000","last_change":"2023-07-21T19:07:42.362561+0000","last_active":"2023-07-21T19:09:29.156058+0000","last_peered":"2023-07-21T19:09:29.156058+0000","last_clean":"2023-07-21T19:09:29.156058+0000","last_became_active":"2023-07-21T19:07:42.362127+0000","last_became_peered":"2023-07-21T19:07:42.362127+0000","last_unstale":"2023-07-21T19:09:29.156058+0000","last_undegraded":"2023-07-21T19:09:29.156058+0000","last_fullsized":"2023-07-21T19:09:29.156058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:08:49.833527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185589+0000","last_change":"2023-07-21T19:09:29.170311+0000","last_active":"2023-07-21T19:09:29.185589+0000","last_peered":"2023-07-21T19:09:29.185589+0000","last_clean":"2023-07-21T19:09:29.185589+0000","last_became_active":"2023-07-21T19:09:29.170021+0000","last_became_peered":"2023-07-21T19:09:29.170021+0000","last_unstale":"2023-07-21T19:09:29.185589+0000","last_undegraded":"2023-07-21T19:09:29.185589+0000","last_fullsized":"2023-07-21T19:09:29.185589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:16:31.425268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.166757+0000","last_change":"2023-07-21T19:09:28.171096+0000","last_active":"2023-07-21T19:09:29.166757+0000","last_peered":"2023-07-21T19:09:29.166757+0000","last_clean":"2023-07-21T19:09:29.166757+0000","last_became_active":"2023-07-21T19:09:28.170832+0000","last_became_peered":"2023-07-21T19:09:28.170832+0000","last_unstale":"2023-07-21T19:09:29.166757+0000","last_undegraded":"2023-07-21T19:09:29.166757+0000","last_fullsized":"2023-07-21T19:09:29.166757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:36:07.290422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.157833+0000","last_change":"2023-07-21T19:07:42.603235+0000","last_active":"2023-07-21T19:09:29.157833+0000","last_peered":"2023-07-21T19:09:29.157833+0000","last_clean":"2023-07-21T19:09:29.157833+0000","last_became_active":"2023-07-21T19:07:42.602762+0000","last_became_peered":"2023-07-21T19:07:42.602762+0000","last_unstale":"2023-07-21T19:09:29.157833+0000","last_undegraded":"2023-07-21T19:09:29.157833+0000","last_fullsized":"2023-07-21T19:09:29.157833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:40.200924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191204+0000","last_change":"2023-07-21T19:09:29.178811+0000","last_active":"2023-07-21T19:09:29.191204+0000","last_peered":"2023-07-21T19:09:29.191204+0000","last_clean":"2023-07-21T19:09:29.191204+0000","last_became_active":"2023-07-21T19:09:29.178477+0000","last_became_peered":"2023-07-21T19:09:29.178477+0000","last_unstale":"2023-07-21T19:09:29.191204+0000","last_undegraded":"2023-07-21T19:09:29.191204+0000","last_fullsized":"2023-07-21T19:09:29.191204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:12:27.095182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.154760+0000","last_change":"2023-07-21T19:09:28.168752+0000","last_active":"2023-07-21T19:09:29.154760+0000","last_peered":"2023-07-21T19:09:29.154760+0000","last_clean":"2023-07-21T19:09:29.154760+0000","last_became_active":"2023-07-21T19:09:28.168490+0000","last_became_peered":"2023-07-21T19:09:28.168490+0000","last_unstale":"2023-07-21T19:09:29.154760+0000","last_undegraded":"2023-07-21T19:09:29.154760+0000","last_fullsized":"2023-07-21T19:09:29.154760+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:55.732644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165213+0000","last_change":"2023-07-21T19:07:42.365054+0000","last_active":"2023-07-21T19:09:29.165213+0000","last_peered":"2023-07-21T19:09:29.165213+0000","last_clean":"2023-07-21T19:09:29.165213+0000","last_became_active":"2023-07-21T19:07:42.364497+0000","last_became_peered":"2023-07-21T19:07:42.364497+0000","last_unstale":"2023-07-21T19:09:29.165213+0000","last_undegraded":"2023-07-21T19:09:29.165213+0000","last_fullsized":"2023-07-21T19:09:29.165213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:54.576141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.186501+0000","last_change":"2023-07-21T19:09:29.182478+0000","last_active":"2023-07-21T19:09:29.186501+0000","last_peered":"2023-07-21T19:09:29.186501+0000","last_clean":"2023-07-21T19:09:29.186501+0000","last_became_active":"2023-07-21T19:09:29.182165+0000","last_became_peered":"2023-07-21T19:09:29.182165+0000","last_unstale":"2023-07-21T19:09:29.186501+0000","last_undegraded":"2023-07-21T19:09:29.186501+0000","last_fullsized":"2023-07-21T19:09:29.186501+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:56.746703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181576+0000","last_change":"2023-07-21T19:09:28.170874+0000","last_active":"2023-07-21T19:09:29.181576+0000","last_peered":"2023-07-21T19:09:29.181576+0000","last_clean":"2023-07-21T19:09:29.181576+0000","last_became_active":"2023-07-21T19:09:28.169722+0000","last_became_peered":"2023-07-21T19:09:28.169722+0000","last_unstale":"2023-07-21T19:09:29.181576+0000","last_undegraded":"2023-07-21T19:09:29.181576+0000","last_fullsized":"2023-07-21T19:09:29.181576+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:54.343748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.157136+0000","last_change":"2023-07-21T19:07:42.362560+0000","last_active":"2023-07-21T19:09:29.157136+0000","last_peered":"2023-07-21T19:09:29.157136+0000","last_clean":"2023-07-21T19:09:29.157136+0000","last_became_active":"2023-07-21T19:07:42.362066+0000","last_became_peered":"2023-07-21T19:07:42.362066+0000","last_unstale":"2023-07-21T19:09:29.157136+0000","last_undegraded":"2023-07-21T19:09:29.157136+0000","last_fullsized":"2023-07-21T19:09:29.157136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:36.502119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165520+0000","last_change":"2023-07-21T19:07:37.495346+0000","last_active":"2023-07-21T19:09:29.165520+0000","last_peered":"2023-07-21T19:09:29.165520+0000","last_clean":"2023-07-21T19:09:29.165520+0000","last_became_active":"2023-07-21T19:07:37.492842+0000","last_became_peered":"2023-07-21T19:07:37.492842+0000","last_unstale":"2023-07-21T19:09:29.165520+0000","last_undegraded":"2023-07-21T19:09:29.165520+0000","last_fullsized":"2023-07-21T19:09:29.165520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_clean_scrub_stamp":"2023-07-21T19:07:36.226507+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:24:55.807126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1085440,"data_stored":808073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.248}]},{"osd":1,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.397},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.141}]},{"osd":2,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.427},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":4.1379999999999999,"5min":4.1379999999999999,"15min":4.1379999999999999},"last":1.492}]},{"osd":3,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.611}]},{"osd":4,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":8.2520000000000007,"5min":8.2520000000000007,"15min":8.2520000000000007},"last":1.357}]},{"osd":5,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.444}]},{"osd":6,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.4730000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":495616,"data_stored":218287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.0740000000000001}]},{"osd":1,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.179},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.135}]},{"osd":2,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.999}]},{"osd":3,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.22}]},{"osd":4,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.421}]},{"osd":5,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.304}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":217685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.497},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.63}]},{"osd":3,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":210167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.0840000000000001}]},{"osd":2,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.4259999999999999}]},{"osd":3,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.23},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":2.9950000000000001},"last":1.496}]},{"osd":7,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.163},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.2829999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":218253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.87},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.81100000000000005}]},{"osd":6,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":219201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.323,"5min":3.323,"15min":3.323},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.876}]},{"osd":6,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":2.9430000000000001,"5min":2.9430000000000001,"15min":2.9430000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.0189999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":217685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.119},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.95999999999999996}]},{"osd":4,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.3029999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":808017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.03},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.391}]},{"osd":2,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.179}]},{"osd":3,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1279999999999999}]},{"osd":4,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.353},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.466},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.325},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.5640000000000001}]},{"osd":7,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.518},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.2370000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T19:09:33.860 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T19:09:34.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.050+0000 7fd59b258700 1 Processor -- start 2023-07-21T19:09:34.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.050+0000 7fd59b258700 1 -- start start 2023-07-21T19:09:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd59b258700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940d1430 0x7fd5940b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd59b258700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59415c2f0 con 0x7fd59415bf20 2023-07-21T19:09:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd59b258700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd594070830 con 0x7fd5940b1530 2023-07-21T19:09:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd59b258700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b5b30 con 0x7fd5940d1430 2023-07-21T19:09:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd598ff4700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd59415bf20 0x7fd5940b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52104/0 (socket says 172.21.15.123:52104) 2023-07-21T19:09:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd598ff4700 1 -- 172.21.15.123:0/2588783549 learned_addr learned my addr 172.21.15.123:0/2588783549 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd5997f5700 1 --2- 172.21.15.123:0/2588783549 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940d1430 0x7fd5940b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876981755 0 0) 0x7fd59415c2f0 con 0x7fd59415bf20 2023-07-21T19:09:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5840035d0 con 0x7fd59415bf20 2023-07-21T19:09:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756784782 0 0) 0x7fd594070830 con 0x7fd5940b1530 2023-07-21T19:09:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.054+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd59415c2f0 con 0x7fd5940b1530 2023-07-21T19:09:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5997f5700 1 -- 172.21.15.123:0/2588783549 >> v1:172.21.15.145:6789/0 conn(0x7fd5940b1530 legacy=0x7fd5940d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5997f5700 1 -- 172.21.15.123:0/2588783549 >> v1:172.21.15.123:6789/0 conn(0x7fd59415bf20 legacy=0x7fd5940b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003652676 0 0) 0x7fd5840035d0 con 0x7fd59415bf20 2023-07-21T19:09:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5997f5700 1 -- 172.21.15.123:0/2588783549 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594070b10 con 0x7fd5940d1430 2023-07-21T19:09:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5997f5700 1 --2- 172.21.15.123:0/2588783549 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940d1430 0x7fd5940b4050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009dc0 tx=0x7fd58c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea426ca234ce0f41 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00e070 con 0x7fd5940d1430 2023-07-21T19:09:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c003a40 con 0x7fd5940d1430 2023-07-21T19:09:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd5937fe700 1 -- 172.21.15.123:0/2588783549 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588001670 con 0x7fd5940d1430 2023-07-21T19:09:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 -- 172.21.15.123:0/2588783549 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940d1430 msgr2=0x7fd5940b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 --2- 172.21.15.123:0/2588783549 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940d1430 0x7fd5940b4050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009dc0 tx=0x7fd58c00b330 comp rx=0 tx=0).stop 2023-07-21T19:09:34.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 -- 172.21.15.123:0/2588783549 shutdown_connections 2023-07-21T19:09:34.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 --2- 172.21.15.123:0/2588783549 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940d1430 0x7fd5940b4050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 -- 172.21.15.123:0/2588783549 >> 172.21.15.123:0/2588783549 conn(0x7fd59406fc80 msgr2=0x7fd594070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:34.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 -- 172.21.15.123:0/2588783549 shutdown_connections 2023-07-21T19:09:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.058+0000 7fd59b258700 1 -- 172.21.15.123:0/2588783549 wait complete. 2023-07-21T19:09:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 Processor -- start 2023-07-21T19:09:34.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 -- start start 2023-07-21T19:09:34.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940b1530 0x7fd59414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 0x7fd59415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd59415bf20 0x7fd59415df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59415c4e0 con 0x7fd5940d1430 2023-07-21T19:09:34.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59415cd80 con 0x7fd59415bf20 2023-07-21T19:09:34.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.062+0000 7fd59b258700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59415d750 con 0x7fd5940b1530 2023-07-21T19:09:34.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 0x7fd59415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 0x7fd59415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47436/0 (socket says 172.21.15.123:47436) 2023-07-21T19:09:34.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 -- 172.21.15.123:0/695114786 learned_addr learned my addr 172.21.15.123:0/695114786 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:34.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd598ff4700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940b1530 0x7fd59414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd5997f5700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd59415bf20 0x7fd59415df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 -- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940b1530 msgr2=0x7fd59414a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940b1530 0x7fd59414a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 -- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd59415bf20 msgr2=0x7fd59415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd59415bf20 0x7fd59415df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 -- 172.21.15.123:0/695114786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c009a70 con 0x7fd5940d1430 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd5997f5700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd59415bf20 0x7fd59415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd593fff700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 0x7fd59415d210 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c450 tx=0x7fd58000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800052d0 con 0x7fd5940d1430 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580005450 con 0x7fd5940d1430 2023-07-21T19:09:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800038e0 con 0x7fd5940d1430 2023-07-21T19:09:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59415e9a0 con 0x7fd5940d1430 2023-07-21T19:09:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59415ca10 con 0x7fd5940d1430 2023-07-21T19:09:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.066+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59404dcb0 con 0x7fd5940d1430 2023-07-21T19:09:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.070+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd580003a40 con 0x7fd5940d1430 2023-07-21T19:09:34.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.070+0000 7fd5917fa700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd578066320 0x7fd5780687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.070+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd580083190 con 0x7fd5940d1430 2023-07-21T19:09:34.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.074+0000 7fd598ff4700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd578066320 0x7fd5780687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.074+0000 7fd598ff4700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd578066320 0x7fd5780687d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd588000f60 tx=0x7fd588001e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.078+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd580050560 con 0x7fd5940d1430 2023-07-21T19:09:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.242+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 --> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5940ccfa0 con 0x7fd578066320 2023-07-21T19:09:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.258+0000 7fd5917fa700 1 -- 172.21.15.123:0/695114786 <== mgr.4104 v2:172.21.15.123:6832/1650121890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309023 (secure 0 0 0) 0x7fd58800f690 con 0x7fd578066320 2023-07-21T19:09:34.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd578066320 msgr2=0x7fd5780687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd578066320 0x7fd5780687d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd588000f60 tx=0x7fd588001e20 comp rx=0 tx=0).stop 2023-07-21T19:09:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 msgr2=0x7fd59415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 0x7fd59415d210 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c450 tx=0x7fd58000c760 comp rx=0 tx=0).stop 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 shutdown_connections 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fd578066320 0x7fd5780687d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd59415bf20 0x7fd59415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5940d1430 0x7fd59415d210 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 --2- 172.21.15.123:0/695114786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5940b1530 0x7fd59414a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 >> 172.21.15.123:0/695114786 conn(0x7fd59406fc80 msgr2=0x7fd5940b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:34.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 shutdown_connections 2023-07-21T19:09:34.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.266+0000 7fd59b258700 1 -- 172.21.15.123:0/695114786 wait complete. 2023-07-21T19:09:34.281 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-07-21T19:09:34.301 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-07-21T19:09:33.916440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224720,"kb_used_data":5008,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750000,"statfs":{"total":773094113280,"available":772864000000,"internally_reserved":0,"allocated":5128192,"data_stored":2917368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001574"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191196+0000","last_change":"2023-07-21T19:09:29.178742+0000","last_active":"2023-07-21T19:09:29.191196+0000","last_peered":"2023-07-21T19:09:29.191196+0000","last_clean":"2023-07-21T19:09:29.191196+0000","last_became_active":"2023-07-21T19:09:29.178411+0000","last_became_peered":"2023-07-21T19:09:29.178411+0000","last_unstale":"2023-07-21T19:09:29.191196+0000","last_undegraded":"2023-07-21T19:09:29.191196+0000","last_fullsized":"2023-07-21T19:09:29.191196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:13:14.276357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190701+0000","last_change":"2023-07-21T19:09:29.182718+0000","last_active":"2023-07-21T19:09:29.190701+0000","last_peered":"2023-07-21T19:09:29.190701+0000","last_clean":"2023-07-21T19:09:29.190701+0000","last_became_active":"2023-07-21T19:09:29.182394+0000","last_became_peered":"2023-07-21T19:09:29.182394+0000","last_unstale":"2023-07-21T19:09:29.190701+0000","last_undegraded":"2023-07-21T19:09:29.190701+0000","last_fullsized":"2023-07-21T19:09:29.190701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:37.895956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.177588+0000","last_change":"2023-07-21T19:09:29.168884+0000","last_active":"2023-07-21T19:09:29.177588+0000","last_peered":"2023-07-21T19:09:29.177588+0000","last_clean":"2023-07-21T19:09:29.177588+0000","last_became_active":"2023-07-21T19:09:29.168615+0000","last_became_peered":"2023-07-21T19:09:29.168615+0000","last_unstale":"2023-07-21T19:09:29.177588+0000","last_undegraded":"2023-07-21T19:09:29.177588+0000","last_fullsized":"2023-07-21T19:09:29.177588+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:11.032020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185611+0000","last_change":"2023-07-21T19:09:29.178955+0000","last_active":"2023-07-21T19:09:29.185611+0000","last_peered":"2023-07-21T19:09:29.185611+0000","last_clean":"2023-07-21T19:09:29.185611+0000","last_became_active":"2023-07-21T19:09:29.178599+0000","last_became_peered":"2023-07-21T19:09:29.178599+0000","last_unstale":"2023-07-21T19:09:29.185611+0000","last_undegraded":"2023-07-21T19:09:29.185611+0000","last_fullsized":"2023-07-21T19:09:29.185611+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:10.654538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190740+0000","last_change":"2023-07-21T19:09:29.180724+0000","last_active":"2023-07-21T19:09:29.190740+0000","last_peered":"2023-07-21T19:09:29.190740+0000","last_clean":"2023-07-21T19:09:29.190740+0000","last_became_active":"2023-07-21T19:09:29.180449+0000","last_became_peered":"2023-07-21T19:09:29.180449+0000","last_unstale":"2023-07-21T19:09:29.190740+0000","last_undegraded":"2023-07-21T19:09:29.190740+0000","last_fullsized":"2023-07-21T19:09:29.190740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:03.877635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187455+0000","last_change":"2023-07-21T19:09:29.183485+0000","last_active":"2023-07-21T19:09:29.187455+0000","last_peered":"2023-07-21T19:09:29.187455+0000","last_clean":"2023-07-21T19:09:29.187455+0000","last_became_active":"2023-07-21T19:09:29.183075+0000","last_became_peered":"2023-07-21T19:09:29.183075+0000","last_unstale":"2023-07-21T19:09:29.187455+0000","last_undegraded":"2023-07-21T19:09:29.187455+0000","last_fullsized":"2023-07-21T19:09:29.187455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:12:27.095182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191243+0000","last_change":"2023-07-21T19:09:29.181177+0000","last_active":"2023-07-21T19:09:29.191243+0000","last_peered":"2023-07-21T19:09:29.191243+0000","last_clean":"2023-07-21T19:09:29.191243+0000","last_became_active":"2023-07-21T19:09:29.180881+0000","last_became_peered":"2023-07-21T19:09:29.180881+0000","last_unstale":"2023-07-21T19:09:29.191243+0000","last_undegraded":"2023-07-21T19:09:29.191243+0000","last_fullsized":"2023-07-21T19:09:29.191243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:34.055455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190872+0000","last_change":"2023-07-21T19:09:29.187237+0000","last_active":"2023-07-21T19:09:29.190872+0000","last_peered":"2023-07-21T19:09:29.190872+0000","last_clean":"2023-07-21T19:09:29.190872+0000","last_became_active":"2023-07-21T19:09:29.185591+0000","last_became_peered":"2023-07-21T19:09:29.185591+0000","last_unstale":"2023-07-21T19:09:29.190872+0000","last_undegraded":"2023-07-21T19:09:29.190872+0000","last_fullsized":"2023-07-21T19:09:29.190872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:48:30.095724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181792+0000","last_change":"2023-07-21T19:09:29.169031+0000","last_active":"2023-07-21T19:09:29.181792+0000","last_peered":"2023-07-21T19:09:29.181792+0000","last_clean":"2023-07-21T19:09:29.181792+0000","last_became_active":"2023-07-21T19:09:29.168734+0000","last_became_peered":"2023-07-21T19:09:29.168734+0000","last_unstale":"2023-07-21T19:09:29.181792+0000","last_undegraded":"2023-07-21T19:09:29.181792+0000","last_fullsized":"2023-07-21T19:09:29.181792+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:59.468564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.186483+0000","last_change":"2023-07-21T19:09:29.179790+0000","last_active":"2023-07-21T19:09:29.186483+0000","last_peered":"2023-07-21T19:09:29.186483+0000","last_clean":"2023-07-21T19:09:29.186483+0000","last_became_active":"2023-07-21T19:09:29.179419+0000","last_became_peered":"2023-07-21T19:09:29.179419+0000","last_unstale":"2023-07-21T19:09:29.186483+0000","last_undegraded":"2023-07-21T19:09:29.186483+0000","last_fullsized":"2023-07-21T19:09:29.186483+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:05:42.019660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182042+0000","last_change":"2023-07-21T19:09:29.169017+0000","last_active":"2023-07-21T19:09:29.182042+0000","last_peered":"2023-07-21T19:09:29.182042+0000","last_clean":"2023-07-21T19:09:29.182042+0000","last_became_active":"2023-07-21T19:09:29.168712+0000","last_became_peered":"2023-07-21T19:09:29.168712+0000","last_unstale":"2023-07-21T19:09:29.182042+0000","last_undegraded":"2023-07-21T19:09:29.182042+0000","last_fullsized":"2023-07-21T19:09:29.182042+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:53.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182012+0000","last_change":"2023-07-21T19:09:29.175439+0000","last_active":"2023-07-21T19:09:29.182012+0000","last_peered":"2023-07-21T19:09:29.182012+0000","last_clean":"2023-07-21T19:09:29.182012+0000","last_became_active":"2023-07-21T19:09:29.175198+0000","last_became_peered":"2023-07-21T19:09:29.175198+0000","last_unstale":"2023-07-21T19:09:29.182012+0000","last_undegraded":"2023-07-21T19:09:29.182012+0000","last_fullsized":"2023-07-21T19:09:29.182012+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:15:53.667235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188151+0000","last_change":"2023-07-21T19:09:29.185170+0000","last_active":"2023-07-21T19:09:29.188151+0000","last_peered":"2023-07-21T19:09:29.188151+0000","last_clean":"2023-07-21T19:09:29.188151+0000","last_became_active":"2023-07-21T19:09:29.184769+0000","last_became_peered":"2023-07-21T19:09:29.184769+0000","last_unstale":"2023-07-21T19:09:29.188151+0000","last_undegraded":"2023-07-21T19:09:29.188151+0000","last_fullsized":"2023-07-21T19:09:29.188151+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:00.340466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181955+0000","last_change":"2023-07-21T19:09:29.169451+0000","last_active":"2023-07-21T19:09:29.181955+0000","last_peered":"2023-07-21T19:09:29.181955+0000","last_clean":"2023-07-21T19:09:29.181955+0000","last_became_active":"2023-07-21T19:09:29.169156+0000","last_became_peered":"2023-07-21T19:09:29.169156+0000","last_unstale":"2023-07-21T19:09:29.181955+0000","last_undegraded":"2023-07-21T19:09:29.181955+0000","last_fullsized":"2023-07-21T19:09:29.181955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:50.125895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185276+0000","last_change":"2023-07-21T19:09:29.182087+0000","last_active":"2023-07-21T19:09:29.185276+0000","last_peered":"2023-07-21T19:09:29.185276+0000","last_clean":"2023-07-21T19:09:29.185276+0000","last_became_active":"2023-07-21T19:09:29.181831+0000","last_became_peered":"2023-07-21T19:09:29.181831+0000","last_unstale":"2023-07-21T19:09:29.185276+0000","last_undegraded":"2023-07-21T19:09:29.185276+0000","last_fullsized":"2023-07-21T19:09:29.185276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:41.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192203+0000","last_change":"2023-07-21T19:09:29.188313+0000","last_active":"2023-07-21T19:09:29.192203+0000","last_peered":"2023-07-21T19:09:29.192203+0000","last_clean":"2023-07-21T19:09:29.192203+0000","last_became_active":"2023-07-21T19:09:29.185092+0000","last_became_peered":"2023-07-21T19:09:29.185092+0000","last_unstale":"2023-07-21T19:09:29.192203+0000","last_undegraded":"2023-07-21T19:09:29.192203+0000","last_fullsized":"2023-07-21T19:09:29.192203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:33.700361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.164151+0000","last_change":"2023-07-21T19:09:29.161246+0000","last_active":"2023-07-21T19:09:29.164151+0000","last_peered":"2023-07-21T19:09:29.164151+0000","last_clean":"2023-07-21T19:09:29.164151+0000","last_became_active":"2023-07-21T19:09:29.160977+0000","last_became_peered":"2023-07-21T19:09:29.160977+0000","last_unstale":"2023-07-21T19:09:29.164151+0000","last_undegraded":"2023-07-21T19:09:29.164151+0000","last_fullsized":"2023-07-21T19:09:29.164151+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:46:46.136748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190783+0000","last_change":"2023-07-21T19:09:29.186599+0000","last_active":"2023-07-21T19:09:29.190783+0000","last_peered":"2023-07-21T19:09:29.190783+0000","last_clean":"2023-07-21T19:09:29.190783+0000","last_became_active":"2023-07-21T19:09:29.186108+0000","last_became_peered":"2023-07-21T19:09:29.186108+0000","last_unstale":"2023-07-21T19:09:29.190783+0000","last_undegraded":"2023-07-21T19:09:29.190783+0000","last_fullsized":"2023-07-21T19:09:29.190783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:06.190198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191984+0000","last_change":"2023-07-21T19:09:29.187434+0000","last_active":"2023-07-21T19:09:29.191984+0000","last_peered":"2023-07-21T19:09:29.191984+0000","last_clean":"2023-07-21T19:09:29.191984+0000","last_became_active":"2023-07-21T19:09:29.185131+0000","last_became_peered":"2023-07-21T19:09:29.185131+0000","last_unstale":"2023-07-21T19:09:29.191984+0000","last_undegraded":"2023-07-21T19:09:29.191984+0000","last_fullsized":"2023-07-21T19:09:29.191984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:09:08.746077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192306+0000","last_change":"2023-07-21T19:09:29.189639+0000","last_active":"2023-07-21T19:09:29.192306+0000","last_peered":"2023-07-21T19:09:29.192306+0000","last_clean":"2023-07-21T19:09:29.192306+0000","last_became_active":"2023-07-21T19:09:29.189172+0000","last_became_peered":"2023-07-21T19:09:29.189172+0000","last_unstale":"2023-07-21T19:09:29.192306+0000","last_undegraded":"2023-07-21T19:09:29.192306+0000","last_fullsized":"2023-07-21T19:09:29.192306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:49:25.956629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185517+0000","last_change":"2023-07-21T19:09:29.181091+0000","last_active":"2023-07-21T19:09:29.185517+0000","last_peered":"2023-07-21T19:09:29.185517+0000","last_clean":"2023-07-21T19:09:29.185517+0000","last_became_active":"2023-07-21T19:09:29.179353+0000","last_became_peered":"2023-07-21T19:09:29.179353+0000","last_unstale":"2023-07-21T19:09:29.185517+0000","last_undegraded":"2023-07-21T19:09:29.185517+0000","last_fullsized":"2023-07-21T19:09:29.185517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:10.139361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185303+0000","last_change":"2023-07-21T19:09:29.180323+0000","last_active":"2023-07-21T19:09:29.185303+0000","last_peered":"2023-07-21T19:09:29.185303+0000","last_clean":"2023-07-21T19:09:29.185303+0000","last_became_active":"2023-07-21T19:09:29.180058+0000","last_became_peered":"2023-07-21T19:09:29.180058+0000","last_unstale":"2023-07-21T19:09:29.185303+0000","last_undegraded":"2023-07-21T19:09:29.185303+0000","last_fullsized":"2023-07-21T19:09:29.185303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:42.375445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192088+0000","last_change":"2023-07-21T19:09:29.187210+0000","last_active":"2023-07-21T19:09:29.192088+0000","last_peered":"2023-07-21T19:09:29.192088+0000","last_clean":"2023-07-21T19:09:29.192088+0000","last_became_active":"2023-07-21T19:09:29.185248+0000","last_became_peered":"2023-07-21T19:09:29.185248+0000","last_unstale":"2023-07-21T19:09:29.192088+0000","last_undegraded":"2023-07-21T19:09:29.192088+0000","last_fullsized":"2023-07-21T19:09:29.192088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:45:13.551045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188050+0000","last_change":"2023-07-21T19:09:29.179726+0000","last_active":"2023-07-21T19:09:29.188050+0000","last_peered":"2023-07-21T19:09:29.188050+0000","last_clean":"2023-07-21T19:09:29.188050+0000","last_became_active":"2023-07-21T19:09:29.179312+0000","last_became_peered":"2023-07-21T19:09:29.179312+0000","last_unstale":"2023-07-21T19:09:29.188050+0000","last_undegraded":"2023-07-21T19:09:29.188050+0000","last_fullsized":"2023-07-21T19:09:29.188050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:38:32.081489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192178+0000","last_change":"2023-07-21T19:09:29.188356+0000","last_active":"2023-07-21T19:09:29.192178+0000","last_peered":"2023-07-21T19:09:29.192178+0000","last_clean":"2023-07-21T19:09:29.192178+0000","last_became_active":"2023-07-21T19:09:29.184208+0000","last_became_peered":"2023-07-21T19:09:29.184208+0000","last_unstale":"2023-07-21T19:09:29.192178+0000","last_undegraded":"2023-07-21T19:09:29.192178+0000","last_fullsized":"2023-07-21T19:09:29.192178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:26.984220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.186798+0000","last_change":"2023-07-21T19:09:29.184084+0000","last_active":"2023-07-21T19:09:29.186798+0000","last_peered":"2023-07-21T19:09:29.186798+0000","last_clean":"2023-07-21T19:09:29.186798+0000","last_became_active":"2023-07-21T19:09:29.183832+0000","last_became_peered":"2023-07-21T19:09:29.183832+0000","last_unstale":"2023-07-21T19:09:29.186798+0000","last_undegraded":"2023-07-21T19:09:29.186798+0000","last_fullsized":"2023-07-21T19:09:29.186798+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:17.676308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.177604+0000","last_change":"2023-07-21T19:09:29.169936+0000","last_active":"2023-07-21T19:09:29.177604+0000","last_peered":"2023-07-21T19:09:29.177604+0000","last_clean":"2023-07-21T19:09:29.177604+0000","last_became_active":"2023-07-21T19:09:29.169660+0000","last_became_peered":"2023-07-21T19:09:29.169660+0000","last_unstale":"2023-07-21T19:09:29.177604+0000","last_undegraded":"2023-07-21T19:09:29.177604+0000","last_fullsized":"2023-07-21T19:09:29.177604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:02.542413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181993+0000","last_change":"2023-07-21T19:09:29.175398+0000","last_active":"2023-07-21T19:09:29.181993+0000","last_peered":"2023-07-21T19:09:29.181993+0000","last_clean":"2023-07-21T19:09:29.181993+0000","last_became_active":"2023-07-21T19:09:29.175108+0000","last_became_peered":"2023-07-21T19:09:29.175108+0000","last_unstale":"2023-07-21T19:09:29.181993+0000","last_undegraded":"2023-07-21T19:09:29.181993+0000","last_fullsized":"2023-07-21T19:09:29.181993+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:20.405125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.189891+0000","last_change":"2023-07-21T19:09:29.183097+0000","last_active":"2023-07-21T19:09:29.189891+0000","last_peered":"2023-07-21T19:09:29.189891+0000","last_clean":"2023-07-21T19:09:29.189891+0000","last_became_active":"2023-07-21T19:09:29.182853+0000","last_became_peered":"2023-07-21T19:09:29.182853+0000","last_unstale":"2023-07-21T19:09:29.189891+0000","last_undegraded":"2023-07-21T19:09:29.189891+0000","last_fullsized":"2023-07-21T19:09:29.189891+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:54.243004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185175+0000","last_change":"2023-07-21T19:09:29.179966+0000","last_active":"2023-07-21T19:09:29.185175+0000","last_peered":"2023-07-21T19:09:29.185175+0000","last_clean":"2023-07-21T19:09:29.185175+0000","last_became_active":"2023-07-21T19:09:29.179656+0000","last_became_peered":"2023-07-21T19:09:29.179656+0000","last_unstale":"2023-07-21T19:09:29.185175+0000","last_undegraded":"2023-07-21T19:09:29.185175+0000","last_fullsized":"2023-07-21T19:09:29.185175+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:41:26.631589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187403+0000","last_change":"2023-07-21T19:09:29.182716+0000","last_active":"2023-07-21T19:09:29.187403+0000","last_peered":"2023-07-21T19:09:29.187403+0000","last_clean":"2023-07-21T19:09:29.187403+0000","last_became_active":"2023-07-21T19:09:29.182410+0000","last_became_peered":"2023-07-21T19:09:29.182410+0000","last_unstale":"2023-07-21T19:09:29.187403+0000","last_undegraded":"2023-07-21T19:09:29.187403+0000","last_fullsized":"2023-07-21T19:09:29.187403+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:34.055455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.174790+0000","last_change":"2023-07-21T19:09:29.168153+0000","last_active":"2023-07-21T19:09:29.174790+0000","last_peered":"2023-07-21T19:09:29.174790+0000","last_clean":"2023-07-21T19:09:29.174790+0000","last_became_active":"2023-07-21T19:09:29.167853+0000","last_became_peered":"2023-07-21T19:09:29.167853+0000","last_unstale":"2023-07-21T19:09:29.174790+0000","last_undegraded":"2023-07-21T19:09:29.174790+0000","last_fullsized":"2023-07-21T19:09:29.174790+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:11.785960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.183433+0000","last_change":"2023-07-21T19:09:29.173947+0000","last_active":"2023-07-21T19:09:29.183433+0000","last_peered":"2023-07-21T19:09:29.183433+0000","last_clean":"2023-07-21T19:09:29.183433+0000","last_became_active":"2023-07-21T19:09:29.173667+0000","last_became_peered":"2023-07-21T19:09:29.173667+0000","last_unstale":"2023-07-21T19:09:29.183433+0000","last_undegraded":"2023-07-21T19:09:29.183433+0000","last_fullsized":"2023-07-21T19:09:29.183433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:13.372886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191322+0000","last_change":"2023-07-21T19:09:28.163677+0000","last_active":"2023-07-21T19:09:29.191322+0000","last_peered":"2023-07-21T19:09:29.191322+0000","last_clean":"2023-07-21T19:09:29.191322+0000","last_became_active":"2023-07-21T19:09:28.163399+0000","last_became_peered":"2023-07-21T19:09:28.163399+0000","last_unstale":"2023-07-21T19:09:29.191322+0000","last_undegraded":"2023-07-21T19:09:29.191322+0000","last_fullsized":"2023-07-21T19:09:29.191322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:42.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190086+0000","last_change":"2023-07-21T19:09:29.180756+0000","last_active":"2023-07-21T19:09:29.190086+0000","last_peered":"2023-07-21T19:09:29.190086+0000","last_clean":"2023-07-21T19:09:29.190086+0000","last_became_active":"2023-07-21T19:09:29.180487+0000","last_became_peered":"2023-07-21T19:09:29.180487+0000","last_unstale":"2023-07-21T19:09:29.190086+0000","last_undegraded":"2023-07-21T19:09:29.190086+0000","last_fullsized":"2023-07-21T19:09:29.190086+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:15:04.561340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.177050+0000","last_change":"2023-07-21T19:09:28.164641+0000","last_active":"2023-07-21T19:09:29.177050+0000","last_peered":"2023-07-21T19:09:29.177050+0000","last_clean":"2023-07-21T19:09:29.177050+0000","last_became_active":"2023-07-21T19:09:28.164363+0000","last_became_peered":"2023-07-21T19:09:28.164363+0000","last_unstale":"2023-07-21T19:09:29.177050+0000","last_undegraded":"2023-07-21T19:09:29.177050+0000","last_fullsized":"2023-07-21T19:09:29.177050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:52:47.591863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181059+0000","last_change":"2023-07-21T19:09:29.174551+0000","last_active":"2023-07-21T19:09:29.181059+0000","last_peered":"2023-07-21T19:09:29.181059+0000","last_clean":"2023-07-21T19:09:29.181059+0000","last_became_active":"2023-07-21T19:09:29.173573+0000","last_became_peered":"2023-07-21T19:09:29.173573+0000","last_unstale":"2023-07-21T19:09:29.181059+0000","last_undegraded":"2023-07-21T19:09:29.181059+0000","last_fullsized":"2023-07-21T19:09:29.181059+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:51:32.224491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.180816+0000","last_change":"2023-07-21T19:09:28.171467+0000","last_active":"2023-07-21T19:09:29.180816+0000","last_peered":"2023-07-21T19:09:29.180816+0000","last_clean":"2023-07-21T19:09:29.180816+0000","last_became_active":"2023-07-21T19:09:28.171173+0000","last_became_peered":"2023-07-21T19:09:28.171173+0000","last_unstale":"2023-07-21T19:09:29.180816+0000","last_undegraded":"2023-07-21T19:09:29.180816+0000","last_fullsized":"2023-07-21T19:09:29.180816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:44:11.689198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190643+0000","last_change":"2023-07-21T19:09:29.181342+0000","last_active":"2023-07-21T19:09:29.190643+0000","last_peered":"2023-07-21T19:09:29.190643+0000","last_clean":"2023-07-21T19:09:29.190643+0000","last_became_active":"2023-07-21T19:09:29.181017+0000","last_became_peered":"2023-07-21T19:09:29.181017+0000","last_unstale":"2023-07-21T19:09:29.190643+0000","last_undegraded":"2023-07-21T19:09:29.190643+0000","last_fullsized":"2023-07-21T19:09:29.190643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:59.468564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.183607+0000","last_change":"2023-07-21T19:09:28.170668+0000","last_active":"2023-07-21T19:09:29.183607+0000","last_peered":"2023-07-21T19:09:29.183607+0000","last_clean":"2023-07-21T19:09:29.183607+0000","last_became_active":"2023-07-21T19:09:28.170401+0000","last_became_peered":"2023-07-21T19:09:28.170401+0000","last_unstale":"2023-07-21T19:09:29.183607+0000","last_undegraded":"2023-07-21T19:09:29.183607+0000","last_fullsized":"2023-07-21T19:09:29.183607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:07.104316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182952+0000","last_change":"2023-07-21T19:09:29.177382+0000","last_active":"2023-07-21T19:09:29.182952+0000","last_peered":"2023-07-21T19:09:29.182952+0000","last_clean":"2023-07-21T19:09:29.182952+0000","last_became_active":"2023-07-21T19:09:29.177052+0000","last_became_peered":"2023-07-21T19:09:29.177052+0000","last_unstale":"2023-07-21T19:09:29.182952+0000","last_undegraded":"2023-07-21T19:09:29.182952+0000","last_fullsized":"2023-07-21T19:09:29.182952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:57:53.103649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187601+0000","last_change":"2023-07-21T19:09:28.173168+0000","last_active":"2023-07-21T19:09:29.187601+0000","last_peered":"2023-07-21T19:09:29.187601+0000","last_clean":"2023-07-21T19:09:29.187601+0000","last_became_active":"2023-07-21T19:09:28.172894+0000","last_became_peered":"2023-07-21T19:09:28.172894+0000","last_unstale":"2023-07-21T19:09:29.187601+0000","last_undegraded":"2023-07-21T19:09:29.187601+0000","last_fullsized":"2023-07-21T19:09:29.187601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:52:28.299963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182136+0000","last_change":"2023-07-21T19:09:29.173082+0000","last_active":"2023-07-21T19:09:29.182136+0000","last_peered":"2023-07-21T19:09:29.182136+0000","last_clean":"2023-07-21T19:09:29.182136+0000","last_became_active":"2023-07-21T19:09:29.172845+0000","last_became_peered":"2023-07-21T19:09:29.172845+0000","last_unstale":"2023-07-21T19:09:29.182136+0000","last_undegraded":"2023-07-21T19:09:29.182136+0000","last_fullsized":"2023-07-21T19:09:29.182136+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:12.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181799+0000","last_change":"2023-07-21T19:09:28.163753+0000","last_active":"2023-07-21T19:09:29.181799+0000","last_peered":"2023-07-21T19:09:29.181799+0000","last_clean":"2023-07-21T19:09:29.181799+0000","last_became_active":"2023-07-21T19:09:28.163486+0000","last_became_peered":"2023-07-21T19:09:28.163486+0000","last_unstale":"2023-07-21T19:09:29.181799+0000","last_undegraded":"2023-07-21T19:09:29.181799+0000","last_fullsized":"2023-07-21T19:09:29.181799+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:45.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190765+0000","last_change":"2023-07-21T19:09:29.185765+0000","last_active":"2023-07-21T19:09:29.190765+0000","last_peered":"2023-07-21T19:09:29.190765+0000","last_clean":"2023-07-21T19:09:29.190765+0000","last_became_active":"2023-07-21T19:09:29.185481+0000","last_became_peered":"2023-07-21T19:09:29.185481+0000","last_unstale":"2023-07-21T19:09:29.190765+0000","last_undegraded":"2023-07-21T19:09:29.190765+0000","last_fullsized":"2023-07-21T19:09:29.190765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:16.337588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155680+0000","last_change":"2023-07-21T19:09:28.170199+0000","last_active":"2023-07-21T19:09:29.155680+0000","last_peered":"2023-07-21T19:09:29.155680+0000","last_clean":"2023-07-21T19:09:29.155680+0000","last_became_active":"2023-07-21T19:09:28.169814+0000","last_became_peered":"2023-07-21T19:09:28.169814+0000","last_unstale":"2023-07-21T19:09:29.155680+0000","last_undegraded":"2023-07-21T19:09:29.155680+0000","last_fullsized":"2023-07-21T19:09:29.155680+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:48.818391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192103+0000","last_change":"2023-07-21T19:09:29.187785+0000","last_active":"2023-07-21T19:09:29.192103+0000","last_peered":"2023-07-21T19:09:29.192103+0000","last_clean":"2023-07-21T19:09:29.192103+0000","last_became_active":"2023-07-21T19:09:29.187449+0000","last_became_peered":"2023-07-21T19:09:29.187449+0000","last_unstale":"2023-07-21T19:09:29.192103+0000","last_undegraded":"2023-07-21T19:09:29.192103+0000","last_fullsized":"2023-07-21T19:09:29.192103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:48:31.466517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.160518+0000","last_change":"2023-07-21T19:09:28.172099+0000","last_active":"2023-07-21T19:09:29.160518+0000","last_peered":"2023-07-21T19:09:29.160518+0000","last_clean":"2023-07-21T19:09:29.160518+0000","last_became_active":"2023-07-21T19:09:28.171660+0000","last_became_peered":"2023-07-21T19:09:28.171660+0000","last_unstale":"2023-07-21T19:09:29.160518+0000","last_undegraded":"2023-07-21T19:09:29.160518+0000","last_fullsized":"2023-07-21T19:09:29.160518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:44:11.689198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190764+0000","last_change":"2023-07-21T19:09:29.186386+0000","last_active":"2023-07-21T19:09:29.190764+0000","last_peered":"2023-07-21T19:09:29.190764+0000","last_clean":"2023-07-21T19:09:29.190764+0000","last_became_active":"2023-07-21T19:09:29.185733+0000","last_became_peered":"2023-07-21T19:09:29.185733+0000","last_unstale":"2023-07-21T19:09:29.190764+0000","last_undegraded":"2023-07-21T19:09:29.190764+0000","last_fullsized":"2023-07-21T19:09:29.190764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:56.328014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.159438+0000","last_change":"2023-07-21T19:09:28.167294+0000","last_active":"2023-07-21T19:09:29.159438+0000","last_peered":"2023-07-21T19:09:29.159438+0000","last_clean":"2023-07-21T19:09:29.159438+0000","last_became_active":"2023-07-21T19:09:28.167020+0000","last_became_peered":"2023-07-21T19:09:28.167020+0000","last_unstale":"2023-07-21T19:09:29.159438+0000","last_undegraded":"2023-07-21T19:09:29.159438+0000","last_fullsized":"2023-07-21T19:09:29.159438+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:53:10.662686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191477+0000","last_change":"2023-07-21T19:09:29.183609+0000","last_active":"2023-07-21T19:09:29.191477+0000","last_peered":"2023-07-21T19:09:29.191477+0000","last_clean":"2023-07-21T19:09:29.191477+0000","last_became_active":"2023-07-21T19:09:29.183240+0000","last_became_peered":"2023-07-21T19:09:29.183240+0000","last_unstale":"2023-07-21T19:09:29.191477+0000","last_undegraded":"2023-07-21T19:09:29.191477+0000","last_fullsized":"2023-07-21T19:09:29.191477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:27.009165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.162272+0000","last_change":"2023-07-21T19:09:28.173396+0000","last_active":"2023-07-21T19:09:29.162272+0000","last_peered":"2023-07-21T19:09:29.162272+0000","last_clean":"2023-07-21T19:09:29.162272+0000","last_became_active":"2023-07-21T19:09:28.173109+0000","last_became_peered":"2023-07-21T19:09:28.173109+0000","last_unstale":"2023-07-21T19:09:29.162272+0000","last_undegraded":"2023-07-21T19:09:29.162272+0000","last_fullsized":"2023-07-21T19:09:29.162272+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:28.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.184925+0000","last_change":"2023-07-21T19:09:29.178659+0000","last_active":"2023-07-21T19:09:29.184925+0000","last_peered":"2023-07-21T19:09:29.184925+0000","last_clean":"2023-07-21T19:09:29.184925+0000","last_became_active":"2023-07-21T19:09:29.178411+0000","last_became_peered":"2023-07-21T19:09:29.178411+0000","last_unstale":"2023-07-21T19:09:29.184925+0000","last_undegraded":"2023-07-21T19:09:29.184925+0000","last_fullsized":"2023-07-21T19:09:29.184925+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:33:49.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190173+0000","last_change":"2023-07-21T19:09:28.170969+0000","last_active":"2023-07-21T19:09:29.190173+0000","last_peered":"2023-07-21T19:09:29.190173+0000","last_clean":"2023-07-21T19:09:29.190173+0000","last_became_active":"2023-07-21T19:09:28.170476+0000","last_became_peered":"2023-07-21T19:09:28.170476+0000","last_unstale":"2023-07-21T19:09:29.190173+0000","last_undegraded":"2023-07-21T19:09:29.190173+0000","last_fullsized":"2023-07-21T19:09:29.190173+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:40.684947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191303+0000","last_change":"2023-07-21T19:09:29.182812+0000","last_active":"2023-07-21T19:09:29.191303+0000","last_peered":"2023-07-21T19:09:29.191303+0000","last_clean":"2023-07-21T19:09:29.191303+0000","last_became_active":"2023-07-21T19:09:29.180858+0000","last_became_peered":"2023-07-21T19:09:29.180858+0000","last_unstale":"2023-07-21T19:09:29.191303+0000","last_undegraded":"2023-07-21T19:09:29.191303+0000","last_fullsized":"2023-07-21T19:09:29.191303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:57:40.914280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.194271+0000","last_change":"2023-07-21T19:09:28.167672+0000","last_active":"2023-07-21T19:09:29.194271+0000","last_peered":"2023-07-21T19:09:29.194271+0000","last_clean":"2023-07-21T19:09:29.194271+0000","last_became_active":"2023-07-21T19:09:28.167386+0000","last_became_peered":"2023-07-21T19:09:28.167386+0000","last_unstale":"2023-07-21T19:09:29.194271+0000","last_undegraded":"2023-07-21T19:09:29.194271+0000","last_fullsized":"2023-07-21T19:09:29.194271+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:39:21.248471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192038+0000","last_change":"2023-07-21T19:09:29.186758+0000","last_active":"2023-07-21T19:09:29.192038+0000","last_peered":"2023-07-21T19:09:29.192038+0000","last_clean":"2023-07-21T19:09:29.192038+0000","last_became_active":"2023-07-21T19:09:29.185023+0000","last_became_peered":"2023-07-21T19:09:29.185023+0000","last_unstale":"2023-07-21T19:09:29.192038+0000","last_undegraded":"2023-07-21T19:09:29.192038+0000","last_fullsized":"2023-07-21T19:09:29.192038+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:23.591211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188682+0000","last_change":"2023-07-21T19:09:28.171134+0000","last_active":"2023-07-21T19:09:29.188682+0000","last_peered":"2023-07-21T19:09:29.188682+0000","last_clean":"2023-07-21T19:09:29.188682+0000","last_became_active":"2023-07-21T19:09:28.170483+0000","last_became_peered":"2023-07-21T19:09:28.170483+0000","last_unstale":"2023-07-21T19:09:29.188682+0000","last_undegraded":"2023-07-21T19:09:29.188682+0000","last_fullsized":"2023-07-21T19:09:29.188682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:42.984648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182154+0000","last_change":"2023-07-21T19:09:29.174593+0000","last_active":"2023-07-21T19:09:29.182154+0000","last_peered":"2023-07-21T19:09:29.182154+0000","last_clean":"2023-07-21T19:09:29.182154+0000","last_became_active":"2023-07-21T19:09:29.174324+0000","last_became_peered":"2023-07-21T19:09:29.174324+0000","last_unstale":"2023-07-21T19:09:29.182154+0000","last_undegraded":"2023-07-21T19:09:29.182154+0000","last_fullsized":"2023-07-21T19:09:29.182154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:14.111231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.161955+0000","last_change":"2023-07-21T19:09:28.170229+0000","last_active":"2023-07-21T19:09:29.161955+0000","last_peered":"2023-07-21T19:09:29.161955+0000","last_clean":"2023-07-21T19:09:29.161955+0000","last_became_active":"2023-07-21T19:09:28.169899+0000","last_became_peered":"2023-07-21T19:09:28.169899+0000","last_unstale":"2023-07-21T19:09:29.161955+0000","last_undegraded":"2023-07-21T19:09:29.161955+0000","last_fullsized":"2023-07-21T19:09:29.161955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:07:42.984648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185203+0000","last_change":"2023-07-21T19:09:29.179907+0000","last_active":"2023-07-21T19:09:29.185203+0000","last_peered":"2023-07-21T19:09:29.185203+0000","last_clean":"2023-07-21T19:09:29.185203+0000","last_became_active":"2023-07-21T19:09:29.179115+0000","last_became_peered":"2023-07-21T19:09:29.179115+0000","last_unstale":"2023-07-21T19:09:29.185203+0000","last_undegraded":"2023-07-21T19:09:29.185203+0000","last_fullsized":"2023-07-21T19:09:29.185203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:19:10.636385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.169067+0000","last_change":"2023-07-21T19:09:28.174380+0000","last_active":"2023-07-21T19:09:29.169067+0000","last_peered":"2023-07-21T19:09:29.169067+0000","last_clean":"2023-07-21T19:09:29.169067+0000","last_became_active":"2023-07-21T19:09:28.174094+0000","last_became_peered":"2023-07-21T19:09:28.174094+0000","last_unstale":"2023-07-21T19:09:29.169067+0000","last_undegraded":"2023-07-21T19:09:29.169067+0000","last_fullsized":"2023-07-21T19:09:29.169067+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:13:13.262298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191430+0000","last_change":"2023-07-21T19:09:29.183360+0000","last_active":"2023-07-21T19:09:29.191430+0000","last_peered":"2023-07-21T19:09:29.191430+0000","last_clean":"2023-07-21T19:09:29.191430+0000","last_became_active":"2023-07-21T19:09:29.182902+0000","last_became_peered":"2023-07-21T19:09:29.182902+0000","last_unstale":"2023-07-21T19:09:29.191430+0000","last_undegraded":"2023-07-21T19:09:29.191430+0000","last_fullsized":"2023-07-21T19:09:29.191430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:57:03.877635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.194681+0000","last_change":"2023-07-21T19:09:28.171923+0000","last_active":"2023-07-21T19:09:29.194681+0000","last_peered":"2023-07-21T19:09:29.194681+0000","last_clean":"2023-07-21T19:09:29.194681+0000","last_became_active":"2023-07-21T19:09:28.170697+0000","last_became_peered":"2023-07-21T19:09:28.170697+0000","last_unstale":"2023-07-21T19:09:29.194681+0000","last_undegraded":"2023-07-21T19:09:29.194681+0000","last_fullsized":"2023-07-21T19:09:29.194681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:12.358826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.178130+0000","last_change":"2023-07-21T19:09:29.173344+0000","last_active":"2023-07-21T19:09:29.178130+0000","last_peered":"2023-07-21T19:09:29.178130+0000","last_clean":"2023-07-21T19:09:29.178130+0000","last_became_active":"2023-07-21T19:09:29.173089+0000","last_became_peered":"2023-07-21T19:09:29.173089+0000","last_unstale":"2023-07-21T19:09:29.178130+0000","last_undegraded":"2023-07-21T19:09:29.178130+0000","last_fullsized":"2023-07-21T19:09:29.178130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:23.591211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187753+0000","last_change":"2023-07-21T19:09:28.168735+0000","last_active":"2023-07-21T19:09:29.187753+0000","last_peered":"2023-07-21T19:09:29.187753+0000","last_clean":"2023-07-21T19:09:29.187753+0000","last_became_active":"2023-07-21T19:09:28.168480+0000","last_became_peered":"2023-07-21T19:09:28.168480+0000","last_unstale":"2023-07-21T19:09:29.187753+0000","last_undegraded":"2023-07-21T19:09:29.187753+0000","last_fullsized":"2023-07-21T19:09:29.187753+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:17.703519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.183351+0000","last_change":"2023-07-21T19:09:29.179089+0000","last_active":"2023-07-21T19:09:29.183351+0000","last_peered":"2023-07-21T19:09:29.183351+0000","last_clean":"2023-07-21T19:09:29.183351+0000","last_became_active":"2023-07-21T19:09:29.178801+0000","last_became_peered":"2023-07-21T19:09:29.178801+0000","last_unstale":"2023-07-21T19:09:29.183351+0000","last_undegraded":"2023-07-21T19:09:29.183351+0000","last_fullsized":"2023-07-21T19:09:29.183351+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:24:33.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.184289+0000","last_change":"2023-07-21T19:09:28.166748+0000","last_active":"2023-07-21T19:09:29.184289+0000","last_peered":"2023-07-21T19:09:29.184289+0000","last_clean":"2023-07-21T19:09:29.184289+0000","last_became_active":"2023-07-21T19:09:28.166179+0000","last_became_peered":"2023-07-21T19:09:28.166179+0000","last_unstale":"2023-07-21T19:09:29.184289+0000","last_undegraded":"2023-07-21T19:09:29.184289+0000","last_fullsized":"2023-07-21T19:09:29.184289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:15.622376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.180975+0000","last_change":"2023-07-21T19:09:29.176350+0000","last_active":"2023-07-21T19:09:29.180975+0000","last_peered":"2023-07-21T19:09:29.180975+0000","last_clean":"2023-07-21T19:09:29.180975+0000","last_became_active":"2023-07-21T19:09:29.176058+0000","last_became_peered":"2023-07-21T19:09:29.176058+0000","last_unstale":"2023-07-21T19:09:29.180975+0000","last_undegraded":"2023-07-21T19:09:29.180975+0000","last_fullsized":"2023-07-21T19:09:29.180975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:18.717579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185925+0000","last_change":"2023-07-21T19:09:28.170577+0000","last_active":"2023-07-21T19:09:29.185925+0000","last_peered":"2023-07-21T19:09:29.185925+0000","last_clean":"2023-07-21T19:09:29.185925+0000","last_became_active":"2023-07-21T19:09:28.170189+0000","last_became_peered":"2023-07-21T19:09:28.170189+0000","last_unstale":"2023-07-21T19:09:29.185925+0000","last_undegraded":"2023-07-21T19:09:29.185925+0000","last_fullsized":"2023-07-21T19:09:29.185925+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:37.559394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191965+0000","last_change":"2023-07-21T19:09:29.187247+0000","last_active":"2023-07-21T19:09:29.191965+0000","last_peered":"2023-07-21T19:09:29.191965+0000","last_clean":"2023-07-21T19:09:29.191965+0000","last_became_active":"2023-07-21T19:09:29.184618+0000","last_became_peered":"2023-07-21T19:09:29.184618+0000","last_unstale":"2023-07-21T19:09:29.191965+0000","last_undegraded":"2023-07-21T19:09:29.191965+0000","last_fullsized":"2023-07-21T19:09:29.191965+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:15:22.023926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.160559+0000","last_change":"2023-07-21T19:09:28.164471+0000","last_active":"2023-07-21T19:09:29.160559+0000","last_peered":"2023-07-21T19:09:29.160559+0000","last_clean":"2023-07-21T19:09:29.160559+0000","last_became_active":"2023-07-21T19:09:28.164200+0000","last_became_peered":"2023-07-21T19:09:28.164200+0000","last_unstale":"2023-07-21T19:09:29.160559+0000","last_undegraded":"2023-07-21T19:09:29.160559+0000","last_fullsized":"2023-07-21T19:09:29.160559+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:11:54.867975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190128+0000","last_change":"2023-07-21T19:09:29.186291+0000","last_active":"2023-07-21T19:09:29.190128+0000","last_peered":"2023-07-21T19:09:29.190128+0000","last_clean":"2023-07-21T19:09:29.190128+0000","last_became_active":"2023-07-21T19:09:29.185971+0000","last_became_peered":"2023-07-21T19:09:29.185971+0000","last_unstale":"2023-07-21T19:09:29.190128+0000","last_undegraded":"2023-07-21T19:09:29.190128+0000","last_fullsized":"2023-07-21T19:09:29.190128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:27.009165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.187697+0000","last_change":"2023-07-21T19:09:28.168266+0000","last_active":"2023-07-21T19:09:29.187697+0000","last_peered":"2023-07-21T19:09:29.187697+0000","last_clean":"2023-07-21T19:09:29.187697+0000","last_became_active":"2023-07-21T19:09:28.167951+0000","last_became_peered":"2023-07-21T19:09:28.167951+0000","last_unstale":"2023-07-21T19:09:29.187697+0000","last_undegraded":"2023-07-21T19:09:29.187697+0000","last_fullsized":"2023-07-21T19:09:29.187697+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:57:39.900220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.188746+0000","last_change":"2023-07-21T19:09:29.178801+0000","last_active":"2023-07-21T19:09:29.188746+0000","last_peered":"2023-07-21T19:09:29.188746+0000","last_clean":"2023-07-21T19:09:29.188746+0000","last_became_active":"2023-07-21T19:09:29.178551+0000","last_became_peered":"2023-07-21T19:09:29.178551+0000","last_unstale":"2023-07-21T19:09:29.188746+0000","last_undegraded":"2023-07-21T19:09:29.188746+0000","last_fullsized":"2023-07-21T19:09:29.188746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:53.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155965+0000","last_change":"2023-07-21T19:09:28.164341+0000","last_active":"2023-07-21T19:09:29.155965+0000","last_peered":"2023-07-21T19:09:29.155965+0000","last_clean":"2023-07-21T19:09:29.155965+0000","last_became_active":"2023-07-21T19:09:28.164085+0000","last_became_peered":"2023-07-21T19:09:28.164085+0000","last_unstale":"2023-07-21T19:09:29.155965+0000","last_undegraded":"2023-07-21T19:09:29.155965+0000","last_fullsized":"2023-07-21T19:09:29.155965+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:46:47.040863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181550+0000","last_change":"2023-07-21T19:09:29.177143+0000","last_active":"2023-07-21T19:09:29.181550+0000","last_peered":"2023-07-21T19:09:29.181550+0000","last_clean":"2023-07-21T19:09:29.181550+0000","last_became_active":"2023-07-21T19:09:29.176846+0000","last_became_peered":"2023-07-21T19:09:29.176846+0000","last_unstale":"2023-07-21T19:09:29.181550+0000","last_undegraded":"2023-07-21T19:09:29.181550+0000","last_fullsized":"2023-07-21T19:09:29.181550+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:23.232840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.158702+0000","last_change":"2023-07-21T19:09:28.175230+0000","last_active":"2023-07-21T19:09:29.158702+0000","last_peered":"2023-07-21T19:09:29.158702+0000","last_clean":"2023-07-21T19:09:29.158702+0000","last_became_active":"2023-07-21T19:09:28.174742+0000","last_became_peered":"2023-07-21T19:09:28.174742+0000","last_unstale":"2023-07-21T19:09:29.158702+0000","last_undegraded":"2023-07-21T19:09:29.158702+0000","last_fullsized":"2023-07-21T19:09:29.158702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:19.781293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181927+0000","last_change":"2023-07-21T19:09:29.169015+0000","last_active":"2023-07-21T19:09:29.181927+0000","last_peered":"2023-07-21T19:09:29.181927+0000","last_clean":"2023-07-21T19:09:29.181927+0000","last_became_active":"2023-07-21T19:09:29.168748+0000","last_became_peered":"2023-07-21T19:09:29.168748+0000","last_unstale":"2023-07-21T19:09:29.181927+0000","last_undegraded":"2023-07-21T19:09:29.181927+0000","last_fullsized":"2023-07-21T19:09:29.181927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:43.278238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165435+0000","last_change":"2023-07-21T19:09:28.170054+0000","last_active":"2023-07-21T19:09:29.165435+0000","last_peered":"2023-07-21T19:09:29.165435+0000","last_clean":"2023-07-21T19:09:29.165435+0000","last_became_active":"2023-07-21T19:09:28.169745+0000","last_became_peered":"2023-07-21T19:09:28.169745+0000","last_unstale":"2023-07-21T19:09:29.165435+0000","last_undegraded":"2023-07-21T19:09:29.165435+0000","last_fullsized":"2023-07-21T19:09:29.165435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:32.398781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.182946+0000","last_change":"2023-07-21T19:09:29.176121+0000","last_active":"2023-07-21T19:09:29.182946+0000","last_peered":"2023-07-21T19:09:29.182946+0000","last_clean":"2023-07-21T19:09:29.182946+0000","last_became_active":"2023-07-21T19:09:29.175849+0000","last_became_peered":"2023-07-21T19:09:29.175849+0000","last_unstale":"2023-07-21T19:09:29.182946+0000","last_undegraded":"2023-07-21T19:09:29.182946+0000","last_fullsized":"2023-07-21T19:09:29.182946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:13:08.635685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165835+0000","last_change":"2023-07-21T19:09:28.170078+0000","last_active":"2023-07-21T19:09:29.165835+0000","last_peered":"2023-07-21T19:09:29.165835+0000","last_clean":"2023-07-21T19:09:29.165835+0000","last_became_active":"2023-07-21T19:09:28.169766+0000","last_became_peered":"2023-07-21T19:09:28.169766+0000","last_unstale":"2023-07-21T19:09:29.165835+0000","last_undegraded":"2023-07-21T19:09:29.165835+0000","last_fullsized":"2023-07-21T19:09:29.165835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:48.739861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165501+0000","last_change":"2023-07-21T19:07:42.363227+0000","last_active":"2023-07-21T19:09:29.165501+0000","last_peered":"2023-07-21T19:09:29.165501+0000","last_clean":"2023-07-21T19:09:29.165501+0000","last_became_active":"2023-07-21T19:07:42.362873+0000","last_became_peered":"2023-07-21T19:07:42.362873+0000","last_unstale":"2023-07-21T19:09:29.165501+0000","last_undegraded":"2023-07-21T19:09:29.165501+0000","last_fullsized":"2023-07-21T19:09:29.165501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:47:39.173333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.190160+0000","last_change":"2023-07-21T19:09:29.185366+0000","last_active":"2023-07-21T19:09:29.190160+0000","last_peered":"2023-07-21T19:09:29.190160+0000","last_clean":"2023-07-21T19:09:29.190160+0000","last_became_active":"2023-07-21T19:09:29.179032+0000","last_became_peered":"2023-07-21T19:09:29.179032+0000","last_unstale":"2023-07-21T19:09:29.190160+0000","last_undegraded":"2023-07-21T19:09:29.190160+0000","last_fullsized":"2023-07-21T19:09:29.190160+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:51.334988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.153765+0000","last_change":"2023-07-21T19:09:28.164950+0000","last_active":"2023-07-21T19:09:29.153765+0000","last_peered":"2023-07-21T19:09:29.153765+0000","last_clean":"2023-07-21T19:09:29.153765+0000","last_became_active":"2023-07-21T19:09:28.164660+0000","last_became_peered":"2023-07-21T19:09:28.164660+0000","last_unstale":"2023-07-21T19:09:29.153765+0000","last_undegraded":"2023-07-21T19:09:29.153765+0000","last_fullsized":"2023-07-21T19:09:29.153765+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:41.025414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155468+0000","last_change":"2023-07-21T19:07:42.367585+0000","last_active":"2023-07-21T19:09:29.155468+0000","last_peered":"2023-07-21T19:09:29.155468+0000","last_clean":"2023-07-21T19:09:29.155468+0000","last_became_active":"2023-07-21T19:07:42.367246+0000","last_became_peered":"2023-07-21T19:07:42.367246+0000","last_unstale":"2023-07-21T19:09:29.155468+0000","last_undegraded":"2023-07-21T19:09:29.155468+0000","last_fullsized":"2023-07-21T19:09:29.155468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:06.564330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.179159+0000","last_change":"2023-07-21T19:09:29.169039+0000","last_active":"2023-07-21T19:09:29.179159+0000","last_peered":"2023-07-21T19:09:29.179159+0000","last_clean":"2023-07-21T19:09:29.179159+0000","last_became_active":"2023-07-21T19:09:29.168753+0000","last_became_peered":"2023-07-21T19:09:29.168753+0000","last_unstale":"2023-07-21T19:09:29.179159+0000","last_undegraded":"2023-07-21T19:09:29.179159+0000","last_fullsized":"2023-07-21T19:09:29.179159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T20:12:14.885142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.155738+0000","last_change":"2023-07-21T19:09:28.163863+0000","last_active":"2023-07-21T19:09:29.155738+0000","last_peered":"2023-07-21T19:09:29.155738+0000","last_clean":"2023-07-21T19:09:29.155738+0000","last_became_active":"2023-07-21T19:09:28.163594+0000","last_became_peered":"2023-07-21T19:09:28.163594+0000","last_unstale":"2023-07-21T19:09:29.155738+0000","last_undegraded":"2023-07-21T19:09:29.155738+0000","last_fullsized":"2023-07-21T19:09:29.155738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:28.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.166834+0000","last_change":"2023-07-21T19:07:42.365391+0000","last_active":"2023-07-21T19:09:29.166834+0000","last_peered":"2023-07-21T19:09:29.166834+0000","last_clean":"2023-07-21T19:09:29.166834+0000","last_became_active":"2023-07-21T19:07:42.364406+0000","last_became_peered":"2023-07-21T19:07:42.364406+0000","last_unstale":"2023-07-21T19:09:29.166834+0000","last_undegraded":"2023-07-21T19:09:29.166834+0000","last_fullsized":"2023-07-21T19:09:29.166834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:41.746238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181538+0000","last_change":"2023-07-21T19:09:29.173077+0000","last_active":"2023-07-21T19:09:29.181538+0000","last_peered":"2023-07-21T19:09:29.181538+0000","last_clean":"2023-07-21T19:09:29.181538+0000","last_became_active":"2023-07-21T19:09:29.172809+0000","last_became_peered":"2023-07-21T19:09:29.172809+0000","last_unstale":"2023-07-21T19:09:29.181538+0000","last_undegraded":"2023-07-21T19:09:29.181538+0000","last_fullsized":"2023-07-21T19:09:29.181538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:14.808883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.160827+0000","last_change":"2023-07-21T19:09:28.176023+0000","last_active":"2023-07-21T19:09:29.160827+0000","last_peered":"2023-07-21T19:09:29.160827+0000","last_clean":"2023-07-21T19:09:29.160827+0000","last_became_active":"2023-07-21T19:09:28.175763+0000","last_became_peered":"2023-07-21T19:09:28.175763+0000","last_unstale":"2023-07-21T19:09:29.160827+0000","last_undegraded":"2023-07-21T19:09:29.160827+0000","last_fullsized":"2023-07-21T19:09:29.160827+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:38:52.333567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.154602+0000","last_change":"2023-07-21T19:07:42.367917+0000","last_active":"2023-07-21T19:09:29.154602+0000","last_peered":"2023-07-21T19:09:29.154602+0000","last_clean":"2023-07-21T19:09:29.154602+0000","last_became_active":"2023-07-21T19:07:42.367308+0000","last_became_peered":"2023-07-21T19:07:42.367308+0000","last_unstale":"2023-07-21T19:09:29.154602+0000","last_undegraded":"2023-07-21T19:09:29.154602+0000","last_fullsized":"2023-07-21T19:09:29.154602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:34.012056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.192064+0000","last_change":"2023-07-21T19:09:29.188044+0000","last_active":"2023-07-21T19:09:29.192064+0000","last_peered":"2023-07-21T19:09:29.192064+0000","last_clean":"2023-07-21T19:09:29.192064+0000","last_became_active":"2023-07-21T19:09:29.187722+0000","last_became_peered":"2023-07-21T19:09:29.187722+0000","last_unstale":"2023-07-21T19:09:29.192064+0000","last_undegraded":"2023-07-21T19:09:29.192064+0000","last_fullsized":"2023-07-21T19:09:29.192064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:19:21.045563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.163764+0000","last_change":"2023-07-21T19:09:28.165530+0000","last_active":"2023-07-21T19:09:29.163764+0000","last_peered":"2023-07-21T19:09:29.163764+0000","last_clean":"2023-07-21T19:09:29.163764+0000","last_became_active":"2023-07-21T19:09:28.164845+0000","last_became_peered":"2023-07-21T19:09:28.164845+0000","last_unstale":"2023-07-21T19:09:29.163764+0000","last_undegraded":"2023-07-21T19:09:29.163764+0000","last_fullsized":"2023-07-21T19:09:29.163764+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:07.104316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.156058+0000","last_change":"2023-07-21T19:07:42.362561+0000","last_active":"2023-07-21T19:09:29.156058+0000","last_peered":"2023-07-21T19:09:29.156058+0000","last_clean":"2023-07-21T19:09:29.156058+0000","last_became_active":"2023-07-21T19:07:42.362127+0000","last_became_peered":"2023-07-21T19:07:42.362127+0000","last_unstale":"2023-07-21T19:09:29.156058+0000","last_undegraded":"2023-07-21T19:09:29.156058+0000","last_fullsized":"2023-07-21T19:09:29.156058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:08:49.833527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.185589+0000","last_change":"2023-07-21T19:09:29.170311+0000","last_active":"2023-07-21T19:09:29.185589+0000","last_peered":"2023-07-21T19:09:29.185589+0000","last_clean":"2023-07-21T19:09:29.185589+0000","last_became_active":"2023-07-21T19:09:29.170021+0000","last_became_peered":"2023-07-21T19:09:29.170021+0000","last_unstale":"2023-07-21T19:09:29.185589+0000","last_undegraded":"2023-07-21T19:09:29.185589+0000","last_fullsized":"2023-07-21T19:09:29.185589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:16:31.425268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.166757+0000","last_change":"2023-07-21T19:09:28.171096+0000","last_active":"2023-07-21T19:09:29.166757+0000","last_peered":"2023-07-21T19:09:29.166757+0000","last_clean":"2023-07-21T19:09:29.166757+0000","last_became_active":"2023-07-21T19:09:28.170832+0000","last_became_peered":"2023-07-21T19:09:28.170832+0000","last_unstale":"2023-07-21T19:09:29.166757+0000","last_undegraded":"2023-07-21T19:09:29.166757+0000","last_fullsized":"2023-07-21T19:09:29.166757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:36:07.290422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.157833+0000","last_change":"2023-07-21T19:07:42.603235+0000","last_active":"2023-07-21T19:09:29.157833+0000","last_peered":"2023-07-21T19:09:29.157833+0000","last_clean":"2023-07-21T19:09:29.157833+0000","last_became_active":"2023-07-21T19:07:42.602762+0000","last_became_peered":"2023-07-21T19:07:42.602762+0000","last_unstale":"2023-07-21T19:09:29.157833+0000","last_undegraded":"2023-07-21T19:09:29.157833+0000","last_fullsized":"2023-07-21T19:09:29.157833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:40.200924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.191204+0000","last_change":"2023-07-21T19:09:29.178811+0000","last_active":"2023-07-21T19:09:29.191204+0000","last_peered":"2023-07-21T19:09:29.191204+0000","last_clean":"2023-07-21T19:09:29.191204+0000","last_became_active":"2023-07-21T19:09:29.178477+0000","last_became_peered":"2023-07-21T19:09:29.178477+0000","last_unstale":"2023-07-21T19:09:29.191204+0000","last_undegraded":"2023-07-21T19:09:29.191204+0000","last_fullsized":"2023-07-21T19:09:29.191204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:12:27.095182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.154760+0000","last_change":"2023-07-21T19:09:28.168752+0000","last_active":"2023-07-21T19:09:29.154760+0000","last_peered":"2023-07-21T19:09:29.154760+0000","last_clean":"2023-07-21T19:09:29.154760+0000","last_became_active":"2023-07-21T19:09:28.168490+0000","last_became_peered":"2023-07-21T19:09:28.168490+0000","last_unstale":"2023-07-21T19:09:29.154760+0000","last_undegraded":"2023-07-21T19:09:29.154760+0000","last_fullsized":"2023-07-21T19:09:29.154760+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:55.732644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165213+0000","last_change":"2023-07-21T19:07:42.365054+0000","last_active":"2023-07-21T19:09:29.165213+0000","last_peered":"2023-07-21T19:09:29.165213+0000","last_clean":"2023-07-21T19:09:29.165213+0000","last_became_active":"2023-07-21T19:07:42.364497+0000","last_became_peered":"2023-07-21T19:07:42.364497+0000","last_unstale":"2023-07-21T19:09:29.165213+0000","last_undegraded":"2023-07-21T19:09:29.165213+0000","last_fullsized":"2023-07-21T19:09:29.165213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:54.576141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.186501+0000","last_change":"2023-07-21T19:09:29.182478+0000","last_active":"2023-07-21T19:09:29.186501+0000","last_peered":"2023-07-21T19:09:29.186501+0000","last_clean":"2023-07-21T19:09:29.186501+0000","last_became_active":"2023-07-21T19:09:29.182165+0000","last_became_peered":"2023-07-21T19:09:29.182165+0000","last_unstale":"2023-07-21T19:09:29.186501+0000","last_undegraded":"2023-07-21T19:09:29.186501+0000","last_fullsized":"2023-07-21T19:09:29.186501+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:28.127217+0000","last_clean_scrub_stamp":"2023-07-21T19:09:28.127217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:56.746703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.181576+0000","last_change":"2023-07-21T19:09:28.170874+0000","last_active":"2023-07-21T19:09:29.181576+0000","last_peered":"2023-07-21T19:09:29.181576+0000","last_clean":"2023-07-21T19:09:29.181576+0000","last_became_active":"2023-07-21T19:09:28.169722+0000","last_became_peered":"2023-07-21T19:09:28.169722+0000","last_unstale":"2023-07-21T19:09:29.181576+0000","last_undegraded":"2023-07-21T19:09:29.181576+0000","last_fullsized":"2023-07-21T19:09:29.181576+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:09:27.113157+0000","last_clean_scrub_stamp":"2023-07-21T19:09:27.113157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:54.343748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.157136+0000","last_change":"2023-07-21T19:07:42.362560+0000","last_active":"2023-07-21T19:09:29.157136+0000","last_peered":"2023-07-21T19:09:29.157136+0000","last_clean":"2023-07-21T19:09:29.157136+0000","last_became_active":"2023-07-21T19:07:42.362066+0000","last_became_peered":"2023-07-21T19:07:42.362066+0000","last_unstale":"2023-07-21T19:09:29.157136+0000","last_undegraded":"2023-07-21T19:09:29.157136+0000","last_fullsized":"2023-07-21T19:09:29.157136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:41.343920+0000","last_clean_scrub_stamp":"2023-07-21T19:07:41.343920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:36.502119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-21T19:09:29.165520+0000","last_change":"2023-07-21T19:07:37.495346+0000","last_active":"2023-07-21T19:09:29.165520+0000","last_peered":"2023-07-21T19:09:29.165520+0000","last_clean":"2023-07-21T19:09:29.165520+0000","last_became_active":"2023-07-21T19:07:37.492842+0000","last_became_peered":"2023-07-21T19:07:37.492842+0000","last_unstale":"2023-07-21T19:09:29.165520+0000","last_undegraded":"2023-07-21T19:09:29.165520+0000","last_fullsized":"2023-07-21T19:09:29.165520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T19:07:36.226507+0000","last_clean_scrub_stamp":"2023-07-21T19:07:36.226507+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T21:24:55.807126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1085440,"data_stored":808073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.248}]},{"osd":1,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.397},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.141}]},{"osd":2,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.427},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":4.1379999999999999,"5min":4.1379999999999999,"15min":4.1379999999999999},"last":1.492}]},{"osd":3,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.611}]},{"osd":4,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":8.2520000000000007,"5min":8.2520000000000007,"15min":8.2520000000000007},"last":1.357}]},{"osd":5,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.444}]},{"osd":6,"last update":"Fri Jul 21 19:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.4730000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":495616,"data_stored":218287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.0740000000000001}]},{"osd":1,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.179},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.135}]},{"osd":2,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.999}]},{"osd":3,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.22}]},{"osd":4,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.421}]},{"osd":5,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Jul 21 19:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.304}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":217685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.497},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.63}]},{"osd":3,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":210167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.0840000000000001}]},{"osd":2,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.4259999999999999}]},{"osd":3,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.23},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":2.9950000000000001},"last":1.496}]},{"osd":7,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.163},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.2829999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":218253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.87},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.81100000000000005}]},{"osd":6,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Jul 21 19:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":219201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.323,"5min":3.323,"15min":3.323},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.876}]},{"osd":6,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":2.9430000000000001,"5min":2.9430000000000001,"15min":2.9430000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Jul 21 19:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.0189999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":217685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.119},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.95999999999999996}]},{"osd":4,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Jul 21 19:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.3029999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":808017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.03},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.391}]},{"osd":2,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.179}]},{"osd":3,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1279999999999999}]},{"osd":4,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.353},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.466},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.325},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.5640000000000001}]},{"osd":7,"last update":"Fri Jul 21 19:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.518},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.2370000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T19:09:34.308 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T19:09:34.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T19:09:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.510+0000 7f9b3b59e700 1 Processor -- start 2023-07-21T19:09:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.510+0000 7f9b3b59e700 1 -- start start 2023-07-21T19:09:34.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3b59e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9b3c1459c0 0x7f9b3c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b3c0ccbd0 0x7f9b3c0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3b59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c145d90 con 0x7f9b3c0d0150 2023-07-21T19:09:34.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0cd650 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3b59e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0cd930 con 0x7f9b3c1459c0 2023-07-21T19:09:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3ad9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9b3c0d0150 0x7f9b3c0b1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52108/0 (socket says 172.21.15.123:52108) 2023-07-21T19:09:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3ad9d700 1 -- 172.21.15.123:0/1550296831 learned_addr learned my addr 172.21.15.123:0/1550296831 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b39d9b700 1 --2- 172.21.15.123:0/1550296831 >> v2:172.21.15.123:3300/0 conn(0x7f9b3c0ccbd0 0x7f9b3c0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3a59c700 1 --2- 172.21.15.123:0/1550296831 >> v2:172.21.15.145:3300/0 conn(0x7f9b3c1459c0 0x7f9b3c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3a59c700 1 -- 172.21.15.123:0/1550296831 >> v2:172.21.15.123:3300/0 conn(0x7f9b3c0ccbd0 msgr2=0x7f9b3c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3a59c700 1 --2- 172.21.15.123:0/1550296831 >> v2:172.21.15.123:3300/0 conn(0x7f9b3c0ccbd0 0x7f9b3c0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3a59c700 1 -- 172.21.15.123:0/1550296831 >> v1:172.21.15.123:6789/0 conn(0x7f9b3c0d0150 legacy=0x7f9b3c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3a59c700 1 -- 172.21.15.123:0/1550296831 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0cdc10 con 0x7f9b3c1459c0 2023-07-21T19:09:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b39d9b700 1 --2- 172.21.15.123:0/1550296831 >> v2:172.21.15.123:3300/0 conn(0x7f9b3c0ccbd0 0x7f9b3c0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.514+0000 7f9b3959a700 1 -- 172.21.15.123:0/1550296831 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861869625 0 0) 0x7f9b3c145d90 con 0x7f9b3c0d0150 2023-07-21T19:09:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3a59c700 1 --2- 172.21.15.123:0/1550296831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0ce6f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009840 tx=0x7f9b2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6450499e167ad0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3959a700 1 -- 172.21.15.123:0/1550296831 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c005e50 con 0x7f9b3c1459c0 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3959a700 1 -- 172.21.15.123:0/1550296831 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c006030 con 0x7f9b3c1459c0 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3959a700 1 -- 172.21.15.123:0/1550296831 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0063c0 con 0x7f9b3c1459c0 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 -- 172.21.15.123:0/1550296831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 msgr2=0x7f9b3c0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/1550296831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0ce6f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009840 tx=0x7f9b2c009b50 comp rx=0 tx=0).stop 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 -- 172.21.15.123:0/1550296831 shutdown_connections 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/1550296831 >> v2:172.21.15.123:3300/0 conn(0x7f9b3c0ccbd0 0x7f9b3c0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/1550296831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0ce6f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 -- 172.21.15.123:0/1550296831 >> 172.21.15.123:0/1550296831 conn(0x7f9b3c060c40 msgr2=0x7f9b3c09b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 -- 172.21.15.123:0/1550296831 shutdown_connections 2023-07-21T19:09:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.518+0000 7f9b3b59e700 1 -- 172.21.15.123:0/1550296831 wait complete. 2023-07-21T19:09:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 Processor -- start 2023-07-21T19:09:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 -- start start 2023-07-21T19:09:34.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 0x7f9b3c0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c0d0150 0x7f9b3c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c7270 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c69b0 con 0x7f9b3c1459c0 2023-07-21T19:09:34.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c6c20 con 0x7f9b3c0d0150 2023-07-21T19:09:34.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 0x7f9b3c0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 0x7f9b3c0b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47462/0 (socket says 172.21.15.123:47462) 2023-07-21T19:09:34.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 -- 172.21.15.123:0/3715337094 learned_addr learned my addr 172.21.15.123:0/3715337094 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:34.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b39d9b700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c0d0150 0x7f9b3c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3ad9d700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 -- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c0d0150 msgr2=0x7f9b3c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c0d0150 0x7f9b3c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 -- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 msgr2=0x7f9b3c0b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 -- 172.21.15.123:0/3715337094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300094b0 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b39d9b700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c0d0150 0x7f9b3c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3ad9d700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3a59c700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 0x7f9b3c0b53b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003ad0 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c003c30 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c009450 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0061a0 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.522+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c1e2b60 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.526+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c0d1960 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.526+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b2c022070 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.530+0000 7f9b2affd700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b1c0662f0 0x7f9b1c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.530+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9b2c085870 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.544 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.530+0000 7f9b39d9b700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b1c0662f0 0x7f9b1c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:34.545 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.530+0000 7f9b39d9b700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b1c0662f0 0x7f9b1c0687a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1f47a0 tx=0x7f9b30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:34.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.534+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9b2c052cc0 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.770+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9b3c04e500 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.793 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.778+0000 7f9b2affd700 1 -- 172.21.15.123:0/3715337094 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9b2c02a0b0 con 0x7f9b3c0ccbd0 2023-07-21T19:09:34.793 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-07-21T19:09:34.793 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBA17pk2Nr+DhAAZaJDjV8t3ZvDwlb/0Xr4lQ== 2023-07-21T19:09:34.793 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2023-07-21T19:09:34.793 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2023-07-21T19:09:34.794 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T19:09:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b1c0662f0 msgr2=0x7f9b1c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b1c0662f0 0x7f9b1c0687a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1f47a0 tx=0x7f9b30008040 comp rx=0 tx=0).stop 2023-07-21T19:09:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 msgr2=0x7f9b3c0b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 0x7f9b3c0b53b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c004770 comp rx=0 tx=0).stop 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 shutdown_connections 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f9b1c0662f0 0x7f9b1c0687a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c1459c0 0x7f9b3c0b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c0d0150 0x7f9b3c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 --2- 172.21.15.123:0/3715337094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c0ccbd0 0x7f9b3c0b53b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 >> 172.21.15.123:0/3715337094 conn(0x7f9b3c060c40 msgr2=0x7f9b3c15b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:34.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 shutdown_connections 2023-07-21T19:09:34.799 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.782+0000 7f9b3b59e700 1 -- 172.21.15.123:0/3715337094 wait complete. 2023-07-21T19:09:34.799 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2023-07-21T19:09:34.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T19:09:34.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1113137700 1 Processor -- start 2023-07-21T19:09:34.997 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1113137700 1 -- start start 2023-07-21T19:09:34.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1113137700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f110c0b0de0 0x7f110c1669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:34.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1113137700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0af0a0 con 0x7f110c0cd240 2023-07-21T19:09:34.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1113137700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0cf720 con 0x7f110c15bff0 2023-07-21T19:09:34.998 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1113137700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0af2f0 con 0x7f110c0b0de0 2023-07-21T19:09:34.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1111934700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f110c0cd240 0x7f110c0ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52114/0 (socket says 172.21.15.123:52114) 2023-07-21T19:09:34.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.982+0000 7f1111934700 1 -- 172.21.15.123:0/2795175595 learned_addr learned my addr 172.21.15.123:0/2795175595 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:34.999 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1112936700 1 --2- 172.21.15.123:0/2795175595 >> v2:172.21.15.145:3300/0 conn(0x7f110c0b0de0 0x7f110c1669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1111133700 1 -- 172.21.15.123:0/2795175595 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366832698 0 0) 0x7f110c0af0a0 con 0x7f110c0cd240 2023-07-21T19:09:35.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1111133700 1 -- 172.21.15.123:0/2795175595 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f80035d0 con 0x7f110c0cd240 2023-07-21T19:09:35.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1112936700 1 -- 172.21.15.123:0/2795175595 >> v1:172.21.15.145:6789/0 conn(0x7f110c15bff0 legacy=0x7f110c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1112936700 1 -- 172.21.15.123:0/2795175595 >> v1:172.21.15.123:6789/0 conn(0x7f110c0cd240 legacy=0x7f110c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.000 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1112936700 1 -- 172.21.15.123:0/2795175595 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0af5d0 con 0x7f110c0b0de0 2023-07-21T19:09:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1112936700 1 --2- 172.21.15.123:0/2795175595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0b0de0 0x7f110c1669d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1104009d90 tx=0x7f110400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7b5945e656cfea1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1111133700 1 -- 172.21.15.123:0/2795175595 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400e070 con 0x7f110c0b0de0 2023-07-21T19:09:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1111133700 1 -- 172.21.15.123:0/2795175595 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110400bb20 con 0x7f110c0b0de0 2023-07-21T19:09:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1111133700 1 -- 172.21.15.123:0/2795175595 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400be90 con 0x7f110c0b0de0 2023-07-21T19:09:35.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 -- 172.21.15.123:0/2795175595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0b0de0 msgr2=0x7f110c1669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 --2- 172.21.15.123:0/2795175595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0b0de0 0x7f110c1669d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1104009d90 tx=0x7f110400b330 comp rx=0 tx=0).stop 2023-07-21T19:09:35.002 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 -- 172.21.15.123:0/2795175595 shutdown_connections 2023-07-21T19:09:35.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 --2- 172.21.15.123:0/2795175595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0b0de0 0x7f110c1669d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 -- 172.21.15.123:0/2795175595 >> 172.21.15.123:0/2795175595 conn(0x7f110c060c40 msgr2=0x7f110c09b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 -- 172.21.15.123:0/2795175595 shutdown_connections 2023-07-21T19:09:35.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.986+0000 7f1113137700 1 -- 172.21.15.123:0/2795175595 wait complete. 2023-07-21T19:09:35.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 Processor -- start 2023-07-21T19:09:35.004 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 -- start start 2023-07-21T19:09:35.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f110c0b0de0 0x7f110c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0cd240 0x7f110c0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 0x7f110c15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b1fe0 con 0x7f110c15bff0 2023-07-21T19:09:35.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b1360 con 0x7f110c0cd240 2023-07-21T19:09:35.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1113137700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b1640 con 0x7f110c0b0de0 2023-07-21T19:09:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1112936700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 0x7f110c15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1112936700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 0x7f110c15cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47470/0 (socket says 172.21.15.123:47470) 2023-07-21T19:09:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.990+0000 7f1112936700 1 -- 172.21.15.123:0/3308108513 learned_addr learned my addr 172.21.15.123:0/3308108513 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1111934700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0cd240 0x7f110c0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112135700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f110c0b0de0 0x7f110c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112936700 1 -- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f110c0b0de0 msgr2=0x7f110c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112936700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f110c0b0de0 0x7f110c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112936700 1 -- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0cd240 msgr2=0x7f110c0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112936700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0cd240 0x7f110c0b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112936700 1 -- 172.21.15.123:0/3308108513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104009a70 con 0x7f110c15bff0 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1112936700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 0x7f110c15cb10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f110400b370 tx=0x7f1104004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104007000 con 0x7f110c15bff0 2023-07-21T19:09:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104012860 con 0x7f110c15bff0 2023-07-21T19:09:35.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0b1920 con 0x7f110c15bff0 2023-07-21T19:09:35.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104012c10 con 0x7f110c15bff0 2023-07-21T19:09:35.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0b61f0 con 0x7f110c15bff0 2023-07-21T19:09:35.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.994+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c0b2120 con 0x7f110c15bff0 2023-07-21T19:09:35.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.998+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f110401c400 con 0x7f110c15bff0 2023-07-21T19:09:35.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.998+0000 7f1102ffd700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f00662f0 0x7f10f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.998+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1104085ee0 con 0x7f110c15bff0 2023-07-21T19:09:35.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:34.998+0000 7f1112135700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f00662f0 0x7f10f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.002+0000 7f1112135700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f00662f0 0x7f10f00687a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1108001640 tx=0x7f1108009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.002+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f110c0b2120 con 0x7f110c15bff0 2023-07-21T19:09:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.206+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f110c0b2120 con 0x7f110c15bff0 2023-07-21T19:09:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.206+0000 7f1102ffd700 1 -- 172.21.15.123:0/3308108513 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f110c0b2120 con 0x7f110c15bff0 2023-07-21T19:09:35.223 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:35.223 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5590,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1040218701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1040218701},{"type":"v1","addr":"172.21.15.145:6835","nonce":1040218701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/3115729738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":3115729738},{"type":"v1","addr":"172.21.15.123:6837","nonce":3115729738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1069533413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1069533413},{"type":"v1","addr":"172.21.15.123:6836","nonce":1069533413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T19:09:28.598376+0000","modified":"2023-07-21T19:09:32.552983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.145:6833/2403302730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2403302730},{"type":"v1","addr":"172.21.15.145:6833","nonce":2403302730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T19:09:35.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f00662f0 msgr2=0x7f10f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f00662f0 0x7f10f00687a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1108001640 tx=0x7f1108009040 comp rx=0 tx=0).stop 2023-07-21T19:09:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 msgr2=0x7f110c15cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 0x7f110c15cb10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f110400b370 tx=0x7f1104004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 shutdown_connections 2023-07-21T19:09:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f10f00662f0 0x7f10f00687a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f110c0cd240 0x7f110c0b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f110c15bff0 0x7f110c15cb10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 --2- 172.21.15.123:0/3308108513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f110c0b0de0 0x7f110c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 >> 172.21.15.123:0/3308108513 conn(0x7f110c060c40 msgr2=0x7f110c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 shutdown_connections 2023-07-21T19:09:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.210+0000 7f1113137700 1 -- 172.21.15.123:0/3308108513 wait complete. 2023-07-21T19:09:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 18 2023-07-21T19:09:35.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T19:09:28.598376+0000', 'modified': '2023-07-21T19:09:32.552983+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5655': {'gid': 5655, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.145:6833/2403302730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 2403302730}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 2403302730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T19:09:35.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T19:09:35.649 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-21T19:09:35.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.814+0000 7f0059326700 1 Processor -- start 2023-07-21T19:09:35.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.814+0000 7f0059326700 1 -- start start 2023-07-21T19:09:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.814+0000 7f0059326700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f005415bff0 0x7f00540ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.814+0000 7f0059326700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540af0a0 con 0x7f00540cf1c0 2023-07-21T19:09:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.814+0000 7f0059326700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540cf720 con 0x7f00540cd070 2023-07-21T19:09:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.814+0000 7f0059326700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540cd4f0 con 0x7f005415bff0 2023-07-21T19:09:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f00537fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f00540cf1c0 0x7f00540afdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52130/0 (socket says 172.21.15.123:52130) 2023-07-21T19:09:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f00537fe700 1 -- 172.21.15.123:0/3718081912 learned_addr learned my addr 172.21.15.123:0/3718081912 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3718081912 >> v2:172.21.15.123:3300/0 conn(0x7f005415bff0 0x7f00540ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0051ffb700 1 -- 172.21.15.123:0/3718081912 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419744621 0 0) 0x7f00540af0a0 con 0x7f00540cf1c0 2023-07-21T19:09:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0051ffb700 1 -- 172.21.15.123:0/3718081912 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c0035d0 con 0x7f00540cf1c0 2023-07-21T19:09:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0052ffd700 1 -- 172.21.15.123:0/3718081912 >> v1:172.21.15.145:6789/0 conn(0x7f00540cd070 legacy=0x7f00540ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0052ffd700 1 -- 172.21.15.123:0/3718081912 >> v1:172.21.15.123:6789/0 conn(0x7f00540cf1c0 legacy=0x7f00540afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0052ffd700 1 -- 172.21.15.123:0/3718081912 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540af2f0 con 0x7f005415bff0 2023-07-21T19:09:35.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3718081912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00540ccb30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0044009850 tx=0x7f0044009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31ed9b230545c16 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0051ffb700 1 -- 172.21.15.123:0/3718081912 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044011830 con 0x7f005415bff0 2023-07-21T19:09:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0051ffb700 1 -- 172.21.15.123:0/3718081912 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044011990 con 0x7f005415bff0 2023-07-21T19:09:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0051ffb700 1 -- 172.21.15.123:0/3718081912 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044011d00 con 0x7f005415bff0 2023-07-21T19:09:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 -- 172.21.15.123:0/3718081912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 msgr2=0x7f00540ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 --2- 172.21.15.123:0/3718081912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00540ccb30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0044009850 tx=0x7f0044009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:35.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 -- 172.21.15.123:0/3718081912 shutdown_connections 2023-07-21T19:09:35.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 --2- 172.21.15.123:0/3718081912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00540ccb30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 -- 172.21.15.123:0/3718081912 >> 172.21.15.123:0/3718081912 conn(0x7f0054060c40 msgr2=0x7f005409b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 -- 172.21.15.123:0/3718081912 shutdown_connections 2023-07-21T19:09:35.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.818+0000 7f0059326700 1 -- 172.21.15.123:0/3718081912 wait complete. 2023-07-21T19:09:35.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.822+0000 7f0059326700 1 Processor -- start 2023-07-21T19:09:35.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.822+0000 7f0059326700 1 -- start start 2023-07-21T19:09:35.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.822+0000 7f0059326700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00540cd070 0x7f00540b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.822+0000 7f0059326700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00540cf1c0 0x7f00541f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0059326700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00541578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0059326700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541f5990 con 0x7f005415bff0 2023-07-21T19:09:35.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0059326700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005415cdd0 con 0x7f00540cd070 2023-07-21T19:09:35.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0059326700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00541f56b0 con 0x7f00540cf1c0 2023-07-21T19:09:35.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00541578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00541578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47492/0 (socket says 172.21.15.123:47492) 2023-07-21T19:09:35.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 -- 172.21.15.123:0/41752680 learned_addr learned my addr 172.21.15.123:0/41752680 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00527fc700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00540cf1c0 0x7f00541f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0052ffd700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00540cd070 0x7f00540b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 -- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00540cf1c0 msgr2=0x7f00541f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00540cf1c0 0x7f00541f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 -- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00540cd070 msgr2=0x7f00540b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00540cd070 0x7f00540b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 -- 172.21.15.123:0/41752680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440094b0 con 0x7f005415bff0 2023-07-21T19:09:35.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0052ffd700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00540cd070 0x7f00540b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T19:09:35.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f00537fe700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00541578c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f004c00caa0 tx=0x7f004c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f003b7fe700 1 -- 172.21.15.123:0/41752680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c007480 con 0x7f005415bff0 2023-07-21T19:09:35.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f003b7fe700 1 -- 172.21.15.123:0/41752680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c0075e0 con 0x7f005415bff0 2023-07-21T19:09:35.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f003b7fe700 1 -- 172.21.15.123:0/41752680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c007970 con 0x7f005415bff0 2023-07-21T19:09:35.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540cbc40 con 0x7f005415bff0 2023-07-21T19:09:35.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.826+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005415f260 con 0x7f005415bff0 2023-07-21T19:09:35.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.830+0000 7f003b7fe700 1 -- 172.21.15.123:0/41752680 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f004c01b3b0 con 0x7f005415bff0 2023-07-21T19:09:35.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.834+0000 7f003b7fe700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f00400662f0 0x7f00400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.834+0000 7f003b7fe700 1 -- 172.21.15.123:0/41752680 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f004c0837f0 con 0x7f005415bff0 2023-07-21T19:09:35.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.834+0000 7f0052ffd700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f00400662f0 0x7f00400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.834+0000 7f005c5ac740 1 Processor -- start 2023-07-21T19:09:35.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.834+0000 7f005c5ac740 1 -- start start 2023-07-21T19:09:35.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.834+0000 7f0052ffd700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f00400662f0 0x7f00400687a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0044000c00 tx=0x7f0044008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4beb0 0x1f048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1f04df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1eb9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dd8270 con 0x1c4bae0 2023-07-21T19:09:35.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e2b3a0 con 0x1c4beb0 2023-07-21T19:09:35.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e24600 con 0x1c4b710 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00527fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1f04df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1eb9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f0052ffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4beb0 0x1f048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00527fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1f04df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47502/0 (socket says 172.21.15.123:47502) 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1eb9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.123:47926/0 (socket says 172.21.15.123:47926) 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00527fc700 1 -- 172.21.15.123:0/1403201004 learned_addr learned my addr 172.21.15.123:0/1403201004 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:35.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 -- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4beb0 msgr2=0x1f048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4beb0 0x1f048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 -- 172.21.15.123:0/1403201004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 msgr2=0x1f04df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1f04df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 -- 172.21.15.123:0/1403201004 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c979e0 con 0x1c4b710 2023-07-21T19:09:35.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00527fc700 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1f04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T19:09:35.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f00537fe700 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1eb9d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f004c081ad0 tx=0x7f004c054260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907b14363eee1b00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f0038ff9700 1 -- 172.21.15.123:0/1403201004 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c081ea0 con 0x1c4b710 2023-07-21T19:09:35.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f0038ff9700 1 -- 172.21.15.123:0/1403201004 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c007ad0 con 0x1c4b710 2023-07-21T19:09:35.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f0038ff9700 1 -- 172.21.15.123:0/1403201004 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c055be0 con 0x1c4b710 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 msgr2=0x1eb9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1eb9d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f004c081ad0 tx=0x7f004c054260 comp rx=0 tx=0).stop 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- 172.21.15.123:0/1403201004 shutdown_connections 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1eb9d20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1f04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 --2- 172.21.15.123:0/1403201004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4beb0 0x1f048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- 172.21.15.123:0/1403201004 >> 172.21.15.123:0/1403201004 conn(0x1eb5b60 msgr2=0x1ec0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.838+0000 7f005c5ac740 1 -- 172.21.15.123:0/1403201004 shutdown_connections 2023-07-21T19:09:35.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 -- 172.21.15.123:0/1403201004 wait complete. 2023-07-21T19:09:35.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 -- start start 2023-07-21T19:09:35.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 Processor -- start 2023-07-21T19:09:35.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4b710 0x1ee7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1eedcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1ee9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de6b00 con 0x1c4bae0 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de5470 con 0x1c4b710 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cd0b20 con 0x1c4beb0 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f005c5ac740 10 client.0 _ll_register_callbacks cb 0x1e4a530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1eedcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00537fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1ee9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1eedcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47508/0 (socket says 172.21.15.123:47508) 2023-07-21T19:09:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 -- 172.21.15.123:0/3100007863 learned_addr learned my addr 172.21.15.123:0/3100007863 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4b710 0x1ee7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 -- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 msgr2=0x1ee9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1ee9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 -- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4b710 msgr2=0x1ee7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4b710 0x1ee7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.842+0000 7f00527fc700 1 -- 172.21.15.123:0/3100007863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00540cf720 con 0x1c4bae0 2023-07-21T19:09:35.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f00527fc700 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1eedcb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0048012550 tx=0x7f0048012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6caccc67d80011 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-21T19:09:35.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 1 -- 172.21.15.123:0/3100007863 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480050d0 con 0x1c4bae0 2023-07-21T19:09:35.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e1d5e0 con 0x1c4bae0 2023-07-21T19:09:35.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 1 -- 172.21.15.123:0/3100007863 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0048005230 con 0x1c4bae0 2023-07-21T19:09:35.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 1 -- 172.21.15.123:0/3100007863 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00480053f0 con 0x1c4bae0 2023-07-21T19:09:35.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 10 client.5835 fetch_fsmap learned FSMap version 18 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f005415f260 con 0x1c4bae0 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 1 -- 172.21.15.123:0/3100007863 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e1d5e0 con 0x1c4bae0 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 1 -- 172.21.15.123:0/3100007863 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f004801e3f0 con 0x1c4bae0 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 10 client.5835 fetch_fsmap finished waiting for FSMap version 18 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 10 client.5835 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 20 client.5835 populate_metadata read hostname 'smithi123' 2023-07-21T19:09:35.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1c96790 0x1f0b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 4 client.5835 mds_command: new command op to 5655 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T19:09:35.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 --> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e1d300 con 0x1c96790 2023-07-21T19:09:35.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1c96790 0x1f0b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1c96790 0x1f0b6a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3242de2cbf43828 server_cookie=9acea9570066e27c in_seq=0 out_seq=0 2023-07-21T19:09:35.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.846+0000 7f0031ffb700 10 client.5835 ms_handle_connect on v2:172.21.15.145:6832/2403302730 2023-07-21T19:09:35.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f0031ffb700 1 -- 172.21.15.123:0/3100007863 <== mds.0 v2:172.21.15.145:6832/2403302730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x1e1d300 con 0x1c96790 2023-07-21T19:09:35.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f0031ffb700 10 client.5835 handle_command_reply: tid=0 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 client.5835 shutdown 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 msgr2=0x1eedcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1eedcb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0048012550 tx=0x7f0048012860 comp rx=0 tx=0).stop 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 shutdown_connections 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1c96790 0x1f0b6a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1ee9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4bae0 0x1eedcb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3100007863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1c4b710 0x1ee7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 >> 172.21.15.123:0/3100007863 conn(0x1eb5b60 msgr2=0x1eb9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f0031ffb700 0 client.5835 ms_handle_reset on v2:172.21.15.145:6832/2403302730 2023-07-21T19:09:35.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 shutdown_connections 2023-07-21T19:09:35.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 1 -- 172.21.15.123:0/3100007863 wait complete. 2023-07-21T19:09:35.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.850+0000 7f005c5ac740 20 client.5835 trim_cache size 0 max 16384 2023-07-21T19:09:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 Processor -- start 2023-07-21T19:09:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 -- start start 2023-07-21T19:09:35.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1f0b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 0x1f0bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1ee8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dde720 con 0x1c4beb0 2023-07-21T19:09:35.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de2ea0 con 0x1ee85c0 2023-07-21T19:09:35.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1df3d50 con 0x1c4b710 2023-07-21T19:09:35.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f00527fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 0x1f0bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f00527fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 0x1f0bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47520/0 (socket says 172.21.15.123:47520) 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.870+0000 7f00527fc700 1 -- 172.21.15.123:0/229415978 learned_addr learned my addr 172.21.15.123:0/229415978 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00537fe700 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1ee8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f0052ffd700 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1f0b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00527fc700 1 -- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 msgr2=0x1f0b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00527fc700 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1f0b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00527fc700 1 -- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 msgr2=0x1ee8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00527fc700 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1ee8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00527fc700 1 -- 172.21.15.123:0/229415978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054158160 con 0x1c4beb0 2023-07-21T19:09:35.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00527fc700 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 0x1f0bbe0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0048000fd0 tx=0x7f004800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792ae9dbfc15b72 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00397fa700 1 -- 172.21.15.123:0/229415978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004801eb60 con 0x1c4beb0 2023-07-21T19:09:35.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00397fa700 1 -- 172.21.15.123:0/229415978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004802c070 con 0x1c4beb0 2023-07-21T19:09:35.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f00397fa700 1 -- 172.21.15.123:0/229415978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0048001060 con 0x1c4beb0 2023-07-21T19:09:35.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 -- 172.21.15.123:0/229415978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 msgr2=0x1f0bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 0x1f0bbe0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0048000fd0 tx=0x7f004800c000 comp rx=0 tx=0).stop 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 -- 172.21.15.123:0/229415978 shutdown_connections 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1ee8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4beb0 0x1f0bbe0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 --2- 172.21.15.123:0/229415978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4b710 0x1f0b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 -- 172.21.15.123:0/229415978 >> 172.21.15.123:0/229415978 conn(0x1eb5b60 msgr2=0x1f0c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 -- 172.21.15.123:0/229415978 shutdown_connections 2023-07-21T19:09:35.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.874+0000 7f005c5ac740 1 -- 172.21.15.123:0/229415978 wait complete. 2023-07-21T19:09:35.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 -- start start 2023-07-21T19:09:35.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 Processor -- start 2023-07-21T19:09:35.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 0x1f656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1f218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1f08dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1df4510 con 0x1c4b710 2023-07-21T19:09:35.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e28600 con 0x1ee85c0 2023-07-21T19:09:35.894 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e1e900 con 0x1c4beb0 2023-07-21T19:09:35.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f005c5ac740 10 client.0 _ll_register_callbacks cb 0x1ddc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T19:09:35.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 0x1f656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 0x1f656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47532/0 (socket says 172.21.15.123:47532) 2023-07-21T19:09:35.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 -- 172.21.15.123:0/3198888672 learned_addr learned my addr 172.21.15.123:0/3198888672 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:35.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 -- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 msgr2=0x1f218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1f218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 -- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 msgr2=0x1f08dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:35.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1f08dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.878+0000 7f0052ffd700 1 -- 172.21.15.123:0/3198888672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005415f260 con 0x1c4b710 2023-07-21T19:09:35.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0052ffd700 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 0x1f656e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0044013000 tx=0x7f004400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac172a5b99779ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 1 -- 172.21.15.123:0/3198888672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044034480 con 0x1c4b710 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f04330 con 0x1c4b710 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 1 -- 172.21.15.123:0/3198888672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0044003aa0 con 0x1c4b710 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 1 -- 172.21.15.123:0/3198888672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0044034e90 con 0x1c4b710 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 10 client.5841 fetch_fsmap learned FSMap version 18 2023-07-21T19:09:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x1dea250 con 0x1c4b710 2023-07-21T19:09:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 1 -- 172.21.15.123:0/3198888672 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f04330 con 0x1c4b710 2023-07-21T19:09:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 1 -- 172.21.15.123:0/3198888672 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0044003c60 con 0x1c4b710 2023-07-21T19:09:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 10 client.5841 fetch_fsmap finished waiting for FSMap version 18 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 10 client.5841 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 20 client.5841 populate_metadata read hostname 'smithi123' 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1f09300 0x1f068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 4 client.5841 mds_command: new command op to 5655 tid=0[{"prefix": "status"}] 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 --> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f004c007ad0 con 0x1f09300 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f00527fc700 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1f09300 0x1f068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f0031ffb700 10 client.5841 ms_handle_connect on v2:172.21.15.145:6832/2403302730 2023-07-21T19:09:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.882+0000 7f00527fc700 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1f09300 0x1f068c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b967bfd7af4faea server_cookie=87a0ff3917264824 in_seq=0 out_seq=0 2023-07-21T19:09:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0031ffb700 1 -- 172.21.15.123:0/3198888672 <== mds.0 v2:172.21.15.145:6832/2403302730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f004c007ad0 con 0x1f09300 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0031ffb700 10 client.5841 handle_command_reply: tid=0 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 client.5841 shutdown 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 msgr2=0x1f656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 0x1f656e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0044013000 tx=0x7f004400e000 comp rx=0 tx=0).stop 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 shutdown_connections 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:6832/2403302730,v1:172.21.15.145:6833/2403302730] conn(0x1f09300 0x1f068c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x1ee85c0 0x1f08dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0031ffb700 0 client.5841 ms_handle_reset on v2:172.21.15.145:6832/2403302730 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x1c4beb0 0x1f218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 --2- 172.21.15.123:0/3198888672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1c4b710 0x1f656e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 >> 172.21.15.123:0/3198888672 conn(0x1eb5b60 msgr2=0x1f0b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 shutdown_connections 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 1 -- 172.21.15.123:0/3198888672 wait complete. 2023-07-21T19:09:35.902 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f005c5ac740 20 client.5841 trim_cache size 0 max 16384 2023-07-21T19:09:35.903 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:09:35.903 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "786ff8a7-6b4c-4933-876c-0b96df73a43e", 2023-07-21T19:09:35.903 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2023-07-21T19:09:35.903 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5655, 2023-07-21T19:09:35.903 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2023-07-21T19:09:35.903 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 6.7412870329999999, 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 18, 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 43, 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 43, 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 15.593583411999999 2023-07-21T19:09:35.904 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:09:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f00400662f0 msgr2=0x7f00400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f00400662f0 0x7f00400687a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0044000c00 tx=0x7f0044008030 comp rx=0 tx=0).stop 2023-07-21T19:09:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 msgr2=0x7f00541578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00541578c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f004c00caa0 tx=0x7f004c00cad0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 shutdown_connections 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f00400662f0 0x7f00400687a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005415bff0 0x7f00541578c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00540cf1c0 0x7f00541f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 --2- 172.21.15.123:0/41752680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00540cd070 0x7f00540b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 >> 172.21.15.123:0/41752680 conn(0x7f0054060c40 msgr2=0x7f0054070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 shutdown_connections 2023-07-21T19:09:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:35.886+0000 7f0059326700 1 -- 172.21.15.123:0/41752680 wait complete. 2023-07-21T19:09:35.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T19:09:36.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.090+0000 7fc62863b700 1 Processor -- start 2023-07-21T19:09:36.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.090+0000 7fc62863b700 1 -- start start 2023-07-21T19:09:36.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc62863b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc6200cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:36.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc62863b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc6200c1e00 0x7fc6200cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:36.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc62863b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6200cc1b0 con 0x7fc62006be70 2023-07-21T19:09:36.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc62863b700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6200cd690 con 0x7fc6200c1e00 2023-07-21T19:09:36.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc62863b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6200cd970 con 0x7fc62006d860 2023-07-21T19:09:36.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc625bd6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc62006be70 0x7fc62006dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:52142/0 (socket says 172.21.15.123:52142) 2023-07-21T19:09:36.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc625bd6700 1 -- 172.21.15.123:0/3854392382 learned_addr learned my addr 172.21.15.123:0/3854392382 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:36.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6263d7700 1 --2- 172.21.15.123:0/3854392382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc6200cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:36.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc626bd8700 1 --2- 172.21.15.123:0/3854392382 >> v2:172.21.15.145:3300/0 conn(0x7fc6200c1e00 0x7fc6200cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:36.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6253d5700 1 -- 172.21.15.123:0/3854392382 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511654768 0 0) 0x7fc6200cc1b0 con 0x7fc62006be70 2023-07-21T19:09:36.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6253d5700 1 -- 172.21.15.123:0/3854392382 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc60c0035d0 con 0x7fc62006be70 2023-07-21T19:09:36.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6263d7700 1 -- 172.21.15.123:0/3854392382 >> v2:172.21.15.145:3300/0 conn(0x7fc6200c1e00 msgr2=0x7fc6200cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:36.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6263d7700 1 --2- 172.21.15.123:0/3854392382 >> v2:172.21.15.145:3300/0 conn(0x7fc6200c1e00 0x7fc6200cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6263d7700 1 -- 172.21.15.123:0/3854392382 >> v1:172.21.15.123:6789/0 conn(0x7fc62006be70 legacy=0x7fc62006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:36.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.094+0000 7fc6263d7700 1 -- 172.21.15.123:0/3854392382 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200cdc50 con 0x7fc62006d860 2023-07-21T19:09:36.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc6263d7700 1 --2- 172.21.15.123:0/3854392382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc6200cb840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009880 tx=0x7fc61c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547764ab0307f7ab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:36.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc6253d5700 1 -- 172.21.15.123:0/3854392382 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011830 con 0x7fc62006d860 2023-07-21T19:09:36.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc6253d5700 1 -- 172.21.15.123:0/3854392382 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c011990 con 0x7fc62006d860 2023-07-21T19:09:36.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc6253d5700 1 -- 172.21.15.123:0/3854392382 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011d20 con 0x7fc62006d860 2023-07-21T19:09:36.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 -- 172.21.15.123:0/3854392382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 msgr2=0x7fc6200cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:36.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 --2- 172.21.15.123:0/3854392382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc6200cb840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009880 tx=0x7fc61c009b90 comp rx=0 tx=0).stop 2023-07-21T19:09:36.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 -- 172.21.15.123:0/3854392382 shutdown_connections 2023-07-21T19:09:36.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 --2- 172.21.15.123:0/3854392382 >> v2:172.21.15.145:3300/0 conn(0x7fc6200c1e00 0x7fc6200cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 --2- 172.21.15.123:0/3854392382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc6200cb840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 -- 172.21.15.123:0/3854392382 >> 172.21.15.123:0/3854392382 conn(0x7fc6200cad30 msgr2=0x7fc6200cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:36.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 -- 172.21.15.123:0/3854392382 shutdown_connections 2023-07-21T19:09:36.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.098+0000 7fc62863b700 1 -- 172.21.15.123:0/3854392382 wait complete. 2023-07-21T19:09:36.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 Processor -- start 2023-07-21T19:09:36.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 -- start start 2023-07-21T19:09:36.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62006be70 0x7fc6201579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:36.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc620146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:36.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 0x7fc6200c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:36.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620155290 con 0x7fc6200c1e00 2023-07-21T19:09:36.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620154fb0 con 0x7fc62006be70 2023-07-21T19:09:36.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc620156ee0 con 0x7fc62006d860 2023-07-21T19:09:36.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 0x7fc6200c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 0x7fc6200c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47542/0 (socket says 172.21.15.123:47542) 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 -- 172.21.15.123:0/763501402 learned_addr learned my addr 172.21.15.123:0/763501402 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc625bd6700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc620146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc6263d7700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62006be70 0x7fc6201579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 -- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 msgr2=0x7fc620146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc620146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 -- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62006be70 msgr2=0x7fc6201579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:36.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62006be70 0x7fc6201579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 -- 172.21.15.123:0/763501402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0094b0 con 0x7fc6200c1e00 2023-07-21T19:09:36.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc626bd8700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 0x7fc6200c9950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc61800efc0 tx=0x7fc61800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:36.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800cad0 con 0x7fc6200c1e00 2023-07-21T19:09:36.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61800f040 con 0x7fc6200c1e00 2023-07-21T19:09:36.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800ce70 con 0x7fc6200c1e00 2023-07-21T19:09:36.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.102+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6201571c0 con 0x7fc6200c1e00 2023-07-21T19:09:36.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.106+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc620157f00 con 0x7fc6200c1e00 2023-07-21T19:09:36.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.106+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc620156d40 con 0x7fc6200c1e00 2023-07-21T19:09:36.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.106+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc618014480 con 0x7fc6200c1e00 2023-07-21T19:09:36.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.110+0000 7fc616ffd700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6040662f0 0x7fc6040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:36.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.110+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc618084670 con 0x7fc6200c1e00 2023-07-21T19:09:36.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.110+0000 7fc6263d7700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6040662f0 0x7fc6040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:36.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.110+0000 7fc6263d7700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6040662f0 0x7fc6040687a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc61c000c00 tx=0x7fc61c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:36.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.114+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc620156d40 con 0x7fc6200c1e00 2023-07-21T19:09:36.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.322+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc620158090 con 0x7fc6200c1e00 2023-07-21T19:09:36.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.322+0000 7fc616ffd700 1 -- 172.21.15.123:0/763501402 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc620158090 con 0x7fc6200c1e00 2023-07-21T19:09:36.339 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T19:09:36.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6040662f0 msgr2=0x7fc6040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:36.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6040662f0 0x7fc6040687a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc61c000c00 tx=0x7fc61c008030 comp rx=0 tx=0).stop 2023-07-21T19:09:36.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 msgr2=0x7fc6200c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 0x7fc6200c9950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc61800efc0 tx=0x7fc61800c0c0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 shutdown_connections 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7fc6040662f0 0x7fc6040687a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6200c1e00 0x7fc6200c9950 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc62006d860 0x7fc620146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 --2- 172.21.15.123:0/763501402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62006be70 0x7fc6201579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 >> 172.21.15.123:0/763501402 conn(0x7fc6200cad30 msgr2=0x7fc6200c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 shutdown_connections 2023-07-21T19:09:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:36.330+0000 7fc62863b700 1 -- 172.21.15.123:0/763501402 wait complete. 2023-07-21T19:09:36.365 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T19:09:36.365 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T19:09:36.366 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2023-07-21T19:09:36.366 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T19:09:36.366 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T19:09:36.366 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T19:09:36.367 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T19:09:36.367 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T19:09:36.368 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T19:09:36.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:36.368 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2023-07-21T19:09:36.386 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T19:09:36.386 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T19:09:36.387 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T19:09:36.387 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.387 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-07-21T19:09:36.387 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.387 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:09:36.387 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T19:09:36.388 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42046sec preferred_lft 42046sec 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:a8:46:62:f1 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:09:36.389 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 2e:56:ab:d6:78:f2 brd ff:ff:ff:ff:ff:ff 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc0:5ff:feb1:7f7e/64 scope link 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.390 INFO:teuthology.orchestra.run.smithi123.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:bd:ab:33:4d:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcbd:abff:fe33:4d9d/64 scope link 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 2e:56:ab:d6:78:f2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::2c56:abff:fed6:78f2/64 scope link 2023-07-21T19:09:36.391 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-07-21T19:09:36.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:36.393 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T19:09:36.472 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-07-21T19:09:36.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:36.475 DEBUG:teuthology.orchestra.run.smithi123:> route 2023-07-21T19:09:36.543 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2023-07-21T19:09:36.543 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T19:09:36.543 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T19:09:36.543 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T19:09:36.543 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T19:09:36.543 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-21T19:09:36.544 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T19:09:36.544 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T19:09:36.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:36.545 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-07-21T19:09:36.546 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-07-21T19:09:36.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T19:09:36.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T19:09:36.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T19:09:36.547 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-07-21T19:09:36.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:36.680 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-07-21T19:09:36.697 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T19:09:36.697 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T19:09:36.698 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T19:09:36.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:36.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2023-07-21T19:09:36.774 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-21T19:09:36.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:09:36.775 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T19:09:36.832 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T19:09:36.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T19:09:36.833 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T19:09:36.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:09:36.972 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:09:36.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:09:37.047 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:09:37.049 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:09:37.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:37.050 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:09:37.108 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T19:09:37.109 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-21T19:09:37.150 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:37.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2023-07-21T19:09:37.166 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:37.239 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T19:09:37.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T19:09:37.302 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2023-07-21T19:09:37.286+0000 7ffb39dd7640 -1 init, newargv = 0x56347cf7a050 newargc=15 2023-07-21T19:09:37.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[46849]: starting ceph client 2023-07-21T19:09:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T19:09:37.315 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T19:09:37.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:37.317 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2023-07-21T19:09:37.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[46849]: starting fuse 2023-07-21T19:09:37.381 INFO:teuthology.orchestra.run.smithi123.stdout:48 2023-07-21T19:09:37.382 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2023-07-21T19:09:37.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T19:09:37.383 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2023-07-21T19:09:37.384 DEBUG:teuthology.orchestra.run.smithi123:> import re 2023-07-21T19:09:37.384 DEBUG:teuthology.orchestra.run.smithi123:> import os 2023-07-21T19:09:37.385 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2023-07-21T19:09:37.385 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:09:37.386 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2023-07-21T19:09:37.387 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T19:09:37.387 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2023-07-21T19:09:37.387 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-21T19:09:37.388 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:09:37.388 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2023-07-21T19:09:37.388 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2023-07-21T19:09:37.389 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2023-07-21T19:09:37.389 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2023-07-21T19:09:37.389 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:09:37.390 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2023-07-21T19:09:37.390 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T19:09:37.390 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T19:09:37.391 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T19:09:37.391 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2023-07-21T19:09:37.391 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2023-07-21T19:09:37.391 DEBUG:teuthology.orchestra.run.smithi123:> return f 2023-07-21T19:09:37.392 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T19:09:37.392 DEBUG:teuthology.orchestra.run.smithi123:> 2023-07-21T19:09:37.392 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2023-07-21T19:09:37.393 DEBUG:teuthology.orchestra.run.smithi123:> ' 2023-07-21T19:09:37.540 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.46849.asok 2023-07-21T19:09:37.724 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46849.asok 2023-07-21T19:09:37.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:37.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46849.asok status 2023-07-21T19:09:37.919 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-07-21T19:09:37.919 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "81cf785aa7781c4e08381c540f890cb9bc987ef9", 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev)", 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "46849", 2023-07-21T19:09:37.920 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2023-07-21T19:09:37.921 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:37.921 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2023-07-21T19:09:37.921 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2023-07-21T19:09:37.921 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5853, 2023-07-21T19:09:37.921 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2023-07-21T19:09:37.921 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5853 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1886310837 2023-07-21T19:09:37.922 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-07-21T19:09:37.923 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:37.923 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2023-07-21T19:09:37.923 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2023-07-21T19:09:37.923 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2023-07-21T19:09:37.923 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1886310837 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.5853 192.168.0.1:0/1886310837", 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1886310837", 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 18, 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 43, 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2023-07-21T19:09:37.924 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2023-07-21T19:09:37.925 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2023-07-21T19:09:37.925 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-07-21T19:09:37.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:37.934 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2023-07-21T19:09:37.934 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-21T19:09:37.951 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2023-07-21T19:09:37.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-21T19:09:37.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:37.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T19:09:38.028 DEBUG:teuthology.orchestra.run.smithi123:> mktemp -d --suffix=xfstests-dev 2023-07-21T19:09:38.089 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.pvIJ2qKH9pxfstests-dev 2023-07-21T19:09:38.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:38.089 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.pvIJ2qKH9pxfstests-dev) 2023-07-21T19:09:38.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:38.176 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.pvIJ2qKH9pxfstests-dev) 2023-07-21T19:09:38.254 INFO:teuthology.orchestra.run.smithi123.stderr:Cloning into '/tmp/tmp.pvIJ2qKH9pxfstests-dev'... 2023-07-21T19:09:39.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:39.274 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-21T19:09:39.356 DEBUG:teuthology.orchestra.run.smithi123:> mktemp -d --suffix=test 2023-07-21T19:09:39.415 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.845xdYTdCWtest 2023-07-21T19:09:39.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:09:39.416 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-21T19:09:39.493 DEBUG:teuthology.orchestra.run.smithi123:> mktemp -d --suffix=scratch 2023-07-21T19:09:39.552 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.DEIyBfWXOYscratch 2023-07-21T19:09:39.553 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-07-21T19:09:39.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-07-21T19:09:39.722 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2023-07-21T19:09:39.921 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2023-07-21T19:09:39.921 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2023-07-21T19:09:40.103 INFO:teuthology.orchestra.run.smithi123.stdout:attr is already the newest version (1:2.4.48-5). 2023-07-21T19:09:40.103 INFO:teuthology.orchestra.run.smithi123.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-07-21T19:09:40.103 INFO:teuthology.orchestra.run.smithi123.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-07-21T19:09:40.103 INFO:teuthology.orchestra.run.smithi123.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-07-21T19:09:40.103 INFO:teuthology.orchestra.run.smithi123.stdout:gcc set to manually installed. 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:make is already the newest version (4.2.1-1.2). 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:make set to manually installed. 2023-07-21T19:09:40.104 INFO:teuthology.orchestra.run.smithi123.stdout:quota is already the newest version (4.05-1). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:dbench is already the newest version (4.0-2build1). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:python2 set to manually installed. 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.4). 2023-07-21T19:09:40.105 INFO:teuthology.orchestra.run.smithi123.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.4). 2023-07-21T19:09:40.106 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T19:09:40.106 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-21T19:09:40.106 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T19:09:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2023-07-21T19:09:40.107 INFO:teuthology.orchestra.run.smithi123.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-07-21T19:09:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2023-07-21T19:09:40.107 INFO:teuthology.orchestra.run.smithi123.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-07-21T19:09:40.171 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2023-07-21T19:09:40.172 INFO:teuthology.orchestra.run.smithi123.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-07-21T19:09:40.173 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2023-07-21T19:09:40.174 INFO:teuthology.orchestra.run.smithi123.stdout: libsqlite3-0 uuid-runtime 2023-07-21T19:09:40.312 INFO:teuthology.orchestra.run.smithi123.stdout:2 upgraded, 7 newly installed, 0 to remove and 204 not upgraded. 2023-07-21T19:09:40.312 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 2,464 kB of archives. 2023-07-21T19:09:40.313 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-07-21T19:09:40.313 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-runtime amd64 2.34-0.1ubuntu9.4 [35.4 kB] 2023-07-21T19:09:40.556 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-07-21T19:09:40.866 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-07-21T19:09:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-07-21T19:09:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-07-21T19:09:40.907 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-07-21T19:09:40.908 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-07-21T19:09:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-07-21T19:09:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-07-21T19:09:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:debconf: unable to initialize frontend: Dialog 2023-07-21T19:09:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-07-21T19:09:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:debconf: falling back to frontend: Readline 2023-07-21T19:09:41.462 INFO:teuthology.orchestra.run.smithi123.stderr:debconf: unable to initialize frontend: Readline 2023-07-21T19:09:41.463 INFO:teuthology.orchestra.run.smithi123.stderr:debconf: (This frontend requires a controlling tty.) 2023-07-21T19:09:41.463 INFO:teuthology.orchestra.run.smithi123.stderr:debconf: falling back to frontend: Teletype 2023-07-21T19:09:41.477 INFO:teuthology.orchestra.run.smithi123.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-07-21T19:09:41.562 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 2,464 kB in 1s (2,611 kB/s) 2023-07-21T19:09:41.897 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121317 files and directories currently installed.) 2023-07-21T19:09:41.901 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../0-uuid-runtime_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-21T19:09:42.045 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking uuid-runtime (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-21T19:09:42.672 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../1-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-07-21T19:09:42.810 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-07-21T19:09:43.280 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-07-21T19:09:43.296 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../2-libglusterfs0_7.2-2build1_amd64.deb ... 2023-07-21T19:09:43.389 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-07-21T19:09:43.801 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-07-21T19:09:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../3-libgfxdr0_7.2-2build1_amd64.deb ... 2023-07-21T19:09:43.859 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-07-21T19:09:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-07-21T19:09:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../4-libgfrpc0_7.2-2build1_amd64.deb ... 2023-07-21T19:09:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-07-21T19:09:44.690 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-07-21T19:09:44.711 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../5-libgfapi0_7.2-2build1_amd64.deb ... 2023-07-21T19:09:44.757 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-07-21T19:09:45.168 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package fio. 2023-07-21T19:09:45.190 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../6-fio_3.16-1_amd64.deb ... 2023-07-21T19:09:45.235 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking fio (3.16-1) ... 2023-07-21T19:09:45.606 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-07-21T19:09:45.626 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../7-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-07-21T19:09:45.697 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-07-21T19:09:46.076 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package sqlite3. 2023-07-21T19:09:46.092 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../8-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-07-21T19:09:46.125 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-07-21T19:09:46.576 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-07-21T19:09:46.705 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-07-21T19:09:46.873 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up uuid-runtime (2.34-0.1ubuntu9.4) ... 2023-07-21T19:09:48.383 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-07-21T19:09:48.509 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-07-21T19:09:48.627 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-07-21T19:09:48.803 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-07-21T19:09:48.929 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-07-21T19:09:49.055 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up fio (3.16-1) ... 2023-07-21T19:09:49.383 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-21T19:09:49.593 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-21T19:09:50.086 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-21T19:09:53.271 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-21T19:09:54.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo useradd -m fsgqa 2023-07-21T19:09:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:useradd: user 'fsgqa' already exists 2023-07-21T19:09:54.286 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-21T19:09:54.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo groupadd fsgqa 2023-07-21T19:09:54.364 INFO:teuthology.orchestra.run.smithi123.stderr:groupadd: group 'fsgqa' already exists 2023-07-21T19:09:54.366 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-21T19:09:54.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo useradd fsgqa2 2023-07-21T19:09:54.845 DEBUG:teuthology.orchestra.run.smithi123:> sudo useradd 123456-fsgqa 2023-07-21T19:09:55.295 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-21T19:09:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.457+0000 7f389ccc4700 1 Processor -- start 2023-07-21T19:09:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.457+0000 7f389ccc4700 1 -- start start 2023-07-21T19:09:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f389ccc4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f389815be80 0x7f3898160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f389ccc4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389815c250 con 0x7f389806f070 2023-07-21T19:09:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f389ccc4700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980b3bb0 con 0x7f38980b2150 2023-07-21T19:09:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f389ccc4700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3898160950 con 0x7f389815be80 2023-07-21T19:09:55.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f3897fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f389806f070 0x7f38980cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47166/0 (socket says 172.21.15.123:47166) 2023-07-21T19:09:55.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f3897fff700 1 -- 172.21.15.123:0/979394121 learned_addr learned my addr 172.21.15.123:0/979394121 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:55.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f38977fe700 1 --2- 172.21.15.123:0/979394121 >> v2:172.21.15.145:3300/0 conn(0x7f389815be80 0x7f3898160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f38967fc700 1 -- 172.21.15.123:0/979394121 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368818534 0 0) 0x7f389815c250 con 0x7f389806f070 2023-07-21T19:09:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f38967fc700 1 -- 172.21.15.123:0/979394121 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38800035d0 con 0x7f389806f070 2023-07-21T19:09:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f38977fe700 1 -- 172.21.15.123:0/979394121 >> v1:172.21.15.145:6789/0 conn(0x7f38980b2150 legacy=0x7f389806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f38977fe700 1 -- 172.21.15.123:0/979394121 >> v1:172.21.15.123:6789/0 conn(0x7f389806f070 legacy=0x7f38980cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.461+0000 7f38977fe700 1 -- 172.21.15.123:0/979394121 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389806b310 con 0x7f389815be80 2023-07-21T19:09:55.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f38977fe700 1 --2- 172.21.15.123:0/979394121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389815be80 0x7f3898160370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3888009850 tx=0x7f3888009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61c46ee1c7c1961 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:55.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f38967fc700 1 -- 172.21.15.123:0/979394121 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888011830 con 0x7f389815be80 2023-07-21T19:09:55.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f38967fc700 1 -- 172.21.15.123:0/979394121 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888011990 con 0x7f389815be80 2023-07-21T19:09:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f38967fc700 1 -- 172.21.15.123:0/979394121 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888011d00 con 0x7f389815be80 2023-07-21T19:09:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 -- 172.21.15.123:0/979394121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389815be80 msgr2=0x7f3898160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 --2- 172.21.15.123:0/979394121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389815be80 0x7f3898160370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3888009850 tx=0x7f3888009b60 comp rx=0 tx=0).stop 2023-07-21T19:09:55.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 -- 172.21.15.123:0/979394121 shutdown_connections 2023-07-21T19:09:55.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 --2- 172.21.15.123:0/979394121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389815be80 0x7f3898160370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 -- 172.21.15.123:0/979394121 >> 172.21.15.123:0/979394121 conn(0x7f389806fa70 msgr2=0x7f389806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:55.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 -- 172.21.15.123:0/979394121 shutdown_connections 2023-07-21T19:09:55.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.465+0000 7f389ccc4700 1 -- 172.21.15.123:0/979394121 wait complete. 2023-07-21T19:09:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 Processor -- start 2023-07-21T19:09:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 -- start start 2023-07-21T19:09:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389806f070 0x7f389814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38980b2150 0x7f389814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 0x7f389814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389814c480 con 0x7f389815be80 2023-07-21T19:09:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389814b870 con 0x7f389806f070 2023-07-21T19:09:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f389ccc4700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389814bb50 con 0x7f38980b2150 2023-07-21T19:09:55.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 0x7f389814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 0x7f389814f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54856/0 (socket says 172.21.15.123:54856) 2023-07-21T19:09:55.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 -- 172.21.15.123:0/3813183321 learned_addr learned my addr 172.21.15.123:0/3813183321 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3896ffd700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38980b2150 0x7f389814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f38977fe700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389806f070 0x7f389814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 -- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38980b2150 msgr2=0x7f389814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38980b2150 0x7f389814d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 -- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389806f070 msgr2=0x7f389814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389806f070 0x7f389814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.469+0000 7f3897fff700 1 -- 172.21.15.123:0/3813183321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880094b0 con 0x7f389815be80 2023-07-21T19:09:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f3897fff700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 0x7f389814f670 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f389000caa0 tx=0x7f389000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890007480 con 0x7f389815be80 2023-07-21T19:09:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38900075e0 con 0x7f389815be80 2023-07-21T19:09:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389814be30 con 0x7f389815be80 2023-07-21T19:09:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890007990 con 0x7f389815be80 2023-07-21T19:09:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389814b3b0 con 0x7f389815be80 2023-07-21T19:09:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.473+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389814c630 con 0x7f389815be80 2023-07-21T19:09:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.477+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f389001b3b0 con 0x7f389815be80 2023-07-21T19:09:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.477+0000 7f387ffff700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f38840662f0 0x7f38840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.477+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3890083790 con 0x7f389815be80 2023-07-21T19:09:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.477+0000 7f38977fe700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f38840662f0 0x7f38840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.477+0000 7f38977fe700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f38840662f0 0x7f38840687a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3888009ba0 tx=0x7f3888008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.485+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f389814c630 con 0x7f389815be80 2023-07-21T19:09:55.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.721+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f389804e500 con 0x7f389815be80 2023-07-21T19:09:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.721+0000 7f387ffff700 1 -- 172.21.15.123:0/3813183321 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f3890050a30 con 0x7f389815be80 2023-07-21T19:09:55.733 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:09:55.733 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":1,"fsid":"786ff8a7-6b4c-4933-876c-0b96df73a43e","modified":"2023-07-21T19:06:38.618962Z","created":"2023-07-21T19:06:38.618962Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3301","nonce":0},{"type":"v1","addr":"172.21.15.145:6790","nonce":0}]},"addr":"172.21.15.145:6790/0","public_addr":"172.21.15.145:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-21T19:09:55.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f38840662f0 msgr2=0x7f38840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f38840662f0 0x7f38840687a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3888009ba0 tx=0x7f3888008030 comp rx=0 tx=0).stop 2023-07-21T19:09:55.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 msgr2=0x7f389814f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 0x7f389814f670 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f389000caa0 tx=0x7f389000cad0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 shutdown_connections 2023-07-21T19:09:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f38840662f0 0x7f38840687a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815be80 0x7f389814f670 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38980b2150 0x7f389814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 --2- 172.21.15.123:0/3813183321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f389806f070 0x7f389814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 >> 172.21.15.123:0/3813183321 conn(0x7f389806fa70 msgr2=0x7f38981520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 shutdown_connections 2023-07-21T19:09:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.725+0000 7f389ccc4700 1 -- 172.21.15.123:0/3813183321 wait complete. 2023-07-21T19:09:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:dumped monmap epoch 1 2023-07-21T19:09:55.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-07-21T19:09:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.917+0000 7f18548a2700 1 Processor -- start 2023-07-21T19:09:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.917+0000 7f18548a2700 1 -- start start 2023-07-21T19:09:55.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f18548a2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f18548a2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f18500c1e00 0x7f18500cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f18548a2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18500cc1b0 con 0x7f185006d860 2023-07-21T19:09:55.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f18548a2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18500cd690 con 0x7f18500c1e00 2023-07-21T19:09:55.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f18548a2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18500cd970 con 0x7f185006be70 2023-07-21T19:09:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f185006d860 0x7f185006dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47180/0 (socket says 172.21.15.123:47180) 2023-07-21T19:09:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184e59c700 1 -- 172.21.15.123:0/2614309173 learned_addr learned my addr 172.21.15.123:0/2614309173 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-21T19:09:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184ed9d700 1 --2- 172.21.15.123:0/2614309173 >> v2:172.21.15.145:3300/0 conn(0x7f18500c1e00 0x7f18500cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184dd9b700 1 --2- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184ed9d700 1 -- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 msgr2=0x7f18500cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T19:09:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184ed9d700 1 --2- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184ed9d700 1 -- 172.21.15.123:0/2614309173 >> v1:172.21.15.123:6789/0 conn(0x7f185006d860 legacy=0x7f185006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184ed9d700 1 -- 172.21.15.123:0/2614309173 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18500cdc50 con 0x7f18500c1e00 2023-07-21T19:09:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184d59a700 1 -- 172.21.15.123:0/2614309173 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091693170 0 0) 0x7f18500cc1b0 con 0x7f185006d860 2023-07-21T19:09:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184ed9d700 1 --2- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18500c1e00 0x7f18500cc640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1848009dc0 tx=0x7f184800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47bda164c69f873 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.921+0000 7f184d59a700 1 -- 172.21.15.123:0/2614309173 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184800e070 con 0x7f18500c1e00 2023-07-21T19:09:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f184d59a700 1 -- 172.21.15.123:0/2614309173 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184800bae0 con 0x7f18500c1e00 2023-07-21T19:09:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f184d59a700 1 -- 172.21.15.123:0/2614309173 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184800be90 con 0x7f18500c1e00 2023-07-21T19:09:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 -- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18500c1e00 msgr2=0x7f18500cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 --2- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18500c1e00 0x7f18500cc640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1848009dc0 tx=0x7f184800b330 comp rx=0 tx=0).stop 2023-07-21T19:09:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 -- 172.21.15.123:0/2614309173 shutdown_connections 2023-07-21T19:09:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 --2- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18500c1e00 0x7f18500cc640 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 --2- 172.21.15.123:0/2614309173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 -- 172.21.15.123:0/2614309173 >> 172.21.15.123:0/2614309173 conn(0x7f18500cad30 msgr2=0x7f18500cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 -- 172.21.15.123:0/2614309173 shutdown_connections 2023-07-21T19:09:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.925+0000 7f18548a2700 1 -- 172.21.15.123:0/2614309173 wait complete. 2023-07-21T19:09:55.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 Processor -- start 2023-07-21T19:09:55.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 -- start start 2023-07-21T19:09:55.940 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f185006d860 0x7f1850152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 0x7f18500c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18500aeea0 con 0x7f18500c1e00 2023-07-21T19:09:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1850152f80 con 0x7f185006d860 2023-07-21T19:09:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f18548a2700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18500ae230 con 0x7f185006be70 2023-07-21T19:09:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 0x7f18500c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 0x7f18500c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54862/0 (socket says 172.21.15.123:54862) 2023-07-21T19:09:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 -- 172.21.15.123:0/3539087481 learned_addr learned my addr 172.21.15.123:0/3539087481 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-21T19:09:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184e59c700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184dd9b700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f185006d860 0x7f1850152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 -- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 msgr2=0x7f18500adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 -- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f185006d860 msgr2=0x7f1850152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f185006d860 0x7f1850152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 -- 172.21.15.123:0/3539087481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848009a70 con 0x7f18500c1e00 2023-07-21T19:09:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.929+0000 7f184ed9d700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 0x7f18500c5380 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f18500700e0 tx=0x7f1848004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848004510 con 0x7f18500c1e00 2023-07-21T19:09:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1848020070 con 0x7f18500c1e00 2023-07-21T19:09:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1850152aa0 con 0x7f18500c1e00 2023-07-21T19:09:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480048b0 con 0x7f18500c1e00 2023-07-21T19:09:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18501540f0 con 0x7f18500c1e00 2023-07-21T19:09:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185004dcb0 con 0x7f18500c1e00 2023-07-21T19:09:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.933+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1848012430 con 0x7f18500c1e00 2023-07-21T19:09:55.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.937+0000 7f183effd700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f18300662f0 0x7f18300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T19:09:55.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.937+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1848022070 con 0x7f18500c1e00 2023-07-21T19:09:55.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.937+0000 7f184e59c700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f18300662f0 0x7f18300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T19:09:55.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.937+0000 7f184e59c700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f18300662f0 0x7f18300687a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1840000f60 tx=0x7f1840007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T19:09:55.952 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:55.941+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1848052d90 con 0x7f18500c1e00 2023-07-21T19:09:56.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.169+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f18500ab8f0 con 0x7f18500c1e00 2023-07-21T19:09:56.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.173+0000 7f183effd700 1 -- 172.21.15.123:0/3539087481 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f184802c0b0 con 0x7f18500c1e00 2023-07-21T19:09:56.184 INFO:teuthology.orchestra.run.smithi123.stdout:[client.admin] 2023-07-21T19:09:56.184 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+17pkydHCNRAA1YAJMuIzdTSDMYQzA8VFRA== 2023-07-21T19:09:56.185 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow *" 2023-07-21T19:09:56.185 INFO:teuthology.orchestra.run.smithi123.stdout: caps mgr = "allow *" 2023-07-21T19:09:56.185 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow *" 2023-07-21T19:09:56.185 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow *" 2023-07-21T19:09:56.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f18300662f0 msgr2=0x7f18300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f18300662f0 0x7f18300687a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1840000f60 tx=0x7f1840007e00 comp rx=0 tx=0).stop 2023-07-21T19:09:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 msgr2=0x7f18500c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T19:09:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 0x7f18500c5380 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f18500700e0 tx=0x7f1848004af0 comp rx=0 tx=0).stop 2023-07-21T19:09:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 shutdown_connections 2023-07-21T19:09:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:6832/1650121890,v1:172.21.15.123:6833/1650121890] conn(0x7f18300662f0 0x7f18300687a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f185006d860 0x7f1850152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18500c1e00 0x7f18500c5380 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 --2- 172.21.15.123:0/3539087481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f185006be70 0x7f18500adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T19:09:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 >> 172.21.15.123:0/3539087481 conn(0x7f18500cad30 msgr2=0x7f18500cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T19:09:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 shutdown_connections 2023-07-21T19:09:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-21T19:09:56.177+0000 7f18548a2700 1 -- 172.21.15.123:0/3539087481 wait complete. 2023-07-21T19:09:56.210 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-07-21T19:09:56.224 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.gbTuXWiYCY 2023-07-21T19:09:56.225 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:09:56.225 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/tmp/tmp.gbTuXWiYCY 2023-07-21T19:09:56.284 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:09:56.285 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/tmp/tmp.pvIJ2qKH9pxfstests-dev/local.config 2023-07-21T19:09:56.363 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.845xdYTdCWtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.DEIyBfWXOYscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.123:6789 -k /tmp/tmp.gbTuXWiYCY --client_mountpoint /test" 2023-07-21T19:09:56.364 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T19:09:56.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/tmp/tmp.pvIJ2qKH9pxfstests-dev/ceph.exclude 2023-07-21T19:09:56.440 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo make) 2023-07-21T19:09:56.554 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize -cfi 2023-07-21T19:09:57.208 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-21T19:09:57.208 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file './config.guess' 2023-07-21T19:09:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file './config.sub' 2023-07-21T19:09:57.262 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file './install-sh' 2023-07-21T19:09:57.290 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file './ltmain.sh' 2023-07-21T19:09:57.413 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-21T19:09:57.413 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-21T19:09:57.443 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-21T19:09:57.472 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-21T19:09:57.497 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-21T19:09:57.525 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-21T19:09:57.547 INFO:teuthology.orchestra.run.smithi123.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-21T19:09:57.553 INFO:teuthology.orchestra.run.smithi123.stdout:cp include/install-sh . 2023-07-21T19:09:57.558 INFO:teuthology.orchestra.run.smithi123.stdout:aclocal -I m4 2023-07-21T19:09:59.137 INFO:teuthology.orchestra.run.smithi123.stdout:autoheader 2023-07-21T19:09:59.582 INFO:teuthology.orchestra.run.smithi123.stdout:autoconf 2023-07-21T19:09:59.909 INFO:teuthology.orchestra.run.smithi123.stdout:./configure \ 2023-07-21T19:09:59.910 INFO:teuthology.orchestra.run.smithi123.stdout: --libexecdir=/usr/lib \ 2023-07-21T19:09:59.910 INFO:teuthology.orchestra.run.smithi123.stdout: --exec_prefix=/var/lib 2023-07-21T19:10:00.952 INFO:teuthology.orchestra.run.smithi123.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-21T19:10:00.952 INFO:teuthology.orchestra.run.smithi123.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-21T19:10:01.017 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to print strings... printf 2023-07-21T19:10:01.018 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gcc... gcc 2023-07-21T19:10:01.357 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether the C compiler works... yes 2023-07-21T19:10:01.357 INFO:teuthology.orchestra.run.smithi123.stdout:checking for C compiler default output file name... a.out 2023-07-21T19:10:01.444 INFO:teuthology.orchestra.run.smithi123.stdout:checking for suffix of executables... 2023-07-21T19:10:01.578 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether we are cross compiling... no 2023-07-21T19:10:01.643 INFO:teuthology.orchestra.run.smithi123.stdout:checking for suffix of object files... o 2023-07-21T19:10:01.702 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether we are using the GNU C compiler... yes 2023-07-21T19:10:01.760 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether gcc accepts -g... yes 2023-07-21T19:10:01.922 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-21T19:10:01.934 INFO:teuthology.orchestra.run.smithi123.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-07-21T19:10:01.945 INFO:teuthology.orchestra.run.smithi123.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-07-21T19:10:01.951 INFO:teuthology.orchestra.run.smithi123.stdout:checking for egrep... /usr/bin/grep -E 2023-07-21T19:10:01.958 INFO:teuthology.orchestra.run.smithi123.stdout:checking for fgrep... /usr/bin/grep -F 2023-07-21T19:10:01.972 INFO:teuthology.orchestra.run.smithi123.stdout:checking for ld used by gcc... /usr/bin/ld 2023-07-21T19:10:01.982 INFO:teuthology.orchestra.run.smithi123.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-07-21T19:10:01.996 INFO:teuthology.orchestra.run.smithi123.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-07-21T19:10:02.074 INFO:teuthology.orchestra.run.smithi123.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-07-21T19:10:02.074 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether ln -s works... yes 2023-07-21T19:10:02.094 INFO:teuthology.orchestra.run.smithi123.stdout:checking the maximum length of command line arguments... 1572864 2023-07-21T19:10:02.106 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-21T19:10:02.107 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-21T19:10:02.107 INFO:teuthology.orchestra.run.smithi123.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-07-21T19:10:02.108 INFO:teuthology.orchestra.run.smithi123.stdout:checking for objdump... objdump 2023-07-21T19:10:02.109 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to recognize dependent libraries... pass_all 2023-07-21T19:10:02.110 INFO:teuthology.orchestra.run.smithi123.stdout:checking for dlltool... no 2023-07-21T19:10:02.110 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-21T19:10:02.111 INFO:teuthology.orchestra.run.smithi123.stdout:checking for ar... ar 2023-07-21T19:10:02.197 INFO:teuthology.orchestra.run.smithi123.stdout:checking for archiver @FILE support... @ 2023-07-21T19:10:02.198 INFO:teuthology.orchestra.run.smithi123.stdout:checking for strip... strip 2023-07-21T19:10:02.199 INFO:teuthology.orchestra.run.smithi123.stdout:checking for ranlib... ranlib 2023-07-21T19:10:02.200 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gawk... gawk 2023-07-21T19:10:02.392 INFO:teuthology.orchestra.run.smithi123.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-07-21T19:10:02.399 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sysroot... no 2023-07-21T19:10:02.416 INFO:teuthology.orchestra.run.smithi123.stdout:checking for a working dd... /usr/bin/dd 2023-07-21T19:10:02.430 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-07-21T19:10:02.484 INFO:teuthology.orchestra.run.smithi123.stdout:checking for mt... mt 2023-07-21T19:10:02.504 INFO:teuthology.orchestra.run.smithi123.stdout:checking if mt is a manifest tool... no 2023-07-21T19:10:03.043 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to run the C preprocessor... gcc -E 2023-07-21T19:10:03.430 INFO:teuthology.orchestra.run.smithi123.stdout:checking for ANSI C header files... yes 2023-07-21T19:10:03.506 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/types.h... yes 2023-07-21T19:10:03.607 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/stat.h... yes 2023-07-21T19:10:03.702 INFO:teuthology.orchestra.run.smithi123.stdout:checking for stdlib.h... yes 2023-07-21T19:10:03.798 INFO:teuthology.orchestra.run.smithi123.stdout:checking for string.h... yes 2023-07-21T19:10:03.901 INFO:teuthology.orchestra.run.smithi123.stdout:checking for memory.h... yes 2023-07-21T19:10:03.992 INFO:teuthology.orchestra.run.smithi123.stdout:checking for strings.h... yes 2023-07-21T19:10:04.093 INFO:teuthology.orchestra.run.smithi123.stdout:checking for inttypes.h... yes 2023-07-21T19:10:04.183 INFO:teuthology.orchestra.run.smithi123.stdout:checking for stdint.h... yes 2023-07-21T19:10:04.293 INFO:teuthology.orchestra.run.smithi123.stdout:checking for unistd.h... yes 2023-07-21T19:10:04.384 INFO:teuthology.orchestra.run.smithi123.stdout:checking for dlfcn.h... yes 2023-07-21T19:10:04.406 INFO:teuthology.orchestra.run.smithi123.stdout:checking for objdir... .libs 2023-07-21T19:10:04.643 INFO:teuthology.orchestra.run.smithi123.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-21T19:10:04.644 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-21T19:10:04.718 INFO:teuthology.orchestra.run.smithi123.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-21T19:10:04.930 INFO:teuthology.orchestra.run.smithi123.stdout:checking if gcc static flag -static works... yes 2023-07-21T19:10:05.028 INFO:teuthology.orchestra.run.smithi123.stdout:checking if gcc supports -c -o file.o... yes 2023-07-21T19:10:05.028 INFO:teuthology.orchestra.run.smithi123.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-21T19:10:05.072 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-21T19:10:05.153 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether -lc should be explicitly linked in... no 2023-07-21T19:10:05.317 INFO:teuthology.orchestra.run.smithi123.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-21T19:10:05.317 INFO:teuthology.orchestra.run.smithi123.stdout:checking how to hardcode library paths into programs... immediate 2023-07-21T19:10:05.345 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether stripping libraries is possible... yes 2023-07-21T19:10:05.345 INFO:teuthology.orchestra.run.smithi123.stdout:checking if libtool supports shared libraries... yes 2023-07-21T19:10:05.346 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether to build shared libraries... yes 2023-07-21T19:10:05.346 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether to build static libraries... yes 2023-07-21T19:10:05.386 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gcc... (cached) gcc 2023-07-21T19:10:05.460 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-21T19:10:05.461 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-21T19:10:05.461 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-21T19:10:05.462 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gmake... no 2023-07-21T19:10:05.463 INFO:teuthology.orchestra.run.smithi123.stdout:checking for make... /usr/bin/make 2023-07-21T19:10:05.463 INFO:teuthology.orchestra.run.smithi123.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-07-21T19:10:05.464 INFO:teuthology.orchestra.run.smithi123.stdout:checking for tar... /bin/tar 2023-07-21T19:10:05.465 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gzip... /bin/gzip 2023-07-21T19:10:05.494 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether gcc -MM is supported... yes 2023-07-21T19:10:05.496 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sort... /bin/sort 2023-07-21T19:10:05.496 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether ln -s works... yes 2023-07-21T19:10:05.497 INFO:teuthology.orchestra.run.smithi123.stdout:checking for rpm... no 2023-07-21T19:10:05.593 INFO:teuthology.orchestra.run.smithi123.stdout:checking assert.h usability... yes 2023-07-21T19:10:05.623 INFO:teuthology.orchestra.run.smithi123.stdout:checking assert.h presence... yes 2023-07-21T19:10:05.624 INFO:teuthology.orchestra.run.smithi123.stdout:checking for assert.h... yes 2023-07-21T19:10:05.729 INFO:teuthology.orchestra.run.smithi123.stdout:checking bstring.h usability... no 2023-07-21T19:10:05.779 INFO:teuthology.orchestra.run.smithi123.stdout:checking bstring.h presence... no 2023-07-21T19:10:05.779 INFO:teuthology.orchestra.run.smithi123.stdout:checking for bstring.h... no 2023-07-21T19:10:05.867 INFO:teuthology.orchestra.run.smithi123.stdout:checking libgen.h usability... yes 2023-07-21T19:10:05.897 INFO:teuthology.orchestra.run.smithi123.stdout:checking libgen.h presence... yes 2023-07-21T19:10:05.898 INFO:teuthology.orchestra.run.smithi123.stdout:checking for libgen.h... yes 2023-07-21T19:10:06.008 INFO:teuthology.orchestra.run.smithi123.stdout:checking dirent.h usability... yes 2023-07-21T19:10:06.041 INFO:teuthology.orchestra.run.smithi123.stdout:checking dirent.h presence... yes 2023-07-21T19:10:06.041 INFO:teuthology.orchestra.run.smithi123.stdout:checking for dirent.h... yes 2023-07-21T19:10:06.183 INFO:teuthology.orchestra.run.smithi123.stdout:checking errno.h usability... yes 2023-07-21T19:10:06.212 INFO:teuthology.orchestra.run.smithi123.stdout:checking errno.h presence... yes 2023-07-21T19:10:06.213 INFO:teuthology.orchestra.run.smithi123.stdout:checking for errno.h... yes 2023-07-21T19:10:06.320 INFO:teuthology.orchestra.run.smithi123.stdout:checking malloc.h usability... yes 2023-07-21T19:10:06.351 INFO:teuthology.orchestra.run.smithi123.stdout:checking malloc.h presence... yes 2023-07-21T19:10:06.351 INFO:teuthology.orchestra.run.smithi123.stdout:checking for malloc.h... yes 2023-07-21T19:10:06.461 INFO:teuthology.orchestra.run.smithi123.stdout:checking uuid.h usability... no 2023-07-21T19:10:06.512 INFO:teuthology.orchestra.run.smithi123.stdout:checking uuid.h presence... no 2023-07-21T19:10:06.512 INFO:teuthology.orchestra.run.smithi123.stdout:checking for uuid.h... no 2023-07-21T19:10:06.602 INFO:teuthology.orchestra.run.smithi123.stdout:checking uuid/uuid.h usability... yes 2023-07-21T19:10:06.635 INFO:teuthology.orchestra.run.smithi123.stdout:checking uuid/uuid.h presence... yes 2023-07-21T19:10:06.636 INFO:teuthology.orchestra.run.smithi123.stdout:checking for uuid/uuid.h... yes 2023-07-21T19:10:06.749 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/uuid.h usability... no 2023-07-21T19:10:06.797 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/uuid.h presence... no 2023-07-21T19:10:06.798 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/uuid.h... no 2023-07-21T19:10:06.896 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/file.h usability... yes 2023-07-21T19:10:06.928 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/file.h presence... yes 2023-07-21T19:10:06.929 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/file.h... yes 2023-07-21T19:10:07.037 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/fcntl.h usability... yes 2023-07-21T19:10:07.071 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/fcntl.h presence... yes 2023-07-21T19:10:07.072 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/fcntl.h... yes 2023-07-21T19:10:07.179 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/syssgi.h usability... no 2023-07-21T19:10:07.227 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/syssgi.h presence... no 2023-07-21T19:10:07.227 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/syssgi.h... no 2023-07-21T19:10:07.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:07.244 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:07.354 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/param.h usability... yes 2023-07-21T19:10:07.388 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/param.h presence... yes 2023-07-21T19:10:07.388 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/param.h... yes 2023-07-21T19:10:07.417 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/stat.h... (cached) yes 2023-07-21T19:10:07.528 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/statvfs.h usability... yes 2023-07-21T19:10:07.559 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/statvfs.h presence... yes 2023-07-21T19:10:07.559 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/statvfs.h... yes 2023-07-21T19:10:07.665 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/time.h usability... yes 2023-07-21T19:10:07.698 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/time.h presence... yes 2023-07-21T19:10:07.698 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/time.h... yes 2023-07-21T19:10:07.817 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/ioctl.h usability... yes 2023-07-21T19:10:07.847 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/ioctl.h presence... yes 2023-07-21T19:10:07.848 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/ioctl.h... yes 2023-07-21T19:10:07.959 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/wait.h usability... yes 2023-07-21T19:10:07.992 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/wait.h presence... yes 2023-07-21T19:10:07.992 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/wait.h... yes 2023-07-21T19:10:08.019 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/types.h... (cached) yes 2023-07-21T19:10:08.046 INFO:teuthology.orchestra.run.smithi123.stdout:checking for strings.h... (cached) yes 2023-07-21T19:10:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:checking err.h usability... yes 2023-07-21T19:10:08.180 INFO:teuthology.orchestra.run.smithi123.stdout:checking err.h presence... yes 2023-07-21T19:10:08.180 INFO:teuthology.orchestra.run.smithi123.stdout:checking for err.h... yes 2023-07-21T19:10:08.285 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/falloc.h usability... yes 2023-07-21T19:10:08.317 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/falloc.h presence... yes 2023-07-21T19:10:08.317 INFO:teuthology.orchestra.run.smithi123.stdout:checking for linux/falloc.h... yes 2023-07-21T19:10:08.426 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-21T19:10:08.474 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-21T19:10:08.474 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-21T19:10:08.563 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-21T19:10:08.611 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-21T19:10:08.611 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-21T19:10:08.705 INFO:teuthology.orchestra.run.smithi123.stdout:checking xfs/platform_defs.h usability... no 2023-07-21T19:10:08.750 INFO:teuthology.orchestra.run.smithi123.stdout:checking xfs/platform_defs.h presence... no 2023-07-21T19:10:08.751 INFO:teuthology.orchestra.run.smithi123.stdout:checking for xfs/platform_defs.h... no 2023-07-21T19:10:08.838 INFO:teuthology.orchestra.run.smithi123.stdout:checking btrfs/ioctl.h usability... no 2023-07-21T19:10:08.886 INFO:teuthology.orchestra.run.smithi123.stdout:checking btrfs/ioctl.h presence... no 2023-07-21T19:10:08.886 INFO:teuthology.orchestra.run.smithi123.stdout:checking for btrfs/ioctl.h... no 2023-07-21T19:10:08.979 INFO:teuthology.orchestra.run.smithi123.stdout:checking cifs/ioctl.h usability... no 2023-07-21T19:10:09.028 INFO:teuthology.orchestra.run.smithi123.stdout:checking cifs/ioctl.h presence... no 2023-07-21T19:10:09.028 INFO:teuthology.orchestra.run.smithi123.stdout:checking for cifs/ioctl.h... no 2023-07-21T19:10:09.120 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/mman.h usability... yes 2023-07-21T19:10:09.151 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/mman.h presence... yes 2023-07-21T19:10:09.151 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/mman.h... yes 2023-07-21T19:10:09.216 INFO:teuthology.orchestra.run.smithi123.stdout:checking for xfs/xfs_log_format.h... no 2023-07-21T19:10:09.329 INFO:teuthology.orchestra.run.smithi123.stdout:checking for uuid_compare... no 2023-07-21T19:10:09.425 INFO:teuthology.orchestra.run.smithi123.stdout:checking for uuid_compare in -luuid... yes 2023-07-21T19:10:09.589 INFO:teuthology.orchestra.run.smithi123.stdout:checking for xfs/xfs.h... yes 2023-07-21T19:10:09.651 INFO:teuthology.orchestra.run.smithi123.stdout:checking for xfs/libxfs.h... no 2023-07-21T19:10:09.723 INFO:teuthology.orchestra.run.smithi123.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-21T19:10:09.806 INFO:teuthology.orchestra.run.smithi123.stdout:checking for xfs/xqm.h... yes 2023-07-21T19:10:09.926 INFO:teuthology.orchestra.run.smithi123.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-21T19:10:10.005 INFO:teuthology.orchestra.run.smithi123.stdout:checking xfs/handle.h usability... yes 2023-07-21T19:10:10.035 INFO:teuthology.orchestra.run.smithi123.stdout:checking xfs/handle.h presence... yes 2023-07-21T19:10:10.036 INFO:teuthology.orchestra.run.smithi123.stdout:checking for xfs/handle.h... yes 2023-07-21T19:10:10.146 INFO:teuthology.orchestra.run.smithi123.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-21T19:10:10.237 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/acl.h usability... yes 2023-07-21T19:10:10.268 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/acl.h presence... yes 2023-07-21T19:10:10.268 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/acl.h... yes 2023-07-21T19:10:10.352 INFO:teuthology.orchestra.run.smithi123.stdout:checking acl/libacl.h usability... yes 2023-07-21T19:10:10.387 INFO:teuthology.orchestra.run.smithi123.stdout:checking acl/libacl.h presence... yes 2023-07-21T19:10:10.387 INFO:teuthology.orchestra.run.smithi123.stdout:checking for acl/libacl.h... yes 2023-07-21T19:10:10.488 INFO:teuthology.orchestra.run.smithi123.stdout:checking for acl_init in -lacl... yes 2023-07-21T19:10:10.567 INFO:teuthology.orchestra.run.smithi123.stdout:checking gdbm-ndbm.h usability... no 2023-07-21T19:10:10.617 INFO:teuthology.orchestra.run.smithi123.stdout:checking gdbm-ndbm.h presence... no 2023-07-21T19:10:10.617 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gdbm-ndbm.h... no 2023-07-21T19:10:10.698 INFO:teuthology.orchestra.run.smithi123.stdout:checking gdbm/ndbm.h usability... no 2023-07-21T19:10:10.745 INFO:teuthology.orchestra.run.smithi123.stdout:checking gdbm/ndbm.h presence... no 2023-07-21T19:10:10.745 INFO:teuthology.orchestra.run.smithi123.stdout:checking for gdbm/ndbm.h... no 2023-07-21T19:10:10.829 INFO:teuthology.orchestra.run.smithi123.stdout:checking ndbm.h usability... no 2023-07-21T19:10:10.872 INFO:teuthology.orchestra.run.smithi123.stdout:checking ndbm.h presence... no 2023-07-21T19:10:10.873 INFO:teuthology.orchestra.run.smithi123.stdout:checking for ndbm.h... no 2023-07-21T19:10:10.956 INFO:teuthology.orchestra.run.smithi123.stdout:checking libaio.h usability... yes 2023-07-21T19:10:10.992 INFO:teuthology.orchestra.run.smithi123.stdout:checking libaio.h presence... yes 2023-07-21T19:10:10.992 INFO:teuthology.orchestra.run.smithi123.stdout:checking for libaio.h... yes 2023-07-21T19:10:11.081 INFO:teuthology.orchestra.run.smithi123.stdout:checking liburing.h usability... no 2023-07-21T19:10:11.127 INFO:teuthology.orchestra.run.smithi123.stdout:checking liburing.h presence... no 2023-07-21T19:10:11.128 INFO:teuthology.orchestra.run.smithi123.stdout:checking for liburing.h... no 2023-07-21T19:10:11.209 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/capability.h usability... no 2023-07-21T19:10:11.257 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/capability.h presence... no 2023-07-21T19:10:11.257 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/capability.h... no 2023-07-21T19:10:11.337 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/fiemap.h usability... yes 2023-07-21T19:10:11.369 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/fiemap.h presence... yes 2023-07-21T19:10:11.370 INFO:teuthology.orchestra.run.smithi123.stdout:checking for linux/fiemap.h... yes 2023-07-21T19:10:11.471 INFO:teuthology.orchestra.run.smithi123.stdout:checking for fallocate... yes 2023-07-21T19:10:11.573 INFO:teuthology.orchestra.run.smithi123.stdout:checking for open_by_handle_at... yes 2023-07-21T19:10:11.651 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/prctl.h usability... yes 2023-07-21T19:10:11.679 INFO:teuthology.orchestra.run.smithi123.stdout:checking sys/prctl.h presence... yes 2023-07-21T19:10:11.679 INFO:teuthology.orchestra.run.smithi123.stdout:checking for sys/prctl.h... yes 2023-07-21T19:10:11.755 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/fs.h usability... yes 2023-07-21T19:10:11.788 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/fs.h presence... yes 2023-07-21T19:10:11.788 INFO:teuthology.orchestra.run.smithi123.stdout:checking for linux/fs.h... yes 2023-07-21T19:10:11.867 INFO:teuthology.orchestra.run.smithi123.stdout:checking btrfsutil.h usability... no 2023-07-21T19:10:11.914 INFO:teuthology.orchestra.run.smithi123.stdout:checking btrfsutil.h presence... no 2023-07-21T19:10:11.914 INFO:teuthology.orchestra.run.smithi123.stdout:checking for btrfsutil.h... no 2023-07-21T19:10:12.019 INFO:teuthology.orchestra.run.smithi123.stdout:checking for copy_file_range... yes 2023-07-21T19:10:12.122 INFO:teuthology.orchestra.run.smithi123.stdout:checking for SEEK_DATA... yes 2023-07-21T19:10:12.251 INFO:teuthology.orchestra.run.smithi123.stdout:checking for BMV_OF_SHARED... yes 2023-07-21T19:10:12.353 INFO:teuthology.orchestra.run.smithi123.stdout:checking for nftw... yes 2023-07-21T19:10:12.453 INFO:teuthology.orchestra.run.smithi123.stdout:checking for RLIMIT_NOFILE... yes 2023-07-21T19:10:12.530 INFO:teuthology.orchestra.run.smithi123.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-21T19:10:12.628 INFO:teuthology.orchestra.run.smithi123.stdout:checking for renameat2... yes 2023-07-21T19:10:12.724 INFO:teuthology.orchestra.run.smithi123.stdout:checking for reallocarray... yes 2023-07-21T19:10:12.782 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct mount_attr... no 2023-07-21T19:10:12.909 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-21T19:10:13.033 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-21T19:10:13.163 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-21T19:10:13.289 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-21T19:10:13.403 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-21T19:10:13.524 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-21T19:10:13.653 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-21T19:10:13.746 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/btrfs.h usability... yes 2023-07-21T19:10:13.778 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/btrfs.h presence... yes 2023-07-21T19:10:13.779 INFO:teuthology.orchestra.run.smithi123.stdout:checking for linux/btrfs.h... yes 2023-07-21T19:10:13.888 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-21T19:10:13.923 INFO:teuthology.orchestra.run.smithi123.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-21T19:10:13.923 INFO:teuthology.orchestra.run.smithi123.stdout:checking for linux/btrfs_tree.h... yes 2023-07-21T19:10:14.064 INFO:teuthology.orchestra.run.smithi123.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-21T19:10:14.121 INFO:teuthology.orchestra.run.smithi123.stdout:configure: creating ./config.status 2023-07-21T19:10:15.998 INFO:teuthology.orchestra.run.smithi123.stdout:config.status: creating include/builddefs 2023-07-21T19:10:16.061 INFO:teuthology.orchestra.run.smithi123.stdout:config.status: creating include/config.h 2023-07-21T19:10:16.110 INFO:teuthology.orchestra.run.smithi123.stdout:config.status: executing libtool commands 2023-07-21T19:10:16.261 INFO:teuthology.orchestra.run.smithi123.stdout:Building include 2023-07-21T19:10:16.274 INFO:teuthology.orchestra.run.smithi123.stdout:Building lib 2023-07-21T19:10:16.285 INFO:teuthology.orchestra.run.smithi123.stdout: [LTDEP] 2023-07-21T19:10:16.589 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dataascii.lo 2023-07-21T19:10:16.885 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] databin.lo 2023-07-21T19:10:17.208 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] datapid.lo 2023-07-21T19:10:17.474 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] file_lock.lo 2023-07-21T19:10:17.816 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] forker.lo 2023-07-21T19:10:18.134 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] pattern.lo 2023-07-21T19:10:18.432 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] open_flags.lo 2023-07-21T19:10:18.749 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] random_range.lo 2023-07-21T19:10:19.149 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] string_to_tokens.lo 2023-07-21T19:10:19.412 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] str_to_bytes.lo 2023-07-21T19:10:19.714 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] tlibio.lo 2023-07-21T19:10:20.154 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] write_log.lo 2023-07-21T19:10:20.335 INFO:teuthology.orchestra.run.smithi123.stderr:write_log.c: In function 'wlog_record_write': 2023-07-21T19:10:20.335 INFO:teuthology.orchestra.run.smithi123.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:20.335 INFO:teuthology.orchestra.run.smithi123.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-07-21T19:10:20.336 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:20.336 INFO:teuthology.orchestra.run.smithi123.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-07-21T19:10:20.336 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:20.581 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] random.lo 2023-07-21T19:10:20.847 INFO:teuthology.orchestra.run.smithi123.stdout: [LD] 2023-07-21T19:10:21.081 INFO:teuthology.orchestra.run.smithi123.stdout:Building ltp 2023-07-21T19:10:21.094 INFO:teuthology.orchestra.run.smithi123.stdout: [DEP] 2023-07-21T19:10:21.417 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] doio 2023-07-21T19:10:22.443 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fsstress 2023-07-21T19:10:24.214 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fsx 2023-07-21T19:10:25.455 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] growfiles 2023-07-21T19:10:26.286 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] iogen 2023-07-21T19:10:26.620 INFO:teuthology.orchestra.run.smithi123.stderr:iogen.c: In function 'main': 2023-07-21T19:10:26.620 INFO:teuthology.orchestra.run.smithi123.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:26.620 INFO:teuthology.orchestra.run.smithi123.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-07-21T19:10:26.620 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:26.624 INFO:teuthology.orchestra.run.smithi123.stderr:iogen.c: In function 'parse_cmdline': 2023-07-21T19:10:26.624 INFO:teuthology.orchestra.run.smithi123.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:26.624 INFO:teuthology.orchestra.run.smithi123.stderr: 1535 | getcwd(fptr->f_path, 2023-07-21T19:10:26.624 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:26.624 INFO:teuthology.orchestra.run.smithi123.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-07-21T19:10:26.624 INFO:teuthology.orchestra.run.smithi123.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:26.937 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-stress 2023-07-21T19:10:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-07-21T19:10:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:27.267 INFO:teuthology.orchestra.run.smithi123.stderr: 1013 | ftruncate(fd, total_ram); 2023-07-21T19:10:27.267 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:27.655 INFO:teuthology.orchestra.run.smithi123.stdout:Building src 2023-07-21T19:10:27.676 INFO:teuthology.orchestra.run.smithi123.stdout: [DEP] 2023-07-21T19:10:31.233 INFO:teuthology.orchestra.run.smithi123.stdout: [DEP] 2023-07-21T19:10:31.316 INFO:teuthology.orchestra.run.smithi123.stdout: [DEP] 2023-07-21T19:10:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: [DEP] 2023-07-21T19:10:31.842 INFO:teuthology.orchestra.run.smithi123.stdout: [DEP] 2023-07-21T19:10:31.918 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dirstress 2023-07-21T19:10:32.436 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fill 2023-07-21T19:10:32.832 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fill2 2023-07-21T19:10:33.327 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] getpagesize 2023-07-21T19:10:33.681 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] holes 2023-07-21T19:10:34.120 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] lstat64 2023-07-21T19:10:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] nametest 2023-07-21T19:10:34.920 INFO:teuthology.orchestra.run.smithi123.stderr:nametest.c: In function 'main': 2023-07-21T19:10:34.920 INFO:teuthology.orchestra.run.smithi123.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr: 236 | write(1, "\n", 1); 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr: 238 | write(1, ".", 1); 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:34.921 INFO:teuthology.orchestra.run.smithi123.stderr: 288 | write(1, ".", 1); 2023-07-21T19:10:34.922 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:10:35.089 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] permname 2023-07-21T19:10:35.548 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] randholes 2023-07-21T19:10:36.062 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] runas 2023-07-21T19:10:36.475 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] truncfile 2023-07-21T19:10:36.919 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] usemem 2023-07-21T19:10:37.299 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] mmapcat 2023-07-21T19:10:37.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:37.333 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:37.593 INFO:teuthology.orchestra.run.smithi123.stderr:mmapcat.c: In function 'main': 2023-07-21T19:10:37.593 INFO:teuthology.orchestra.run.smithi123.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:37.593 INFO:teuthology.orchestra.run.smithi123.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-07-21T19:10:37.593 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:37.660 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] append_reader 2023-07-21T19:10:38.047 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] append_writer 2023-07-21T19:10:38.435 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dirperf 2023-07-21T19:10:38.917 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] metaperf 2023-07-21T19:10:39.240 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c: In function 'crfiles': 2023-07-21T19:10:39.240 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:39.241 INFO:teuthology.orchestra.run.smithi123.stderr: 166 | write(fd, buf, fsize); 2023-07-21T19:10:39.241 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:39.241 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c: In function 't_linkun': 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr: 454 | link("a", *fnp); 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~ 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c: In function 't_chown': 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr: 404 | chown(*fnp, 2, -1); 2023-07-21T19:10:39.242 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr: 406 | chown(*fnp, 1, -1); 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c: In function 'i_chown': 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr: 291 | chown(*fnp, 1, -1); 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:39.243 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c: In function 'main': 2023-07-21T19:10:39.244 INFO:teuthology.orchestra.run.smithi123.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:39.244 INFO:teuthology.orchestra.run.smithi123.stderr: 152 | chdir(".."); 2023-07-21T19:10:39.244 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~ 2023-07-21T19:10:39.434 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] devzero 2023-07-21T19:10:39.871 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] feature 2023-07-21T19:10:40.351 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] alloc 2023-07-21T19:10:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:alloc.c: In function 'main': 2023-07-21T19:10:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:40.688 INFO:teuthology.orchestra.run.smithi123.stderr: 247 | mkstemp(tmpfile); 2023-07-21T19:10:40.688 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:10:40.820 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fault 2023-07-21T19:10:41.219 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fstest 2023-07-21T19:10:41.725 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_access_root 2023-07-21T19:10:42.033 INFO:teuthology.orchestra.run.smithi123.stderr:t_access_root.c: In function 'main': 2023-07-21T19:10:42.033 INFO:teuthology.orchestra.run.smithi123.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:42.034 INFO:teuthology.orchestra.run.smithi123.stderr: 55 | system(cmd); 2023-07-21T19:10:42.034 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~ 2023-07-21T19:10:42.116 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] godown 2023-07-21T19:10:42.541 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] resvtest 2023-07-21T19:10:42.978 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] writemod 2023-07-21T19:10:43.360 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] writev_on_pagefault 2023-07-21T19:10:43.760 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] makeextents 2023-07-21T19:10:44.190 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] itrash 2023-07-21T19:10:44.600 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] rename 2023-07-21T19:10:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] multi_open_unlink 2023-07-21T19:10:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] unwritten_sync 2023-07-21T19:10:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] genhashnames 2023-07-21T19:10:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_holes 2023-07-21T19:10:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_writev 2023-07-21T19:10:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_truncate_cmtime 2023-07-21T19:10:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dirhash_collide 2023-07-21T19:10:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_rename_overwrite 2023-07-21T19:10:48.259 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] holetest 2023-07-21T19:10:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:holetest.c: In function 'pt_write_marker': 2023-07-21T19:10:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:48.591 INFO:teuthology.orchestra.run.smithi123.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-07-21T19:10:48.591 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:48.740 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_truncate_self 2023-07-21T19:10:49.105 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] af_unix 2023-07-21T19:10:49.498 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_stale_pmd 2023-07-21T19:10:49.813 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-07-21T19:10:49.813 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:49.813 INFO:teuthology.orchestra.run.smithi123.stderr: 42 | ftruncate(fd, 0); 2023-07-21T19:10:49.813 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:10:49.814 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:49.814 INFO:teuthology.orchestra.run.smithi123.stderr: 43 | ftruncate(fd, MiB(4)); 2023-07-21T19:10:49.814 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:49.814 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:49.814 INFO:teuthology.orchestra.run.smithi123.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-07-21T19:10:49.814 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_cow_race 2023-07-21T19:10:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_cow_race.c: In function 'main': 2023-07-21T19:10:50.193 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:50.193 INFO:teuthology.orchestra.run.smithi123.stderr: 61 | ftruncate(fd, 0); 2023-07-21T19:10:50.193 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:10:50.193 INFO:teuthology.orchestra.run.smithi123.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:50.193 INFO:teuthology.orchestra.run.smithi123.stderr: 62 | ftruncate(fd, MiB(2)); 2023-07-21T19:10:50.193 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:50.272 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_fallocate 2023-07-21T19:10:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fsync-err 2023-07-21T19:10:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_write_ro 2023-07-21T19:10:51.457 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-21T19:10:51.774 INFO:teuthology.orchestra.run.smithi123.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-07-21T19:10:51.774 INFO:teuthology.orchestra.run.smithi123.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:51.775 INFO:teuthology.orchestra.run.smithi123.stderr: 61 | ftruncate(fd, 0); 2023-07-21T19:10:51.775 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:10:51.857 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-21T19:10:52.252 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_ofd_locks 2023-07-21T19:10:52.706 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_collision 2023-07-21T19:10:53.168 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] mmap-write-concurrent 2023-07-21T19:10:53.579 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_get_file_time 2023-07-21T19:10:53.955 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_create_short_dirs 2023-07-21T19:10:54.357 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_create_long_dirs 2023-07-21T19:10:54.770 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_enospc 2023-07-21T19:10:55.211 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_writev_overlap 2023-07-21T19:10:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] checkpoint_journal 2023-07-21T19:10:56.043 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] mmap-rw-fault 2023-07-21T19:10:56.467 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] allocstale 2023-07-21T19:10:56.891 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_cow_memory_failure 2023-07-21T19:10:57.318 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fake-dump-rootino 2023-07-21T19:10:57.707 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dio-buf-fault 2023-07-21T19:10:58.108 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] xfsctl 2023-07-21T19:10:58.553 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] bstat 2023-07-21T19:10:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mtab 2023-07-21T19:10:59.354 INFO:teuthology.orchestra.run.smithi123.stderr:t_mtab.c: In function 'update_mtab': 2023-07-21T19:10:59.354 INFO:teuthology.orchestra.run.smithi123.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:10:59.354 INFO:teuthology.orchestra.run.smithi123.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-07-21T19:10:59.355 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:10:59.471 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] getdevicesize 2023-07-21T19:10:59.849 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] preallo_rw_pattern_reader 2023-07-21T19:11:00.168 INFO:teuthology.orchestra.run.smithi123.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-07-21T19:11:00.169 INFO:teuthology.orchestra.run.smithi123.stderr:iopat.c: In function 'main': 2023-07-21T19:11:00.169 INFO:teuthology.orchestra.run.smithi123.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:00.169 INFO:teuthology.orchestra.run.smithi123.stderr: 38 | read(fd, &x, 1048576); 2023-07-21T19:11:00.169 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:00.243 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] preallo_rw_pattern_writer 2023-07-21T19:11:00.581 INFO:teuthology.orchestra.run.smithi123.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-07-21T19:11:00.582 INFO:teuthology.orchestra.run.smithi123.stderr:iopat.c: In function 'main': 2023-07-21T19:11:00.582 INFO:teuthology.orchestra.run.smithi123.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:00.582 INFO:teuthology.orchestra.run.smithi123.stderr: 34 | write(fd, &x, 1048576); 2023-07-21T19:11:00.582 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:00.659 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] ftrunc 2023-07-21T19:11:01.056 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] trunc 2023-07-21T19:11:01.481 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fs_perms 2023-07-21T19:11:01.814 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c: In function 'main': 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr: 54 | system("rm -f test.file"); 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c: In function 'testsetup': 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr: 67 | system("cp testx.file test.file"); 2023-07-21T19:11:01.815 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:01.816 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:01.816 INFO:teuthology.orchestra.run.smithi123.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-07-21T19:11:01.816 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:01.816 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c: In function 'testfperm': 2023-07-21T19:11:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:01.817 INFO:teuthology.orchestra.run.smithi123.stderr: 123 | seteuid(0); 2023-07-21T19:11:01.817 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~ 2023-07-21T19:11:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:01.817 INFO:teuthology.orchestra.run.smithi123.stderr: 124 | setegid(0); 2023-07-21T19:11:01.817 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~ 2023-07-21T19:11:01.901 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] testx 2023-07-21T19:11:02.258 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] looptest 2023-07-21T19:11:02.707 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] locktest 2023-07-21T19:11:03.292 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] unwritten_mmap 2023-07-21T19:11:03.698 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] bulkstat_unlink_test 2023-07-21T19:11:04.029 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test.c: In function 'main': 2023-07-21T19:11:04.030 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:04.030 INFO:teuthology.orchestra.run.smithi123.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-07-21T19:11:04.030 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:04.030 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:04.030 INFO:teuthology.orchestra.run.smithi123.stderr: 178 | system(fname); 2023-07-21T19:11:04.030 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~ 2023-07-21T19:11:04.154 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] deduperace 2023-07-21T19:11:04.602 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] bulkstat_unlink_test_modified 2023-07-21T19:11:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-07-21T19:11:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: 185 | system(fname); 2023-07-21T19:11:04.935 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~ 2023-07-21T19:11:05.056 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_dir_offset 2023-07-21T19:11:05.439 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_futimens 2023-07-21T19:11:05.817 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_immutable 2023-07-21T19:11:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c: In function 'create_test_area': 2023-07-21T19:11:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.178 INFO:teuthology.orchestra.run.smithi123.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-07-21T19:11:06.178 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.178 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.178 INFO:teuthology.orchestra.run.smithi123.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-07-21T19:11:06.178 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.179 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c: In function 'remove_test_area': 2023-07-21T19:11:06.179 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.179 INFO:teuthology.orchestra.run.smithi123.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-07-21T19:11:06.179 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.179 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-07-21T19:11:06.180 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.181 INFO:teuthology.orchestra.run.smithi123.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-07-21T19:11:06.181 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.181 INFO:teuthology.orchestra.run.smithi123.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-07-21T19:11:06.181 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c: In function 'check_test_area': 2023-07-21T19:11:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.183 INFO:teuthology.orchestra.run.smithi123.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-07-21T19:11:06.184 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c: In function 'test_immutable': 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.186 INFO:teuthology.orchestra.run.smithi123.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr: 408 | chown(path, 0, 0); 2023-07-21T19:11:06.187 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.188 INFO:teuthology.orchestra.run.smithi123.stderr: 553 | chown(path, 0, 0); 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-07-21T19:11:06.189 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.190 INFO:teuthology.orchestra.run.smithi123.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr: 653 | chown(path, 0, 0); 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr: 705 | chown(path, 0, 0); 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.192 INFO:teuthology.orchestra.run.smithi123.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-07-21T19:11:06.193 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c: In function 'test_append': 2023-07-21T19:11:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.194 INFO:teuthology.orchestra.run.smithi123.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-07-21T19:11:06.194 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr: 1051 | chown(path, 0, 0); 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.196 INFO:teuthology.orchestra.run.smithi123.stderr: 1516 | chown(path, 0, 0); 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-07-21T19:11:06.198 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.199 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr: 1618 | chown(path, 0, 0); 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.200 INFO:teuthology.orchestra.run.smithi123.stderr: 1644 | chown(path, 0, 0); 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.201 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.202 INFO:teuthology.orchestra.run.smithi123.stderr: 1692 | chown(path, 0, 0); 2023-07-21T19:11:06.202 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.202 INFO:teuthology.orchestra.run.smithi123.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:06.202 INFO:teuthology.orchestra.run.smithi123.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-07-21T19:11:06.202 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:06.811 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] stale_handle 2023-07-21T19:11:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:stale_handle.c: In function 'main': 2023-07-21T19:11:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:07.138 INFO:teuthology.orchestra.run.smithi123.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-07-21T19:11:07.139 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:07.230 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] pwrite_mmap_blocked 2023-07-21T19:11:07.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:07.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:07.608 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_dir_offset2 2023-07-21T19:11:08.038 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] seek_sanity_test 2023-07-21T19:11:08.384 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c: In function 'test18': 2023-07-21T19:11:08.384 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.384 INFO:teuthology.orchestra.run.smithi123.stderr: 460 | ftruncate(fd, 0); 2023-07-21T19:11:08.384 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.387 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-07-21T19:11:08.387 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.387 INFO:teuthology.orchestra.run.smithi123.stderr: 1207 | ftruncate(fd, 0); 2023-07-21T19:11:08.387 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.387 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.388 INFO:teuthology.orchestra.run.smithi123.stderr: 1256 | ftruncate(fd, 0); 2023-07-21T19:11:08.388 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-07-21T19:11:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.388 INFO:teuthology.orchestra.run.smithi123.stderr: 88 | ftruncate(fd, 0); 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr: 98 | ftruncate(fd, 0); 2023-07-21T19:11:08.389 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.390 INFO:teuthology.orchestra.run.smithi123.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:08.390 INFO:teuthology.orchestra.run.smithi123.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-07-21T19:11:08.390 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:08.756 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] seek_copy_test 2023-07-21T19:11:09.187 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_readdir_1 2023-07-21T19:11:09.506 INFO:teuthology.orchestra.run.smithi123.stderr:t_readdir_1.c: In function 'main': 2023-07-21T19:11:09.506 INFO:teuthology.orchestra.run.smithi123.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:09.507 INFO:teuthology.orchestra.run.smithi123.stderr: 30 | read(fd, buf, 100); 2023-07-21T19:11:09.507 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:09.577 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_readdir_2 2023-07-21T19:11:09.950 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fsync-tester 2023-07-21T19:11:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:fsync-tester.c: In function 'main': 2023-07-21T19:11:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:10.277 INFO:teuthology.orchestra.run.smithi123.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-07-21T19:11:10.277 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:10.277 INFO:teuthology.orchestra.run.smithi123.stderr: 541 | system("reboot -fn"); 2023-07-21T19:11:10.277 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-07-21T19:11:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:10.278 INFO:teuthology.orchestra.run.smithi123.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-07-21T19:11:10.278 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:10.467 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] nsexec 2023-07-21T19:11:10.892 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] cloner 2023-07-21T19:11:11.319 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] renameat2 2023-07-21T19:11:11.729 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_getcwd 2023-07-21T19:11:12.055 INFO:teuthology.orchestra.run.smithi123.stderr:t_getcwd.c: In function 'test_getcwd': 2023-07-21T19:11:12.055 INFO:teuthology.orchestra.run.smithi123.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:12.056 INFO:teuthology.orchestra.run.smithi123.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-07-21T19:11:12.056 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:12.147 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] e4compact 2023-07-21T19:11:12.603 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] test-nextquota 2023-07-21T19:11:13.003 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] punch-alternating 2023-07-21T19:11:13.432 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-21T19:11:13.851 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] listxattr 2023-07-21T19:11:14.241 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dio-interleaved 2023-07-21T19:11:14.640 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_dir_type 2023-07-21T19:11:15.025 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] dio-invalidate-cache 2023-07-21T19:11:15.344 INFO:teuthology.orchestra.run.smithi123.stderr:dio-invalidate-cache.c: In function 'main': 2023-07-21T19:11:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:15.345 INFO:teuthology.orchestra.run.smithi123.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-07-21T19:11:15.345 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:15.485 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] stat_test 2023-07-21T19:11:16.056 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_encrypted_d_revalidate 2023-07-21T19:11:16.467 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] attr_replace_test 2023-07-21T19:11:16.874 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] swapon 2023-07-21T19:11:17.286 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] mkswap 2023-07-21T19:11:17.676 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_attr_corruption 2023-07-21T19:11:18.066 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_open_tmpfiles 2023-07-21T19:11:18.498 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fscrypt-crypt-util 2023-07-21T19:11:19.486 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] bulkstat_null_ocount 2023-07-21T19:11:19.883 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] splice-test 2023-07-21T19:11:20.315 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] chprojid_fail 2023-07-21T19:11:20.721 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] detached_mounts_propagation 2023-07-21T19:11:21.151 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] ext4_resize 2023-07-21T19:11:21.529 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_readdir_3 2023-07-21T19:11:21.973 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] splice2pipe 2023-07-21T19:11:22.298 INFO:teuthology.orchestra.run.smithi123.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-07-21T19:11:22.298 INFO:teuthology.orchestra.run.smithi123.stderr:splice2pipe.c:57:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:22.298 INFO:teuthology.orchestra.run.smithi123.stderr: 57 | write(p[1], buffer, n); 2023-07-21T19:11:22.298 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:22.299 INFO:teuthology.orchestra.run.smithi123.stderr:splice2pipe.c:65:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:22.299 INFO:teuthology.orchestra.run.smithi123.stderr: 65 | read(p[0], buffer, n); 2023-07-21T19:11:22.299 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:22.388 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] uuid_ioctl 2023-07-21T19:11:22.789 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fiemap-tester 2023-07-21T19:11:23.330 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_stripealign 2023-07-21T19:11:23.719 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] open_by_handle 2023-07-21T19:11:24.240 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] t_mmap_dio 2023-07-21T19:11:24.643 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] xfsfind 2023-07-21T19:11:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] fssum 2023-07-21T19:11:25.825 INFO:teuthology.orchestra.run.smithi123.stdout:Building log-writes 2023-07-21T19:11:25.844 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] replay-log 2023-07-21T19:11:26.433 INFO:teuthology.orchestra.run.smithi123.stdout:Building perf 2023-07-21T19:11:26.446 INFO:teuthology.orchestra.run.smithi123.stdout:Building aio-dio-regress 2023-07-21T19:11:26.466 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-21T19:11:26.897 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-fcntl-race 2023-07-21T19:11:27.303 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-subblock-eof-read 2023-07-21T19:11:27.687 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-append-write-read-race 2023-07-21T19:11:28.114 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-invalidate-readahead 2023-07-21T19:11:28.526 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-hole-filling-race 2023-07-21T19:11:28.922 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-21T19:11:29.291 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-last-ref-held-by-io 2023-07-21T19:11:29.713 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-cycle-write 2023-07-21T19:11:30.028 INFO:teuthology.orchestra.run.smithi123.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-07-21T19:11:30.029 INFO:teuthology.orchestra.run.smithi123.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:30.029 INFO:teuthology.orchestra.run.smithi123.stderr: 83 | ftruncate(fd, buf_size); 2023-07-21T19:11:30.029 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:30.162 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-extend-stat 2023-07-21T19:11:30.590 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-21T19:11:30.953 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aiocp 2023-07-21T19:11:31.439 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-invalidate-failure 2023-07-21T19:11:31.846 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aiodio_sparse2 2023-07-21T19:11:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-07-21T19:11:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:32.160 INFO:teuthology.orchestra.run.smithi123.stderr: 111 | ftruncate(fd, filesize); 2023-07-21T19:11:32.160 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:32.160 INFO:teuthology.orchestra.run.smithi123.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-07-21T19:11:32.160 INFO:teuthology.orchestra.run.smithi123.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-21T19:11:32.160 INFO:teuthology.orchestra.run.smithi123.stderr: 274 | ftruncate(fd, size); 2023-07-21T19:11:32.161 INFO:teuthology.orchestra.run.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-07-21T19:11:32.323 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-cow-race 2023-07-21T19:11:32.726 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-write-verify 2023-07-21T19:11:33.168 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] aio-dio-eof-race 2023-07-21T19:11:33.603 INFO:teuthology.orchestra.run.smithi123.stdout:Building vfs 2023-07-21T19:11:33.621 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] vfstest 2023-07-21T19:11:36.275 INFO:teuthology.orchestra.run.smithi123.stdout: [CC] mount-idmapped 2023-07-21T19:11:36.932 INFO:teuthology.orchestra.run.smithi123.stdout:Building m4 2023-07-21T19:11:36.944 INFO:teuthology.orchestra.run.smithi123.stdout:Building common 2023-07-21T19:11:36.959 INFO:teuthology.orchestra.run.smithi123.stdout:Building tests 2023-07-21T19:11:36.976 INFO:teuthology.orchestra.run.smithi123.stdout:Building perf 2023-07-21T19:11:36.994 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/perf/group.list 2023-07-21T19:11:37.041 INFO:teuthology.orchestra.run.smithi123.stdout:Building ext4 2023-07-21T19:11:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ext4/group.list 2023-07-21T19:11:37.229 INFO:teuthology.orchestra.run.smithi123.stdout:Building ocfs2 2023-07-21T19:11:37.248 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ocfs2/group.list 2023-07-21T19:11:37.318 INFO:teuthology.orchestra.run.smithi123.stdout:Building overlay 2023-07-21T19:11:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/overlay/group.list 2023-07-21T19:11:37.496 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:37.500 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:37.521 INFO:teuthology.orchestra.run.smithi123.stdout:Building cifs 2023-07-21T19:11:37.537 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/cifs/group.list 2023-07-21T19:11:37.590 INFO:teuthology.orchestra.run.smithi123.stdout:Building generic 2023-07-21T19:11:37.608 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/generic/group.list 2023-07-21T19:11:38.067 INFO:teuthology.orchestra.run.smithi123.stdout:Building shared 2023-07-21T19:11:38.086 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/shared/group.list 2023-07-21T19:11:38.167 INFO:teuthology.orchestra.run.smithi123.stdout:Building xfs 2023-07-21T19:11:38.188 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/xfs/group.list 2023-07-21T19:11:38.661 INFO:teuthology.orchestra.run.smithi123.stdout:Building f2fs 2023-07-21T19:11:38.679 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/f2fs/group.list 2023-07-21T19:11:38.755 INFO:teuthology.orchestra.run.smithi123.stdout:Building udf 2023-07-21T19:11:38.771 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/udf/group.list 2023-07-21T19:11:38.829 INFO:teuthology.orchestra.run.smithi123.stdout:Building ceph 2023-07-21T19:11:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ceph/group.list 2023-07-21T19:11:38.919 INFO:teuthology.orchestra.run.smithi123.stdout:Building nfs 2023-07-21T19:11:38.938 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/nfs/group.list 2023-07-21T19:11:39.013 INFO:teuthology.orchestra.run.smithi123.stdout:Building btrfs 2023-07-21T19:11:39.031 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/btrfs/group.list 2023-07-21T19:11:39.323 INFO:teuthology.orchestra.run.smithi123.stdout:Building tmpfs 2023-07-21T19:11:39.340 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/tmpfs/group.list 2023-07-21T19:11:39.407 INFO:teuthology.orchestra.run.smithi123.stdout:Building selftest 2023-07-21T19:11:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/selftest/group.list 2023-07-21T19:11:39.485 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo make install) 2023-07-21T19:11:39.615 INFO:teuthology.orchestra.run.smithi123.stdout:Building include 2023-07-21T19:11:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:Building lib 2023-07-21T19:11:39.644 INFO:teuthology.orchestra.run.smithi123.stdout:Building ltp 2023-07-21T19:11:39.660 INFO:teuthology.orchestra.run.smithi123.stdout:Building src 2023-07-21T19:11:39.775 INFO:teuthology.orchestra.run.smithi123.stdout:Building log-writes 2023-07-21T19:11:39.790 INFO:teuthology.orchestra.run.smithi123.stdout:Building perf 2023-07-21T19:11:39.806 INFO:teuthology.orchestra.run.smithi123.stdout:Building aio-dio-regress 2023-07-21T19:11:39.821 INFO:teuthology.orchestra.run.smithi123.stdout:Building vfs 2023-07-21T19:11:39.837 INFO:teuthology.orchestra.run.smithi123.stdout:Building m4 2023-07-21T19:11:39.850 INFO:teuthology.orchestra.run.smithi123.stdout:Building common 2023-07-21T19:11:39.863 INFO:teuthology.orchestra.run.smithi123.stdout:Building tests 2023-07-21T19:11:39.879 INFO:teuthology.orchestra.run.smithi123.stdout:Building perf 2023-07-21T19:11:39.897 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/perf/group.list 2023-07-21T19:11:39.956 INFO:teuthology.orchestra.run.smithi123.stdout:Building ext4 2023-07-21T19:11:39.977 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ext4/group.list 2023-07-21T19:11:40.158 INFO:teuthology.orchestra.run.smithi123.stdout:Building ocfs2 2023-07-21T19:11:40.176 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ocfs2/group.list 2023-07-21T19:11:40.240 INFO:teuthology.orchestra.run.smithi123.stdout:Building overlay 2023-07-21T19:11:40.256 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/overlay/group.list 2023-07-21T19:11:40.434 INFO:teuthology.orchestra.run.smithi123.stdout:Building cifs 2023-07-21T19:11:40.449 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/cifs/group.list 2023-07-21T19:11:40.513 INFO:teuthology.orchestra.run.smithi123.stdout:Building generic 2023-07-21T19:11:40.537 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/generic/group.list 2023-07-21T19:11:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:Building shared 2023-07-21T19:11:41.012 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/shared/group.list 2023-07-21T19:11:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:Building xfs 2023-07-21T19:11:41.117 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/xfs/group.list 2023-07-21T19:11:41.585 INFO:teuthology.orchestra.run.smithi123.stdout:Building f2fs 2023-07-21T19:11:41.602 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/f2fs/group.list 2023-07-21T19:11:41.688 INFO:teuthology.orchestra.run.smithi123.stdout:Building udf 2023-07-21T19:11:41.705 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/udf/group.list 2023-07-21T19:11:41.762 INFO:teuthology.orchestra.run.smithi123.stdout:Building ceph 2023-07-21T19:11:41.780 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ceph/group.list 2023-07-21T19:11:41.852 INFO:teuthology.orchestra.run.smithi123.stdout:Building nfs 2023-07-21T19:11:41.870 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/nfs/group.list 2023-07-21T19:11:41.938 INFO:teuthology.orchestra.run.smithi123.stdout:Building btrfs 2023-07-21T19:11:41.959 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/btrfs/group.list 2023-07-21T19:11:42.247 INFO:teuthology.orchestra.run.smithi123.stdout:Building tmpfs 2023-07-21T19:11:42.263 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/tmpfs/group.list 2023-07-21T19:11:42.326 INFO:teuthology.orchestra.run.smithi123.stdout:Building selftest 2023-07-21T19:11:42.345 INFO:teuthology.orchestra.run.smithi123.stdout: [GROUP] /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/selftest/group.list 2023-07-21T19:11:42.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-07-21T19:11:42.405 INFO:teuthology.orchestra.run.smithi123.stdout:make[1]: Nothing to be done for 'install'. 2023-07-21T19:11:42.405 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-07-21T19:11:42.416 INFO:teuthology.orchestra.run.smithi123.stdout:make[1]: Nothing to be done for 'install'. 2023-07-21T19:11:42.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-07-21T19:11:42.426 INFO:teuthology.orchestra.run.smithi123.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-21T19:11:42.475 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-21T19:11:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-21T19:11:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-07-21T19:11:42.939 INFO:teuthology.orchestra.run.smithi123.stdout:Building log-writes 2023-07-21T19:11:42.954 INFO:teuthology.orchestra.run.smithi123.stdout:Building perf 2023-07-21T19:11:42.967 INFO:teuthology.orchestra.run.smithi123.stdout:Building aio-dio-regress 2023-07-21T19:11:42.982 INFO:teuthology.orchestra.run.smithi123.stdout:Building vfs 2023-07-21T19:11:42.991 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make -C log-writes install 2023-07-21T19:11:43.000 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-21T19:11:43.044 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-21T19:11:43.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make -C perf install 2023-07-21T19:11:43.099 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-21T19:11:43.144 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-21T19:11:43.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make -C aio-dio-regress install 2023-07-21T19:11:43.258 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-21T19:11:43.307 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-21T19:11:43.565 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make -C vfs install 2023-07-21T19:11:43.574 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-21T19:11:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-21T19:11:43.683 INFO:teuthology.orchestra.run.smithi123.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-21T19:11:43.730 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-21T19:11:49.794 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-21T19:11:50.226 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-21T19:11:50.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-07-21T19:11:50.327 INFO:teuthology.orchestra.run.smithi123.stdout:make[1]: Nothing to be done for 'install'. 2023-07-21T19:11:50.328 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-07-21T19:11:50.333 INFO:teuthology.orchestra.run.smithi123.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-21T19:11:50.378 INFO:teuthology.orchestra.run.smithi123.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-21T19:11:50.984 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-07-21T19:11:50.994 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/btrfs/ install 2023-07-21T19:11:51.005 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-21T19:11:51.054 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-21T19:11:54.963 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-21T19:11:55.006 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 041.out 016.out 145.out 064.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 252.out 270.out 148.out 088.out 137.out 096.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 112.out 012.out 107.out 162.out 147.out 288.out 196.out 242.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 002.out 171.out 261.out 156.out 092.out 082.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 287.out 010.out 001.out 138.out 237.out 097.out 153.out 181.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 174.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 193.out 283.out 083.out 099.out 247.out 186.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 004.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 130.out 023.out 044.out 073.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 289.out 038.out 045.out 281.out 090.out 224.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out 221.out 087.out 212.out /var/lib/xfstests/tests/btrfs 2023-07-21T19:11:58.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ceph/ install 2023-07-21T19:11:58.891 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-21T19:11:58.942 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-21T19:11:59.031 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-21T19:11:59.074 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-21T19:11:59.172 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/cifs/ install 2023-07-21T19:11:59.180 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-21T19:11:59.226 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-21T19:11:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-21T19:11:59.312 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-21T19:11:59.362 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ext4/ install 2023-07-21T19:11:59.373 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-21T19:11:59.420 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-21T19:12:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-21T19:12:00.399 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-07-21T19:12:01.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/f2fs/ install 2023-07-21T19:12:01.376 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-21T19:12:01.425 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-21T19:12:01.483 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-21T19:12:01.528 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-21T19:12:01.584 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/generic/ install 2023-07-21T19:12:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-21T19:12:01.641 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-21T19:12:07.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:07.597 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:11.367 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-21T19:12:11.418 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 460.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 728.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 377.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 447.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 640.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 047.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 472.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 149.out 179.out 703.out 619.out 727.out 685.out 562.out 419.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 555.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 729.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 645.out 486.out 223.out 123.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 375.out 181.out 676.out 271.out 570.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 167.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 444.out 483.out 096.out 393.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-07-21T19:12:21.199 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/nfs/ install 2023-07-21T19:12:21.206 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-21T19:12:21.249 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-21T19:12:21.293 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-21T19:12:21.338 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-21T19:12:21.384 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/ocfs2/ install 2023-07-21T19:12:21.395 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-21T19:12:21.443 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-21T19:12:21.484 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-21T19:12:21.531 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-21T19:12:21.583 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/overlay/ install 2023-07-21T19:12:21.594 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-21T19:12:21.637 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-21T19:12:22.933 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-21T19:12:22.978 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-07-21T19:12:24.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/perf/ install 2023-07-21T19:12:24.273 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-21T19:12:24.323 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-21T19:12:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-21T19:12:24.408 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-21T19:12:24.454 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/selftest/ install 2023-07-21T19:12:24.464 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-21T19:12:24.514 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-21T19:12:24.616 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-21T19:12:24.663 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-21T19:12:24.775 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/shared/ install 2023-07-21T19:12:24.784 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-21T19:12:24.832 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-21T19:12:24.904 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-21T19:12:24.947 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-21T19:12:25.018 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/tmpfs/ install 2023-07-21T19:12:25.028 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-21T19:12:25.074 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-21T19:12:25.115 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-21T19:12:25.164 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-21T19:12:25.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/udf/ install 2023-07-21T19:12:25.216 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-21T19:12:25.261 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-21T19:12:25.305 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-21T19:12:25.352 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-21T19:12:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.pvIJ2qKH9pxfstests-dev/tests/xfs/ install 2023-07-21T19:12:25.413 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-21T19:12:25.457 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-21T19:12:34.598 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-21T19:12:34.648 INFO:teuthology.orchestra.run.smithi123.stdout:../../install-sh -o root -g root -m 644 033.out.crc 216.out.64mblog 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 071.out.32 216.cfg 033.cfg 449.out 185.out 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 455.out 233.out 194.out 443.out 295.out 497.out 337.out 237.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 789.out 195.out 711.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 529.out 434.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 224.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 291.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 742.out 098.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 357.out 542.out 783.out 485.out 442.out 188.out 026.out 099.out 342.out 279.out 281.out 524.out 174.out 771.out 324.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 414.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 588.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 373.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 068.out 591.out 752.out 736.out 236.out 773.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 017.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 394.out 356.out 184.out 435.out 509.out 466.out 278.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 548.out 299.out 364.out 595.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 555.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 516.out 146.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 288.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 569.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 346.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 021.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 070.out 433.out 720.out 196.out 520.out 242.out 420.out 498.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 759.out 072.out 778.out 084.out 056.out 369.out 247.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 141.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 709.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out /var/lib/xfstests/tests/xfs 2023-07-21T19:12:37.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:37.719 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:43.916 INFO:teuthology.orchestra.run.smithi123.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-21T19:12:43.963 INFO:teuthology.orchestra.run.smithi123.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-21T19:12:44.008 INFO:teuthology.orchestra.run.smithi123.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-21T19:12:44.049 INFO:teuthology.orchestra.run.smithi123.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-21T19:12:44.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T19:12:44.102 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec ls tests/generic) 2023-07-21T19:12:44.127 INFO:teuthology.orchestra.run.smithi123.stdout:001 2023-07-21T19:12:44.128 INFO:teuthology.orchestra.run.smithi123.stdout:001.out 2023-07-21T19:12:44.128 INFO:teuthology.orchestra.run.smithi123.stdout:002 2023-07-21T19:12:44.128 INFO:teuthology.orchestra.run.smithi123.stdout:002.out 2023-07-21T19:12:44.128 INFO:teuthology.orchestra.run.smithi123.stdout:003 2023-07-21T19:12:44.128 INFO:teuthology.orchestra.run.smithi123.stdout:003.out 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:004 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:004.out 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:005 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:005.out 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:006 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:006.out 2023-07-21T19:12:44.129 INFO:teuthology.orchestra.run.smithi123.stdout:007 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:007.out 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:008 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:008.out 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:009 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:009.out 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:010 2023-07-21T19:12:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:010.out 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:011 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:011.out 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:012 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:012.out 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:013 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:013.out 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:014 2023-07-21T19:12:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:014.out 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:015 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:015.out 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:016 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:016.out 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:017 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:017.out 2023-07-21T19:12:44.132 INFO:teuthology.orchestra.run.smithi123.stdout:018 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:018.out 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:019 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:019.out 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:020 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:020.out 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:021 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:021.out 2023-07-21T19:12:44.133 INFO:teuthology.orchestra.run.smithi123.stdout:022 2023-07-21T19:12:44.134 INFO:teuthology.orchestra.run.smithi123.stdout:022.out 2023-07-21T19:12:44.134 INFO:teuthology.orchestra.run.smithi123.stdout:023 2023-07-21T19:12:44.134 INFO:teuthology.orchestra.run.smithi123.stdout:023.out 2023-07-21T19:12:44.134 INFO:teuthology.orchestra.run.smithi123.stdout:024 2023-07-21T19:12:44.134 INFO:teuthology.orchestra.run.smithi123.stdout:024.out 2023-07-21T19:12:44.134 INFO:teuthology.orchestra.run.smithi123.stdout:025 2023-07-21T19:12:44.135 INFO:teuthology.orchestra.run.smithi123.stdout:025.out 2023-07-21T19:12:44.135 INFO:teuthology.orchestra.run.smithi123.stdout:026 2023-07-21T19:12:44.135 INFO:teuthology.orchestra.run.smithi123.stdout:026.out 2023-07-21T19:12:44.135 INFO:teuthology.orchestra.run.smithi123.stdout:027 2023-07-21T19:12:44.135 INFO:teuthology.orchestra.run.smithi123.stdout:027.out 2023-07-21T19:12:44.135 INFO:teuthology.orchestra.run.smithi123.stdout:028 2023-07-21T19:12:44.136 INFO:teuthology.orchestra.run.smithi123.stdout:028.out 2023-07-21T19:12:44.136 INFO:teuthology.orchestra.run.smithi123.stdout:029 2023-07-21T19:12:44.136 INFO:teuthology.orchestra.run.smithi123.stdout:029.out 2023-07-21T19:12:44.136 INFO:teuthology.orchestra.run.smithi123.stdout:030 2023-07-21T19:12:44.136 INFO:teuthology.orchestra.run.smithi123.stdout:030.out 2023-07-21T19:12:44.136 INFO:teuthology.orchestra.run.smithi123.stdout:031 2023-07-21T19:12:44.137 INFO:teuthology.orchestra.run.smithi123.stdout:031.out 2023-07-21T19:12:44.137 INFO:teuthology.orchestra.run.smithi123.stdout:032 2023-07-21T19:12:44.137 INFO:teuthology.orchestra.run.smithi123.stdout:032.out 2023-07-21T19:12:44.137 INFO:teuthology.orchestra.run.smithi123.stdout:033 2023-07-21T19:12:44.137 INFO:teuthology.orchestra.run.smithi123.stdout:033.out 2023-07-21T19:12:44.137 INFO:teuthology.orchestra.run.smithi123.stdout:034 2023-07-21T19:12:44.138 INFO:teuthology.orchestra.run.smithi123.stdout:034.out 2023-07-21T19:12:44.138 INFO:teuthology.orchestra.run.smithi123.stdout:035 2023-07-21T19:12:44.138 INFO:teuthology.orchestra.run.smithi123.stdout:035.cfg 2023-07-21T19:12:44.138 INFO:teuthology.orchestra.run.smithi123.stdout:035.out.default 2023-07-21T19:12:44.138 INFO:teuthology.orchestra.run.smithi123.stdout:035.out.nfs 2023-07-21T19:12:44.139 INFO:teuthology.orchestra.run.smithi123.stdout:036 2023-07-21T19:12:44.139 INFO:teuthology.orchestra.run.smithi123.stdout:036.out 2023-07-21T19:12:44.139 INFO:teuthology.orchestra.run.smithi123.stdout:037 2023-07-21T19:12:44.139 INFO:teuthology.orchestra.run.smithi123.stdout:037.out 2023-07-21T19:12:44.139 INFO:teuthology.orchestra.run.smithi123.stdout:038 2023-07-21T19:12:44.140 INFO:teuthology.orchestra.run.smithi123.stdout:038.out 2023-07-21T19:12:44.140 INFO:teuthology.orchestra.run.smithi123.stdout:039 2023-07-21T19:12:44.140 INFO:teuthology.orchestra.run.smithi123.stdout:039.out 2023-07-21T19:12:44.140 INFO:teuthology.orchestra.run.smithi123.stdout:040 2023-07-21T19:12:44.140 INFO:teuthology.orchestra.run.smithi123.stdout:040.out 2023-07-21T19:12:44.141 INFO:teuthology.orchestra.run.smithi123.stdout:041 2023-07-21T19:12:44.141 INFO:teuthology.orchestra.run.smithi123.stdout:041.out 2023-07-21T19:12:44.141 INFO:teuthology.orchestra.run.smithi123.stdout:042 2023-07-21T19:12:44.141 INFO:teuthology.orchestra.run.smithi123.stdout:042.out 2023-07-21T19:12:44.141 INFO:teuthology.orchestra.run.smithi123.stdout:043 2023-07-21T19:12:44.142 INFO:teuthology.orchestra.run.smithi123.stdout:043.out 2023-07-21T19:12:44.142 INFO:teuthology.orchestra.run.smithi123.stdout:044 2023-07-21T19:12:44.142 INFO:teuthology.orchestra.run.smithi123.stdout:044.out 2023-07-21T19:12:44.142 INFO:teuthology.orchestra.run.smithi123.stdout:045 2023-07-21T19:12:44.142 INFO:teuthology.orchestra.run.smithi123.stdout:045.out 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:046 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:046.out 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:047 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:047.out 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:048 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:048.out 2023-07-21T19:12:44.143 INFO:teuthology.orchestra.run.smithi123.stdout:049 2023-07-21T19:12:44.144 INFO:teuthology.orchestra.run.smithi123.stdout:049.out 2023-07-21T19:12:44.144 INFO:teuthology.orchestra.run.smithi123.stdout:050 2023-07-21T19:12:44.144 INFO:teuthology.orchestra.run.smithi123.stdout:050.cfg 2023-07-21T19:12:44.144 INFO:teuthology.orchestra.run.smithi123.stdout:050.out.default 2023-07-21T19:12:44.144 INFO:teuthology.orchestra.run.smithi123.stdout:050.out.nojournal 2023-07-21T19:12:44.144 INFO:teuthology.orchestra.run.smithi123.stdout:050.out.xfsquota 2023-07-21T19:12:44.145 INFO:teuthology.orchestra.run.smithi123.stdout:051 2023-07-21T19:12:44.145 INFO:teuthology.orchestra.run.smithi123.stdout:051.out 2023-07-21T19:12:44.145 INFO:teuthology.orchestra.run.smithi123.stdout:052 2023-07-21T19:12:44.145 INFO:teuthology.orchestra.run.smithi123.stdout:052.out 2023-07-21T19:12:44.145 INFO:teuthology.orchestra.run.smithi123.stdout:053 2023-07-21T19:12:44.145 INFO:teuthology.orchestra.run.smithi123.stdout:053.out 2023-07-21T19:12:44.146 INFO:teuthology.orchestra.run.smithi123.stdout:054 2023-07-21T19:12:44.146 INFO:teuthology.orchestra.run.smithi123.stdout:054.out 2023-07-21T19:12:44.146 INFO:teuthology.orchestra.run.smithi123.stdout:055 2023-07-21T19:12:44.146 INFO:teuthology.orchestra.run.smithi123.stdout:055.out 2023-07-21T19:12:44.146 INFO:teuthology.orchestra.run.smithi123.stdout:056 2023-07-21T19:12:44.146 INFO:teuthology.orchestra.run.smithi123.stdout:056.out 2023-07-21T19:12:44.147 INFO:teuthology.orchestra.run.smithi123.stdout:057 2023-07-21T19:12:44.147 INFO:teuthology.orchestra.run.smithi123.stdout:057.out 2023-07-21T19:12:44.147 INFO:teuthology.orchestra.run.smithi123.stdout:058 2023-07-21T19:12:44.147 INFO:teuthology.orchestra.run.smithi123.stdout:058.out 2023-07-21T19:12:44.147 INFO:teuthology.orchestra.run.smithi123.stdout:059 2023-07-21T19:12:44.147 INFO:teuthology.orchestra.run.smithi123.stdout:059.out 2023-07-21T19:12:44.148 INFO:teuthology.orchestra.run.smithi123.stdout:060 2023-07-21T19:12:44.148 INFO:teuthology.orchestra.run.smithi123.stdout:060.out 2023-07-21T19:12:44.148 INFO:teuthology.orchestra.run.smithi123.stdout:061 2023-07-21T19:12:44.148 INFO:teuthology.orchestra.run.smithi123.stdout:061.out 2023-07-21T19:12:44.148 INFO:teuthology.orchestra.run.smithi123.stdout:062 2023-07-21T19:12:44.148 INFO:teuthology.orchestra.run.smithi123.stdout:062.out 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:063 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:063.out 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:064 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:064.out 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:065 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:065.out 2023-07-21T19:12:44.149 INFO:teuthology.orchestra.run.smithi123.stdout:066 2023-07-21T19:12:44.150 INFO:teuthology.orchestra.run.smithi123.stdout:066.out 2023-07-21T19:12:44.150 INFO:teuthology.orchestra.run.smithi123.stdout:067 2023-07-21T19:12:44.150 INFO:teuthology.orchestra.run.smithi123.stdout:067.out 2023-07-21T19:12:44.150 INFO:teuthology.orchestra.run.smithi123.stdout:068 2023-07-21T19:12:44.150 INFO:teuthology.orchestra.run.smithi123.stdout:068.out 2023-07-21T19:12:44.150 INFO:teuthology.orchestra.run.smithi123.stdout:069 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:069.out 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:070 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:070.out 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:071 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:071.out 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:072 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:072.out 2023-07-21T19:12:44.151 INFO:teuthology.orchestra.run.smithi123.stdout:073 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:073.out 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:074 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:074.out 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:075 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:075.out 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:076 2023-07-21T19:12:44.152 INFO:teuthology.orchestra.run.smithi123.stdout:076.out 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:077 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:077.out 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:078 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:078.out 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:079 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:079.out 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:080 2023-07-21T19:12:44.153 INFO:teuthology.orchestra.run.smithi123.stdout:080.out 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:081 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:081.out 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:082 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:082.out 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:083 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:083.out 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:084 2023-07-21T19:12:44.154 INFO:teuthology.orchestra.run.smithi123.stdout:084.out 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:085 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:085.out 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:086 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:086.out 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:087 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:087.out 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:088 2023-07-21T19:12:44.155 INFO:teuthology.orchestra.run.smithi123.stdout:088.out 2023-07-21T19:12:44.156 INFO:teuthology.orchestra.run.smithi123.stdout:089 2023-07-21T19:12:44.156 INFO:teuthology.orchestra.run.smithi123.stdout:089.out 2023-07-21T19:12:44.156 INFO:teuthology.orchestra.run.smithi123.stdout:090 2023-07-21T19:12:44.156 INFO:teuthology.orchestra.run.smithi123.stdout:090.out 2023-07-21T19:12:44.156 INFO:teuthology.orchestra.run.smithi123.stdout:091 2023-07-21T19:12:44.156 INFO:teuthology.orchestra.run.smithi123.stdout:091.out 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:092 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:092.out 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:093 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:093.out 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:094 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:094.out 2023-07-21T19:12:44.157 INFO:teuthology.orchestra.run.smithi123.stdout:095 2023-07-21T19:12:44.158 INFO:teuthology.orchestra.run.smithi123.stdout:095.out 2023-07-21T19:12:44.158 INFO:teuthology.orchestra.run.smithi123.stdout:096 2023-07-21T19:12:44.158 INFO:teuthology.orchestra.run.smithi123.stdout:096.out 2023-07-21T19:12:44.158 INFO:teuthology.orchestra.run.smithi123.stdout:097 2023-07-21T19:12:44.158 INFO:teuthology.orchestra.run.smithi123.stdout:097.out 2023-07-21T19:12:44.158 INFO:teuthology.orchestra.run.smithi123.stdout:098 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:098.out 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:099 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:099.out 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:100 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:100.out 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:101 2023-07-21T19:12:44.159 INFO:teuthology.orchestra.run.smithi123.stdout:101.out 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:102 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:102.out 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:103 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:103.out 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:104 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:104.out 2023-07-21T19:12:44.160 INFO:teuthology.orchestra.run.smithi123.stdout:105 2023-07-21T19:12:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:105.out 2023-07-21T19:12:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:106 2023-07-21T19:12:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:106.out 2023-07-21T19:12:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:107 2023-07-21T19:12:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:107.out 2023-07-21T19:12:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:108 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:108.out 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:109 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:109.out 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:110 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:110.out 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:111 2023-07-21T19:12:44.162 INFO:teuthology.orchestra.run.smithi123.stdout:111.out 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:112 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:112.out 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:113 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:113.out 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:114 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:114.out 2023-07-21T19:12:44.163 INFO:teuthology.orchestra.run.smithi123.stdout:115 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:115.out 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:116 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:116.out 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:117 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:117.out 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:118 2023-07-21T19:12:44.164 INFO:teuthology.orchestra.run.smithi123.stdout:118.out 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:119 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:119.out 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:120 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:120.out 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:121 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:121.out 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:122 2023-07-21T19:12:44.165 INFO:teuthology.orchestra.run.smithi123.stdout:122.out 2023-07-21T19:12:44.166 INFO:teuthology.orchestra.run.smithi123.stdout:123 2023-07-21T19:12:44.166 INFO:teuthology.orchestra.run.smithi123.stdout:123.out 2023-07-21T19:12:44.166 INFO:teuthology.orchestra.run.smithi123.stdout:124 2023-07-21T19:12:44.166 INFO:teuthology.orchestra.run.smithi123.stdout:124.out 2023-07-21T19:12:44.166 INFO:teuthology.orchestra.run.smithi123.stdout:125 2023-07-21T19:12:44.166 INFO:teuthology.orchestra.run.smithi123.stdout:125.out 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:126 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:126.out 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:127 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:127.out 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:128 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:128.out 2023-07-21T19:12:44.167 INFO:teuthology.orchestra.run.smithi123.stdout:129 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:129.out 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:130 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:130.out 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:131 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:131.out 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:132 2023-07-21T19:12:44.168 INFO:teuthology.orchestra.run.smithi123.stdout:132.out 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:133 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:133.out 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:134 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:134.out 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:135 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:135.out 2023-07-21T19:12:44.169 INFO:teuthology.orchestra.run.smithi123.stdout:136 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:136.out 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:137 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:137.out 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:138 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:138.out 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:139 2023-07-21T19:12:44.170 INFO:teuthology.orchestra.run.smithi123.stdout:139.out 2023-07-21T19:12:44.171 INFO:teuthology.orchestra.run.smithi123.stdout:140 2023-07-21T19:12:44.171 INFO:teuthology.orchestra.run.smithi123.stdout:140.out 2023-07-21T19:12:44.171 INFO:teuthology.orchestra.run.smithi123.stdout:141 2023-07-21T19:12:44.171 INFO:teuthology.orchestra.run.smithi123.stdout:141.out 2023-07-21T19:12:44.171 INFO:teuthology.orchestra.run.smithi123.stdout:142 2023-07-21T19:12:44.171 INFO:teuthology.orchestra.run.smithi123.stdout:142.out 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:143 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:143.out 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:144 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:144.out 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:145 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:145.out 2023-07-21T19:12:44.172 INFO:teuthology.orchestra.run.smithi123.stdout:146 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:146.out 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:147 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:147.out 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:148 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:148.out 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:149 2023-07-21T19:12:44.173 INFO:teuthology.orchestra.run.smithi123.stdout:149.out 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:150 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:150.out 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:151 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:151.out 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:152 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:152.out 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:153 2023-07-21T19:12:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:153.out 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:154 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:154.out 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:155 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:155.out 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:156 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:156.out 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:157 2023-07-21T19:12:44.175 INFO:teuthology.orchestra.run.smithi123.stdout:157.out 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:158 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:158.out 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:159 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:159.out 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:160 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:160.out 2023-07-21T19:12:44.176 INFO:teuthology.orchestra.run.smithi123.stdout:161 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:161.out 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:162 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:162.out 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:163 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:163.out 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:164 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:164.out 2023-07-21T19:12:44.177 INFO:teuthology.orchestra.run.smithi123.stdout:165 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:165.out 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:166 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:166.out 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:167 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:167.out 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:168 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:168.out 2023-07-21T19:12:44.178 INFO:teuthology.orchestra.run.smithi123.stdout:169 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:169.out 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:170 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:170.out 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:171 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:171.out 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:172 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:172.out 2023-07-21T19:12:44.179 INFO:teuthology.orchestra.run.smithi123.stdout:173 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:173.out 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:174 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:174.out 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:175 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:175.out 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:176 2023-07-21T19:12:44.180 INFO:teuthology.orchestra.run.smithi123.stdout:176.out 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:177 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:177.out 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:178 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:178.out 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:179 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:179.out 2023-07-21T19:12:44.181 INFO:teuthology.orchestra.run.smithi123.stdout:180 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:180.out 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:181 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:181.out 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:182 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:182.out 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:183 2023-07-21T19:12:44.182 INFO:teuthology.orchestra.run.smithi123.stdout:183.out 2023-07-21T19:12:44.183 INFO:teuthology.orchestra.run.smithi123.stdout:184 2023-07-21T19:12:44.183 INFO:teuthology.orchestra.run.smithi123.stdout:184.out 2023-07-21T19:12:44.183 INFO:teuthology.orchestra.run.smithi123.stdout:185 2023-07-21T19:12:44.183 INFO:teuthology.orchestra.run.smithi123.stdout:185.out 2023-07-21T19:12:44.183 INFO:teuthology.orchestra.run.smithi123.stdout:186 2023-07-21T19:12:44.183 INFO:teuthology.orchestra.run.smithi123.stdout:186.out 2023-07-21T19:12:44.184 INFO:teuthology.orchestra.run.smithi123.stdout:187 2023-07-21T19:12:44.184 INFO:teuthology.orchestra.run.smithi123.stdout:187.out 2023-07-21T19:12:44.184 INFO:teuthology.orchestra.run.smithi123.stdout:188 2023-07-21T19:12:44.184 INFO:teuthology.orchestra.run.smithi123.stdout:188.out 2023-07-21T19:12:44.184 INFO:teuthology.orchestra.run.smithi123.stdout:189 2023-07-21T19:12:44.184 INFO:teuthology.orchestra.run.smithi123.stdout:189.out 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:190 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:190.out 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:191 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:191.out 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:192 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:192.out 2023-07-21T19:12:44.185 INFO:teuthology.orchestra.run.smithi123.stdout:193 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:193.out 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:194 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:194.out 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:195 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:195.out 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:196 2023-07-21T19:12:44.186 INFO:teuthology.orchestra.run.smithi123.stdout:196.out 2023-07-21T19:12:44.187 INFO:teuthology.orchestra.run.smithi123.stdout:197 2023-07-21T19:12:44.187 INFO:teuthology.orchestra.run.smithi123.stdout:197.out 2023-07-21T19:12:44.187 INFO:teuthology.orchestra.run.smithi123.stdout:198 2023-07-21T19:12:44.187 INFO:teuthology.orchestra.run.smithi123.stdout:198.out 2023-07-21T19:12:44.187 INFO:teuthology.orchestra.run.smithi123.stdout:199 2023-07-21T19:12:44.187 INFO:teuthology.orchestra.run.smithi123.stdout:199.out 2023-07-21T19:12:44.188 INFO:teuthology.orchestra.run.smithi123.stdout:200 2023-07-21T19:12:44.188 INFO:teuthology.orchestra.run.smithi123.stdout:200.out 2023-07-21T19:12:44.188 INFO:teuthology.orchestra.run.smithi123.stdout:201 2023-07-21T19:12:44.188 INFO:teuthology.orchestra.run.smithi123.stdout:201.out 2023-07-21T19:12:44.188 INFO:teuthology.orchestra.run.smithi123.stdout:202 2023-07-21T19:12:44.188 INFO:teuthology.orchestra.run.smithi123.stdout:202.out 2023-07-21T19:12:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:203 2023-07-21T19:12:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:203.out 2023-07-21T19:12:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:204 2023-07-21T19:12:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:204.out 2023-07-21T19:12:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:205 2023-07-21T19:12:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:205.out 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:206 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:206.out 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:207 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:207.out 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:208 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:208.out 2023-07-21T19:12:44.190 INFO:teuthology.orchestra.run.smithi123.stdout:209 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:209.out 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:210 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:210.out 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:211 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:211.out 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:212 2023-07-21T19:12:44.191 INFO:teuthology.orchestra.run.smithi123.stdout:212.out 2023-07-21T19:12:44.192 INFO:teuthology.orchestra.run.smithi123.stdout:213 2023-07-21T19:12:44.192 INFO:teuthology.orchestra.run.smithi123.stdout:213.out 2023-07-21T19:12:44.192 INFO:teuthology.orchestra.run.smithi123.stdout:214 2023-07-21T19:12:44.192 INFO:teuthology.orchestra.run.smithi123.stdout:214.out 2023-07-21T19:12:44.192 INFO:teuthology.orchestra.run.smithi123.stdout:215 2023-07-21T19:12:44.192 INFO:teuthology.orchestra.run.smithi123.stdout:215.out 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:216 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:216.out 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:217 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:217.out 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:218 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:218.out 2023-07-21T19:12:44.193 INFO:teuthology.orchestra.run.smithi123.stdout:219 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:219.out 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:220 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:220.out 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:221 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:221.out 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:222 2023-07-21T19:12:44.194 INFO:teuthology.orchestra.run.smithi123.stdout:222.out 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:223 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:223.out 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:224 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:224.out 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:225 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:225.out 2023-07-21T19:12:44.195 INFO:teuthology.orchestra.run.smithi123.stdout:226 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:226.out 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:227 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:227.out 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:228 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:228.out 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:229 2023-07-21T19:12:44.196 INFO:teuthology.orchestra.run.smithi123.stdout:229.out 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:230 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:230.out 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:231 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:231.out 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:232 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:232.out 2023-07-21T19:12:44.197 INFO:teuthology.orchestra.run.smithi123.stdout:233 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:233.out 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:234 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:234.out 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:235 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:235.out 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:236 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:236.out 2023-07-21T19:12:44.198 INFO:teuthology.orchestra.run.smithi123.stdout:237 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:237.out 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:238 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:238.out 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:239 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:239.out 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:240 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:240.out 2023-07-21T19:12:44.199 INFO:teuthology.orchestra.run.smithi123.stdout:241 2023-07-21T19:12:44.200 INFO:teuthology.orchestra.run.smithi123.stdout:241.out 2023-07-21T19:12:44.200 INFO:teuthology.orchestra.run.smithi123.stdout:242 2023-07-21T19:12:44.200 INFO:teuthology.orchestra.run.smithi123.stdout:242.out 2023-07-21T19:12:44.200 INFO:teuthology.orchestra.run.smithi123.stdout:243 2023-07-21T19:12:44.200 INFO:teuthology.orchestra.run.smithi123.stdout:243.out 2023-07-21T19:12:44.200 INFO:teuthology.orchestra.run.smithi123.stdout:244 2023-07-21T19:12:44.201 INFO:teuthology.orchestra.run.smithi123.stdout:244.out 2023-07-21T19:12:44.201 INFO:teuthology.orchestra.run.smithi123.stdout:245 2023-07-21T19:12:44.201 INFO:teuthology.orchestra.run.smithi123.stdout:245.out 2023-07-21T19:12:44.201 INFO:teuthology.orchestra.run.smithi123.stdout:246 2023-07-21T19:12:44.202 INFO:teuthology.orchestra.run.smithi123.stdout:246.out 2023-07-21T19:12:44.202 INFO:teuthology.orchestra.run.smithi123.stdout:247 2023-07-21T19:12:44.202 INFO:teuthology.orchestra.run.smithi123.stdout:247.out 2023-07-21T19:12:44.203 INFO:teuthology.orchestra.run.smithi123.stdout:248 2023-07-21T19:12:44.203 INFO:teuthology.orchestra.run.smithi123.stdout:248.out 2023-07-21T19:12:44.203 INFO:teuthology.orchestra.run.smithi123.stdout:249 2023-07-21T19:12:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:249.out 2023-07-21T19:12:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:250 2023-07-21T19:12:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:250.out 2023-07-21T19:12:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:251 2023-07-21T19:12:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:251.out 2023-07-21T19:12:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:252 2023-07-21T19:12:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:252.out 2023-07-21T19:12:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:253 2023-07-21T19:12:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:253.out 2023-07-21T19:12:44.207 INFO:teuthology.orchestra.run.smithi123.stdout:254 2023-07-21T19:12:44.207 INFO:teuthology.orchestra.run.smithi123.stdout:254.out 2023-07-21T19:12:44.207 INFO:teuthology.orchestra.run.smithi123.stdout:255 2023-07-21T19:12:44.207 INFO:teuthology.orchestra.run.smithi123.stdout:255.out 2023-07-21T19:12:44.208 INFO:teuthology.orchestra.run.smithi123.stdout:256 2023-07-21T19:12:44.208 INFO:teuthology.orchestra.run.smithi123.stdout:256.out 2023-07-21T19:12:44.208 INFO:teuthology.orchestra.run.smithi123.stdout:257 2023-07-21T19:12:44.208 INFO:teuthology.orchestra.run.smithi123.stdout:257.out 2023-07-21T19:12:44.208 INFO:teuthology.orchestra.run.smithi123.stdout:258 2023-07-21T19:12:44.208 INFO:teuthology.orchestra.run.smithi123.stdout:258.out 2023-07-21T19:12:44.209 INFO:teuthology.orchestra.run.smithi123.stdout:259 2023-07-21T19:12:44.209 INFO:teuthology.orchestra.run.smithi123.stdout:259.out 2023-07-21T19:12:44.209 INFO:teuthology.orchestra.run.smithi123.stdout:260 2023-07-21T19:12:44.209 INFO:teuthology.orchestra.run.smithi123.stdout:260.out 2023-07-21T19:12:44.209 INFO:teuthology.orchestra.run.smithi123.stdout:261 2023-07-21T19:12:44.209 INFO:teuthology.orchestra.run.smithi123.stdout:261.out 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:262 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:262.out 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:263 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:263.out 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:264 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:264.out 2023-07-21T19:12:44.210 INFO:teuthology.orchestra.run.smithi123.stdout:265 2023-07-21T19:12:44.211 INFO:teuthology.orchestra.run.smithi123.stdout:265.out 2023-07-21T19:12:44.211 INFO:teuthology.orchestra.run.smithi123.stdout:266 2023-07-21T19:12:44.211 INFO:teuthology.orchestra.run.smithi123.stdout:266.out 2023-07-21T19:12:44.211 INFO:teuthology.orchestra.run.smithi123.stdout:267 2023-07-21T19:12:44.211 INFO:teuthology.orchestra.run.smithi123.stdout:267.out 2023-07-21T19:12:44.211 INFO:teuthology.orchestra.run.smithi123.stdout:268 2023-07-21T19:12:44.212 INFO:teuthology.orchestra.run.smithi123.stdout:268.out 2023-07-21T19:12:44.212 INFO:teuthology.orchestra.run.smithi123.stdout:269 2023-07-21T19:12:44.212 INFO:teuthology.orchestra.run.smithi123.stdout:269.out 2023-07-21T19:12:44.212 INFO:teuthology.orchestra.run.smithi123.stdout:270 2023-07-21T19:12:44.212 INFO:teuthology.orchestra.run.smithi123.stdout:270.out 2023-07-21T19:12:44.212 INFO:teuthology.orchestra.run.smithi123.stdout:271 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:271.out 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:272 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:272.out 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:273 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:273.out 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:274 2023-07-21T19:12:44.213 INFO:teuthology.orchestra.run.smithi123.stdout:274.out 2023-07-21T19:12:44.214 INFO:teuthology.orchestra.run.smithi123.stdout:275 2023-07-21T19:12:44.214 INFO:teuthology.orchestra.run.smithi123.stdout:275.out 2023-07-21T19:12:44.214 INFO:teuthology.orchestra.run.smithi123.stdout:276 2023-07-21T19:12:44.214 INFO:teuthology.orchestra.run.smithi123.stdout:276.out 2023-07-21T19:12:44.214 INFO:teuthology.orchestra.run.smithi123.stdout:277 2023-07-21T19:12:44.215 INFO:teuthology.orchestra.run.smithi123.stdout:277.out 2023-07-21T19:12:44.215 INFO:teuthology.orchestra.run.smithi123.stdout:278 2023-07-21T19:12:44.215 INFO:teuthology.orchestra.run.smithi123.stdout:278.out 2023-07-21T19:12:44.215 INFO:teuthology.orchestra.run.smithi123.stdout:279 2023-07-21T19:12:44.215 INFO:teuthology.orchestra.run.smithi123.stdout:279.out 2023-07-21T19:12:44.215 INFO:teuthology.orchestra.run.smithi123.stdout:280 2023-07-21T19:12:44.216 INFO:teuthology.orchestra.run.smithi123.stdout:280.out 2023-07-21T19:12:44.216 INFO:teuthology.orchestra.run.smithi123.stdout:281 2023-07-21T19:12:44.216 INFO:teuthology.orchestra.run.smithi123.stdout:281.out 2023-07-21T19:12:44.216 INFO:teuthology.orchestra.run.smithi123.stdout:282 2023-07-21T19:12:44.216 INFO:teuthology.orchestra.run.smithi123.stdout:282.out 2023-07-21T19:12:44.216 INFO:teuthology.orchestra.run.smithi123.stdout:283 2023-07-21T19:12:44.217 INFO:teuthology.orchestra.run.smithi123.stdout:283.out 2023-07-21T19:12:44.217 INFO:teuthology.orchestra.run.smithi123.stdout:284 2023-07-21T19:12:44.217 INFO:teuthology.orchestra.run.smithi123.stdout:284.out 2023-07-21T19:12:44.217 INFO:teuthology.orchestra.run.smithi123.stdout:285 2023-07-21T19:12:44.217 INFO:teuthology.orchestra.run.smithi123.stdout:285.out 2023-07-21T19:12:44.217 INFO:teuthology.orchestra.run.smithi123.stdout:286 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:286.out 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:287 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:287.out 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:288 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:288.out 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:289 2023-07-21T19:12:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:289.out 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:290 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:290.out 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:291 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:291.out 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:292 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:292.out 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:293 2023-07-21T19:12:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:293.out 2023-07-21T19:12:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:294 2023-07-21T19:12:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:294.out 2023-07-21T19:12:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:295 2023-07-21T19:12:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:295.out 2023-07-21T19:12:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:296 2023-07-21T19:12:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:296.out 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:297 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:297.out 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:298 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:298.out 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:299 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:299.out 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:300 2023-07-21T19:12:44.221 INFO:teuthology.orchestra.run.smithi123.stdout:300.out 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:301 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:301.out 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:302 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:302.out 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:303 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:303.out 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:304 2023-07-21T19:12:44.222 INFO:teuthology.orchestra.run.smithi123.stdout:304.out 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:305 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:305.out 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:306 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:306.out 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:307 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:307.out 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:308 2023-07-21T19:12:44.223 INFO:teuthology.orchestra.run.smithi123.stdout:308.out 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:309 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:309.out 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:310 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:310.out 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:311 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:311.out 2023-07-21T19:12:44.224 INFO:teuthology.orchestra.run.smithi123.stdout:312 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:312.out 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:313 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:313.out 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:314 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:314.out 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:315 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:315.out 2023-07-21T19:12:44.225 INFO:teuthology.orchestra.run.smithi123.stdout:316 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:316.out 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:317 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:317.out 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:318 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:318.out 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:319 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:319.out 2023-07-21T19:12:44.226 INFO:teuthology.orchestra.run.smithi123.stdout:320 2023-07-21T19:12:44.227 INFO:teuthology.orchestra.run.smithi123.stdout:320.out 2023-07-21T19:12:44.227 INFO:teuthology.orchestra.run.smithi123.stdout:321 2023-07-21T19:12:44.227 INFO:teuthology.orchestra.run.smithi123.stdout:321.out 2023-07-21T19:12:44.227 INFO:teuthology.orchestra.run.smithi123.stdout:322 2023-07-21T19:12:44.227 INFO:teuthology.orchestra.run.smithi123.stdout:322.out 2023-07-21T19:12:44.227 INFO:teuthology.orchestra.run.smithi123.stdout:323 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:323.out 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:324 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:324.out 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:325 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:325.out 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:326 2023-07-21T19:12:44.228 INFO:teuthology.orchestra.run.smithi123.stdout:326.out 2023-07-21T19:12:44.229 INFO:teuthology.orchestra.run.smithi123.stdout:327 2023-07-21T19:12:44.229 INFO:teuthology.orchestra.run.smithi123.stdout:327.out 2023-07-21T19:12:44.229 INFO:teuthology.orchestra.run.smithi123.stdout:328 2023-07-21T19:12:44.229 INFO:teuthology.orchestra.run.smithi123.stdout:328.out 2023-07-21T19:12:44.229 INFO:teuthology.orchestra.run.smithi123.stdout:329 2023-07-21T19:12:44.229 INFO:teuthology.orchestra.run.smithi123.stdout:329.out 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:330 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:330.out 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:331 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:331.out 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:332 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:332.out 2023-07-21T19:12:44.230 INFO:teuthology.orchestra.run.smithi123.stdout:333 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:333.out 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:334 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:334.out 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:335 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:335.out 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:336 2023-07-21T19:12:44.231 INFO:teuthology.orchestra.run.smithi123.stdout:336.out 2023-07-21T19:12:44.232 INFO:teuthology.orchestra.run.smithi123.stdout:337 2023-07-21T19:12:44.232 INFO:teuthology.orchestra.run.smithi123.stdout:337.out 2023-07-21T19:12:44.232 INFO:teuthology.orchestra.run.smithi123.stdout:338 2023-07-21T19:12:44.232 INFO:teuthology.orchestra.run.smithi123.stdout:338.out 2023-07-21T19:12:44.232 INFO:teuthology.orchestra.run.smithi123.stdout:339 2023-07-21T19:12:44.232 INFO:teuthology.orchestra.run.smithi123.stdout:339.out 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:340 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:340.out 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:341 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:341.out 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:342 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:342.out 2023-07-21T19:12:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:343 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:343.out 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:344 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:344.out 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:345 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:345.out 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:346 2023-07-21T19:12:44.234 INFO:teuthology.orchestra.run.smithi123.stdout:346.out 2023-07-21T19:12:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:347 2023-07-21T19:12:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:347.out 2023-07-21T19:12:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:348 2023-07-21T19:12:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:348.out 2023-07-21T19:12:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:349 2023-07-21T19:12:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:349.out 2023-07-21T19:12:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:350 2023-07-21T19:12:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:350.out 2023-07-21T19:12:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:351 2023-07-21T19:12:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:351.out 2023-07-21T19:12:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:352 2023-07-21T19:12:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:352.out 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:353 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:353.out 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:354 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:354.out 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:355 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:355.out 2023-07-21T19:12:44.237 INFO:teuthology.orchestra.run.smithi123.stdout:356 2023-07-21T19:12:44.238 INFO:teuthology.orchestra.run.smithi123.stdout:356.out 2023-07-21T19:12:44.238 INFO:teuthology.orchestra.run.smithi123.stdout:357 2023-07-21T19:12:44.238 INFO:teuthology.orchestra.run.smithi123.stdout:357.out 2023-07-21T19:12:44.238 INFO:teuthology.orchestra.run.smithi123.stdout:358 2023-07-21T19:12:44.238 INFO:teuthology.orchestra.run.smithi123.stdout:358.out 2023-07-21T19:12:44.238 INFO:teuthology.orchestra.run.smithi123.stdout:359 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:359.out 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:360 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:360.out 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:361 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:361.out 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:362 2023-07-21T19:12:44.239 INFO:teuthology.orchestra.run.smithi123.stdout:362.out 2023-07-21T19:12:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:363 2023-07-21T19:12:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:363.out 2023-07-21T19:12:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:364 2023-07-21T19:12:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:364.out 2023-07-21T19:12:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:365 2023-07-21T19:12:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:365.out 2023-07-21T19:12:44.241 INFO:teuthology.orchestra.run.smithi123.stdout:366 2023-07-21T19:12:44.241 INFO:teuthology.orchestra.run.smithi123.stdout:366.out 2023-07-21T19:12:44.241 INFO:teuthology.orchestra.run.smithi123.stdout:367 2023-07-21T19:12:44.241 INFO:teuthology.orchestra.run.smithi123.stdout:367.out 2023-07-21T19:12:44.241 INFO:teuthology.orchestra.run.smithi123.stdout:368 2023-07-21T19:12:44.241 INFO:teuthology.orchestra.run.smithi123.stdout:368.out 2023-07-21T19:12:44.243 INFO:teuthology.orchestra.run.smithi123.stdout:369 2023-07-21T19:12:44.243 INFO:teuthology.orchestra.run.smithi123.stdout:369.out 2023-07-21T19:12:44.243 INFO:teuthology.orchestra.run.smithi123.stdout:370 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:370.out 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:371 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:371.out 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:372 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:372.out 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:373 2023-07-21T19:12:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:373.out 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:374 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:374.out 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:375 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:375.out 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:376 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:376.out 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:377 2023-07-21T19:12:44.245 INFO:teuthology.orchestra.run.smithi123.stdout:377.out 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:378 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:378.out 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:379 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:379.out 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:380 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:380.out 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:381 2023-07-21T19:12:44.246 INFO:teuthology.orchestra.run.smithi123.stdout:381.out 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:382 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:382.out 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:383 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:383.out 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:384 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:384.out 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:385 2023-07-21T19:12:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:385.out 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:386 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:386.out 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:387 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:387.out 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:388 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:388.out 2023-07-21T19:12:44.248 INFO:teuthology.orchestra.run.smithi123.stdout:389 2023-07-21T19:12:44.249 INFO:teuthology.orchestra.run.smithi123.stdout:389.out 2023-07-21T19:12:44.249 INFO:teuthology.orchestra.run.smithi123.stdout:390 2023-07-21T19:12:44.249 INFO:teuthology.orchestra.run.smithi123.stdout:390.out 2023-07-21T19:12:44.249 INFO:teuthology.orchestra.run.smithi123.stdout:391 2023-07-21T19:12:44.249 INFO:teuthology.orchestra.run.smithi123.stdout:391.out 2023-07-21T19:12:44.249 INFO:teuthology.orchestra.run.smithi123.stdout:392 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:392.out 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:393 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:393.out 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:394 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:394.out 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:395 2023-07-21T19:12:44.250 INFO:teuthology.orchestra.run.smithi123.stdout:395.out 2023-07-21T19:12:44.251 INFO:teuthology.orchestra.run.smithi123.stdout:396 2023-07-21T19:12:44.251 INFO:teuthology.orchestra.run.smithi123.stdout:396.out 2023-07-21T19:12:44.251 INFO:teuthology.orchestra.run.smithi123.stdout:397 2023-07-21T19:12:44.251 INFO:teuthology.orchestra.run.smithi123.stdout:397.out 2023-07-21T19:12:44.251 INFO:teuthology.orchestra.run.smithi123.stdout:398 2023-07-21T19:12:44.251 INFO:teuthology.orchestra.run.smithi123.stdout:398.out 2023-07-21T19:12:44.252 INFO:teuthology.orchestra.run.smithi123.stdout:399 2023-07-21T19:12:44.252 INFO:teuthology.orchestra.run.smithi123.stdout:399.out 2023-07-21T19:12:44.252 INFO:teuthology.orchestra.run.smithi123.stdout:400 2023-07-21T19:12:44.252 INFO:teuthology.orchestra.run.smithi123.stdout:400.out 2023-07-21T19:12:44.252 INFO:teuthology.orchestra.run.smithi123.stdout:401 2023-07-21T19:12:44.252 INFO:teuthology.orchestra.run.smithi123.stdout:401.out 2023-07-21T19:12:44.253 INFO:teuthology.orchestra.run.smithi123.stdout:402 2023-07-21T19:12:44.253 INFO:teuthology.orchestra.run.smithi123.stdout:402.out 2023-07-21T19:12:44.253 INFO:teuthology.orchestra.run.smithi123.stdout:403 2023-07-21T19:12:44.253 INFO:teuthology.orchestra.run.smithi123.stdout:403.out 2023-07-21T19:12:44.253 INFO:teuthology.orchestra.run.smithi123.stdout:404 2023-07-21T19:12:44.253 INFO:teuthology.orchestra.run.smithi123.stdout:404.out 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:405 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:405.out 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:406 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:406.out 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:407 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:407.out 2023-07-21T19:12:44.254 INFO:teuthology.orchestra.run.smithi123.stdout:408 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:408.out 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:409 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:409.out 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:410 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:410.out 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:411 2023-07-21T19:12:44.255 INFO:teuthology.orchestra.run.smithi123.stdout:411.out 2023-07-21T19:12:44.256 INFO:teuthology.orchestra.run.smithi123.stdout:412 2023-07-21T19:12:44.256 INFO:teuthology.orchestra.run.smithi123.stdout:412.out 2023-07-21T19:12:44.256 INFO:teuthology.orchestra.run.smithi123.stdout:413 2023-07-21T19:12:44.256 INFO:teuthology.orchestra.run.smithi123.stdout:413.out 2023-07-21T19:12:44.256 INFO:teuthology.orchestra.run.smithi123.stdout:414 2023-07-21T19:12:44.256 INFO:teuthology.orchestra.run.smithi123.stdout:414.out 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:415 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:415.out 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:416 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:416.out 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:417 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:417.out 2023-07-21T19:12:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:418 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:418.out 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:419 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:419.out 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:420 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:420.out 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:421 2023-07-21T19:12:44.258 INFO:teuthology.orchestra.run.smithi123.stdout:421.out 2023-07-21T19:12:44.259 INFO:teuthology.orchestra.run.smithi123.stdout:422 2023-07-21T19:12:44.259 INFO:teuthology.orchestra.run.smithi123.stdout:422.out 2023-07-21T19:12:44.259 INFO:teuthology.orchestra.run.smithi123.stdout:423 2023-07-21T19:12:44.259 INFO:teuthology.orchestra.run.smithi123.stdout:423.out 2023-07-21T19:12:44.259 INFO:teuthology.orchestra.run.smithi123.stdout:424 2023-07-21T19:12:44.259 INFO:teuthology.orchestra.run.smithi123.stdout:424.out 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:425 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:425.out 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:426 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:426.out 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:427 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:427.out 2023-07-21T19:12:44.260 INFO:teuthology.orchestra.run.smithi123.stdout:428 2023-07-21T19:12:44.261 INFO:teuthology.orchestra.run.smithi123.stdout:428.out 2023-07-21T19:12:44.261 INFO:teuthology.orchestra.run.smithi123.stdout:429 2023-07-21T19:12:44.261 INFO:teuthology.orchestra.run.smithi123.stdout:429.out 2023-07-21T19:12:44.261 INFO:teuthology.orchestra.run.smithi123.stdout:430 2023-07-21T19:12:44.261 INFO:teuthology.orchestra.run.smithi123.stdout:430.out 2023-07-21T19:12:44.261 INFO:teuthology.orchestra.run.smithi123.stdout:431 2023-07-21T19:12:44.262 INFO:teuthology.orchestra.run.smithi123.stdout:431.out 2023-07-21T19:12:44.262 INFO:teuthology.orchestra.run.smithi123.stdout:432 2023-07-21T19:12:44.262 INFO:teuthology.orchestra.run.smithi123.stdout:432.out 2023-07-21T19:12:44.262 INFO:teuthology.orchestra.run.smithi123.stdout:433 2023-07-21T19:12:44.262 INFO:teuthology.orchestra.run.smithi123.stdout:433.out 2023-07-21T19:12:44.262 INFO:teuthology.orchestra.run.smithi123.stdout:434 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:434.out 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:435 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:435.out 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:436 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:436.out 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:437 2023-07-21T19:12:44.263 INFO:teuthology.orchestra.run.smithi123.stdout:437.out 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:438 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:438.out 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:439 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:439.out 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:440 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:440.out 2023-07-21T19:12:44.264 INFO:teuthology.orchestra.run.smithi123.stdout:441 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:441.out 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:442 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:442.out 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:443 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:443.out 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:444 2023-07-21T19:12:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:444.out 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:445 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:445.out 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:446 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:446.out 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:447 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:447.out 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:448 2023-07-21T19:12:44.266 INFO:teuthology.orchestra.run.smithi123.stdout:448.out 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:449 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:449.out 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:450 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:450.out 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:451 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:451.out 2023-07-21T19:12:44.267 INFO:teuthology.orchestra.run.smithi123.stdout:452 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:452.out 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:453 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:453.out 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:454 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:454.out 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:455 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:455.out 2023-07-21T19:12:44.268 INFO:teuthology.orchestra.run.smithi123.stdout:456 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:456.out 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:457 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:457.out 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:458 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:458.out 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:459 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:459.out 2023-07-21T19:12:44.269 INFO:teuthology.orchestra.run.smithi123.stdout:460 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:460.out 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:461 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:461.out 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:462 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:462.out 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:463 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:463.out 2023-07-21T19:12:44.270 INFO:teuthology.orchestra.run.smithi123.stdout:464 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:464.out 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:465 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:465.out 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:466 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:466.out 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:467 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:467.out 2023-07-21T19:12:44.271 INFO:teuthology.orchestra.run.smithi123.stdout:468 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:468.out 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:469 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:469.out 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:470 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:470.out 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:471 2023-07-21T19:12:44.272 INFO:teuthology.orchestra.run.smithi123.stdout:471.out 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:472 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:472.out 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:473 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:473.out 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:474 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:474.out 2023-07-21T19:12:44.273 INFO:teuthology.orchestra.run.smithi123.stdout:475 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:475.out 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:476 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:476.out 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:477 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:477.out 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:478 2023-07-21T19:12:44.274 INFO:teuthology.orchestra.run.smithi123.stdout:478.out 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:479 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:479.out 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:480 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:480.out 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:481 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:481.out 2023-07-21T19:12:44.275 INFO:teuthology.orchestra.run.smithi123.stdout:482 2023-07-21T19:12:44.276 INFO:teuthology.orchestra.run.smithi123.stdout:482.out 2023-07-21T19:12:44.276 INFO:teuthology.orchestra.run.smithi123.stdout:483 2023-07-21T19:12:44.276 INFO:teuthology.orchestra.run.smithi123.stdout:483.out 2023-07-21T19:12:44.276 INFO:teuthology.orchestra.run.smithi123.stdout:484 2023-07-21T19:12:44.276 INFO:teuthology.orchestra.run.smithi123.stdout:484.out 2023-07-21T19:12:44.276 INFO:teuthology.orchestra.run.smithi123.stdout:485 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:485.out 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:486 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:486.out 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:487 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:487.out 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:488 2023-07-21T19:12:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:488.out 2023-07-21T19:12:44.278 INFO:teuthology.orchestra.run.smithi123.stdout:489 2023-07-21T19:12:44.278 INFO:teuthology.orchestra.run.smithi123.stdout:489.out 2023-07-21T19:12:44.278 INFO:teuthology.orchestra.run.smithi123.stdout:490 2023-07-21T19:12:44.278 INFO:teuthology.orchestra.run.smithi123.stdout:490.out 2023-07-21T19:12:44.278 INFO:teuthology.orchestra.run.smithi123.stdout:491 2023-07-21T19:12:44.278 INFO:teuthology.orchestra.run.smithi123.stdout:491.out 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:492 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:492.out 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:493 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:493.out 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:494 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:494.out 2023-07-21T19:12:44.279 INFO:teuthology.orchestra.run.smithi123.stdout:495 2023-07-21T19:12:44.280 INFO:teuthology.orchestra.run.smithi123.stdout:495.out 2023-07-21T19:12:44.280 INFO:teuthology.orchestra.run.smithi123.stdout:496 2023-07-21T19:12:44.280 INFO:teuthology.orchestra.run.smithi123.stdout:496.out 2023-07-21T19:12:44.280 INFO:teuthology.orchestra.run.smithi123.stdout:497 2023-07-21T19:12:44.280 INFO:teuthology.orchestra.run.smithi123.stdout:497.out 2023-07-21T19:12:44.280 INFO:teuthology.orchestra.run.smithi123.stdout:498 2023-07-21T19:12:44.281 INFO:teuthology.orchestra.run.smithi123.stdout:498.out 2023-07-21T19:12:44.281 INFO:teuthology.orchestra.run.smithi123.stdout:499 2023-07-21T19:12:44.281 INFO:teuthology.orchestra.run.smithi123.stdout:499.out 2023-07-21T19:12:44.281 INFO:teuthology.orchestra.run.smithi123.stdout:500 2023-07-21T19:12:44.281 INFO:teuthology.orchestra.run.smithi123.stdout:500.out 2023-07-21T19:12:44.281 INFO:teuthology.orchestra.run.smithi123.stdout:501 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:501.out 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:502 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:502.out 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:503 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:503.out 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:504 2023-07-21T19:12:44.282 INFO:teuthology.orchestra.run.smithi123.stdout:504.out 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:505 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:505.out 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:506 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:506.out 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:507 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:507.out 2023-07-21T19:12:44.283 INFO:teuthology.orchestra.run.smithi123.stdout:508 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:508.out 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:509 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:509.out 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:510 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:510.out 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:511 2023-07-21T19:12:44.284 INFO:teuthology.orchestra.run.smithi123.stdout:511.out 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:512 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:512.out 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:513 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:513.out 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:514 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:514.out 2023-07-21T19:12:44.285 INFO:teuthology.orchestra.run.smithi123.stdout:515 2023-07-21T19:12:44.286 INFO:teuthology.orchestra.run.smithi123.stdout:515.out 2023-07-21T19:12:44.286 INFO:teuthology.orchestra.run.smithi123.stdout:516 2023-07-21T19:12:44.286 INFO:teuthology.orchestra.run.smithi123.stdout:516.out 2023-07-21T19:12:44.286 INFO:teuthology.orchestra.run.smithi123.stdout:517 2023-07-21T19:12:44.286 INFO:teuthology.orchestra.run.smithi123.stdout:517.out 2023-07-21T19:12:44.286 INFO:teuthology.orchestra.run.smithi123.stdout:518 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:518.out 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:519 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:519.out 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:520 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:520.out 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:521 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:521.out 2023-07-21T19:12:44.287 INFO:teuthology.orchestra.run.smithi123.stdout:522 2023-07-21T19:12:44.288 INFO:teuthology.orchestra.run.smithi123.stdout:522.out 2023-07-21T19:12:44.288 INFO:teuthology.orchestra.run.smithi123.stdout:523 2023-07-21T19:12:44.288 INFO:teuthology.orchestra.run.smithi123.stdout:523.out 2023-07-21T19:12:44.288 INFO:teuthology.orchestra.run.smithi123.stdout:524 2023-07-21T19:12:44.288 INFO:teuthology.orchestra.run.smithi123.stdout:524.out 2023-07-21T19:12:44.288 INFO:teuthology.orchestra.run.smithi123.stdout:525 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:525.out 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:526 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:526.out 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:527 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:527.out 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:528 2023-07-21T19:12:44.289 INFO:teuthology.orchestra.run.smithi123.stdout:528.out 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:529 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:529.out 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:530 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:530.out 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:531 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:531.out 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:532 2023-07-21T19:12:44.290 INFO:teuthology.orchestra.run.smithi123.stdout:532.out 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:533 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:533.out 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:534 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:534.out 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:535 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:535.out 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:536 2023-07-21T19:12:44.291 INFO:teuthology.orchestra.run.smithi123.stdout:536.out 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:537 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:537.out 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:538 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:538.out 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:539 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:539.out 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:540 2023-07-21T19:12:44.292 INFO:teuthology.orchestra.run.smithi123.stdout:540.out 2023-07-21T19:12:44.293 INFO:teuthology.orchestra.run.smithi123.stdout:541 2023-07-21T19:12:44.293 INFO:teuthology.orchestra.run.smithi123.stdout:541.out 2023-07-21T19:12:44.293 INFO:teuthology.orchestra.run.smithi123.stdout:542 2023-07-21T19:12:44.293 INFO:teuthology.orchestra.run.smithi123.stdout:542.out 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:543 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:543.out 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:544 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:544.out 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:545 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:545.out 2023-07-21T19:12:44.294 INFO:teuthology.orchestra.run.smithi123.stdout:546 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:546.out 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:547 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:547.out 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:548 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:548.out 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:549 2023-07-21T19:12:44.295 INFO:teuthology.orchestra.run.smithi123.stdout:549.out 2023-07-21T19:12:44.296 INFO:teuthology.orchestra.run.smithi123.stdout:550 2023-07-21T19:12:44.296 INFO:teuthology.orchestra.run.smithi123.stdout:550.out 2023-07-21T19:12:44.296 INFO:teuthology.orchestra.run.smithi123.stdout:551 2023-07-21T19:12:44.296 INFO:teuthology.orchestra.run.smithi123.stdout:551.out 2023-07-21T19:12:44.296 INFO:teuthology.orchestra.run.smithi123.stdout:552 2023-07-21T19:12:44.296 INFO:teuthology.orchestra.run.smithi123.stdout:552.out 2023-07-21T19:12:44.297 INFO:teuthology.orchestra.run.smithi123.stdout:553 2023-07-21T19:12:44.297 INFO:teuthology.orchestra.run.smithi123.stdout:553.out 2023-07-21T19:12:44.297 INFO:teuthology.orchestra.run.smithi123.stdout:554 2023-07-21T19:12:44.297 INFO:teuthology.orchestra.run.smithi123.stdout:554.out 2023-07-21T19:12:44.297 INFO:teuthology.orchestra.run.smithi123.stdout:555 2023-07-21T19:12:44.297 INFO:teuthology.orchestra.run.smithi123.stdout:555.out 2023-07-21T19:12:44.298 INFO:teuthology.orchestra.run.smithi123.stdout:556 2023-07-21T19:12:44.298 INFO:teuthology.orchestra.run.smithi123.stdout:556.out 2023-07-21T19:12:44.298 INFO:teuthology.orchestra.run.smithi123.stdout:557 2023-07-21T19:12:44.298 INFO:teuthology.orchestra.run.smithi123.stdout:557.out 2023-07-21T19:12:44.298 INFO:teuthology.orchestra.run.smithi123.stdout:558 2023-07-21T19:12:44.298 INFO:teuthology.orchestra.run.smithi123.stdout:558.out 2023-07-21T19:12:44.299 INFO:teuthology.orchestra.run.smithi123.stdout:559 2023-07-21T19:12:44.299 INFO:teuthology.orchestra.run.smithi123.stdout:559.out 2023-07-21T19:12:44.299 INFO:teuthology.orchestra.run.smithi123.stdout:560 2023-07-21T19:12:44.299 INFO:teuthology.orchestra.run.smithi123.stdout:560.out 2023-07-21T19:12:44.299 INFO:teuthology.orchestra.run.smithi123.stdout:561 2023-07-21T19:12:44.299 INFO:teuthology.orchestra.run.smithi123.stdout:561.out 2023-07-21T19:12:44.300 INFO:teuthology.orchestra.run.smithi123.stdout:562 2023-07-21T19:12:44.300 INFO:teuthology.orchestra.run.smithi123.stdout:562.out 2023-07-21T19:12:44.300 INFO:teuthology.orchestra.run.smithi123.stdout:563 2023-07-21T19:12:44.300 INFO:teuthology.orchestra.run.smithi123.stdout:563.out 2023-07-21T19:12:44.300 INFO:teuthology.orchestra.run.smithi123.stdout:564 2023-07-21T19:12:44.300 INFO:teuthology.orchestra.run.smithi123.stdout:564.out 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:565 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:565.out 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:566 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:566.out 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:567 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:567.out 2023-07-21T19:12:44.301 INFO:teuthology.orchestra.run.smithi123.stdout:568 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:568.out 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:569 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:569.out 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:570 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:570.out 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:571 2023-07-21T19:12:44.302 INFO:teuthology.orchestra.run.smithi123.stdout:571.out 2023-07-21T19:12:44.303 INFO:teuthology.orchestra.run.smithi123.stdout:572 2023-07-21T19:12:44.303 INFO:teuthology.orchestra.run.smithi123.stdout:572.out 2023-07-21T19:12:44.303 INFO:teuthology.orchestra.run.smithi123.stdout:573 2023-07-21T19:12:44.303 INFO:teuthology.orchestra.run.smithi123.stdout:573.out 2023-07-21T19:12:44.303 INFO:teuthology.orchestra.run.smithi123.stdout:574 2023-07-21T19:12:44.303 INFO:teuthology.orchestra.run.smithi123.stdout:574.out 2023-07-21T19:12:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:575 2023-07-21T19:12:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:575.out 2023-07-21T19:12:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:576 2023-07-21T19:12:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:576.out 2023-07-21T19:12:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:577 2023-07-21T19:12:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:577.out 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:578 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:578.out 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:579 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:579.out 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:580 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:580.out 2023-07-21T19:12:44.305 INFO:teuthology.orchestra.run.smithi123.stdout:581 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:581.out 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:582 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:582.out 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:583 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:583.out 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:584 2023-07-21T19:12:44.306 INFO:teuthology.orchestra.run.smithi123.stdout:584.out 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:585 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:585.out 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:586 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:586.out 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:587 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:587.out 2023-07-21T19:12:44.307 INFO:teuthology.orchestra.run.smithi123.stdout:588 2023-07-21T19:12:44.308 INFO:teuthology.orchestra.run.smithi123.stdout:588.out 2023-07-21T19:12:44.308 INFO:teuthology.orchestra.run.smithi123.stdout:589 2023-07-21T19:12:44.308 INFO:teuthology.orchestra.run.smithi123.stdout:589.out 2023-07-21T19:12:44.308 INFO:teuthology.orchestra.run.smithi123.stdout:590 2023-07-21T19:12:44.308 INFO:teuthology.orchestra.run.smithi123.stdout:590.out 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:591 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:591.out 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:592 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:592.out 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:593 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:593.out 2023-07-21T19:12:44.309 INFO:teuthology.orchestra.run.smithi123.stdout:594 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:594.out 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:595 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:595.out 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:596 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:596.out 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:597 2023-07-21T19:12:44.310 INFO:teuthology.orchestra.run.smithi123.stdout:597.out 2023-07-21T19:12:44.311 INFO:teuthology.orchestra.run.smithi123.stdout:598 2023-07-21T19:12:44.311 INFO:teuthology.orchestra.run.smithi123.stdout:598.out 2023-07-21T19:12:44.311 INFO:teuthology.orchestra.run.smithi123.stdout:599 2023-07-21T19:12:44.311 INFO:teuthology.orchestra.run.smithi123.stdout:599.out 2023-07-21T19:12:44.311 INFO:teuthology.orchestra.run.smithi123.stdout:600 2023-07-21T19:12:44.311 INFO:teuthology.orchestra.run.smithi123.stdout:600.out 2023-07-21T19:12:44.312 INFO:teuthology.orchestra.run.smithi123.stdout:601 2023-07-21T19:12:44.312 INFO:teuthology.orchestra.run.smithi123.stdout:601.out 2023-07-21T19:12:44.312 INFO:teuthology.orchestra.run.smithi123.stdout:602 2023-07-21T19:12:44.312 INFO:teuthology.orchestra.run.smithi123.stdout:602.out 2023-07-21T19:12:44.312 INFO:teuthology.orchestra.run.smithi123.stdout:603 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:603.out 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:604 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:604.out 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:605 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:605.out 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:606 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:606.out 2023-07-21T19:12:44.313 INFO:teuthology.orchestra.run.smithi123.stdout:607 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:607.out 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:608 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:608.out 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:609 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:609.out 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:610 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:610.out 2023-07-21T19:12:44.314 INFO:teuthology.orchestra.run.smithi123.stdout:611 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:611.out 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:612 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:612.out 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:613 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:613.out 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:614 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:614.out 2023-07-21T19:12:44.315 INFO:teuthology.orchestra.run.smithi123.stdout:615 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:615.out 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:616 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:616.out 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:617 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:617.out 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:618 2023-07-21T19:12:44.316 INFO:teuthology.orchestra.run.smithi123.stdout:618.out 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:619 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:619.out 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:620 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:620.out 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:621 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:621.out 2023-07-21T19:12:44.317 INFO:teuthology.orchestra.run.smithi123.stdout:622 2023-07-21T19:12:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:622.out 2023-07-21T19:12:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:623 2023-07-21T19:12:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:623.out 2023-07-21T19:12:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:624 2023-07-21T19:12:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:624.out 2023-07-21T19:12:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:625 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:625.out 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:626 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:626.out 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:627 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:627.out 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:628 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:628.out 2023-07-21T19:12:44.319 INFO:teuthology.orchestra.run.smithi123.stdout:629 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:629.out 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:630 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:630.out 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:631 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:631.out 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:632 2023-07-21T19:12:44.320 INFO:teuthology.orchestra.run.smithi123.stdout:632.out 2023-07-21T19:12:44.321 INFO:teuthology.orchestra.run.smithi123.stdout:633 2023-07-21T19:12:44.321 INFO:teuthology.orchestra.run.smithi123.stdout:633.out 2023-07-21T19:12:44.321 INFO:teuthology.orchestra.run.smithi123.stdout:634 2023-07-21T19:12:44.321 INFO:teuthology.orchestra.run.smithi123.stdout:634.out 2023-07-21T19:12:44.321 INFO:teuthology.orchestra.run.smithi123.stdout:635 2023-07-21T19:12:44.321 INFO:teuthology.orchestra.run.smithi123.stdout:635.out 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:636 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:636.out 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:637 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:637.out 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:638 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:638.out 2023-07-21T19:12:44.322 INFO:teuthology.orchestra.run.smithi123.stdout:639 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:639.out 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:640 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:640.out 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:641 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:641.out 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:642 2023-07-21T19:12:44.323 INFO:teuthology.orchestra.run.smithi123.stdout:642.out 2023-07-21T19:12:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:643 2023-07-21T19:12:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:643.out 2023-07-21T19:12:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:644 2023-07-21T19:12:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:644.out 2023-07-21T19:12:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:645 2023-07-21T19:12:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:645.out 2023-07-21T19:12:44.325 INFO:teuthology.orchestra.run.smithi123.stdout:646 2023-07-21T19:12:44.325 INFO:teuthology.orchestra.run.smithi123.stdout:646.out 2023-07-21T19:12:44.325 INFO:teuthology.orchestra.run.smithi123.stdout:647 2023-07-21T19:12:44.325 INFO:teuthology.orchestra.run.smithi123.stdout:647.out 2023-07-21T19:12:44.325 INFO:teuthology.orchestra.run.smithi123.stdout:648 2023-07-21T19:12:44.325 INFO:teuthology.orchestra.run.smithi123.stdout:648.out 2023-07-21T19:12:44.326 INFO:teuthology.orchestra.run.smithi123.stdout:649 2023-07-21T19:12:44.326 INFO:teuthology.orchestra.run.smithi123.stdout:649.out 2023-07-21T19:12:44.326 INFO:teuthology.orchestra.run.smithi123.stdout:650 2023-07-21T19:12:44.326 INFO:teuthology.orchestra.run.smithi123.stdout:650.out 2023-07-21T19:12:44.326 INFO:teuthology.orchestra.run.smithi123.stdout:651 2023-07-21T19:12:44.326 INFO:teuthology.orchestra.run.smithi123.stdout:651.out 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:652 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:652.out 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:653 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:653.out 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:654 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:654.out 2023-07-21T19:12:44.327 INFO:teuthology.orchestra.run.smithi123.stdout:655 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:655.out 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:656 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:656.out 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:657 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:657.out 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:658 2023-07-21T19:12:44.328 INFO:teuthology.orchestra.run.smithi123.stdout:658.out 2023-07-21T19:12:44.329 INFO:teuthology.orchestra.run.smithi123.stdout:659 2023-07-21T19:12:44.329 INFO:teuthology.orchestra.run.smithi123.stdout:659.out 2023-07-21T19:12:44.329 INFO:teuthology.orchestra.run.smithi123.stdout:660 2023-07-21T19:12:44.329 INFO:teuthology.orchestra.run.smithi123.stdout:660.out 2023-07-21T19:12:44.329 INFO:teuthology.orchestra.run.smithi123.stdout:661 2023-07-21T19:12:44.329 INFO:teuthology.orchestra.run.smithi123.stdout:661.out 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:662 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:662.out 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:663 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:663.out 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:664 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:664.out 2023-07-21T19:12:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:665 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:665.out 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:666 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:666.out 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:667 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:667.out 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:668 2023-07-21T19:12:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:668.out 2023-07-21T19:12:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:669 2023-07-21T19:12:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:669.out 2023-07-21T19:12:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:670 2023-07-21T19:12:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:670.out 2023-07-21T19:12:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:671 2023-07-21T19:12:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:671.out 2023-07-21T19:12:44.333 INFO:teuthology.orchestra.run.smithi123.stdout:672 2023-07-21T19:12:44.333 INFO:teuthology.orchestra.run.smithi123.stdout:672.out 2023-07-21T19:12:44.333 INFO:teuthology.orchestra.run.smithi123.stdout:673 2023-07-21T19:12:44.333 INFO:teuthology.orchestra.run.smithi123.stdout:673.out 2023-07-21T19:12:44.333 INFO:teuthology.orchestra.run.smithi123.stdout:674 2023-07-21T19:12:44.334 INFO:teuthology.orchestra.run.smithi123.stdout:674.out 2023-07-21T19:12:44.334 INFO:teuthology.orchestra.run.smithi123.stdout:675 2023-07-21T19:12:44.334 INFO:teuthology.orchestra.run.smithi123.stdout:675.out 2023-07-21T19:12:44.334 INFO:teuthology.orchestra.run.smithi123.stdout:676 2023-07-21T19:12:44.334 INFO:teuthology.orchestra.run.smithi123.stdout:676.out 2023-07-21T19:12:44.335 INFO:teuthology.orchestra.run.smithi123.stdout:677 2023-07-21T19:12:44.335 INFO:teuthology.orchestra.run.smithi123.stdout:677.out 2023-07-21T19:12:44.335 INFO:teuthology.orchestra.run.smithi123.stdout:678 2023-07-21T19:12:44.335 INFO:teuthology.orchestra.run.smithi123.stdout:678.out 2023-07-21T19:12:44.335 INFO:teuthology.orchestra.run.smithi123.stdout:679 2023-07-21T19:12:44.335 INFO:teuthology.orchestra.run.smithi123.stdout:679.out 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:680 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:680.out 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:681 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:681.out 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:682 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:682.out 2023-07-21T19:12:44.336 INFO:teuthology.orchestra.run.smithi123.stdout:683 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:683.out 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:684 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:684.out 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:685 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:685.out 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:686 2023-07-21T19:12:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:686.out 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:687 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:687.out 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:688 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:688.out 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:689 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:689.out 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:690 2023-07-21T19:12:44.338 INFO:teuthology.orchestra.run.smithi123.stdout:690.out 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:691 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:691.out 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:692 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:692.out 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:693 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:693.out 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:694 2023-07-21T19:12:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:694.out 2023-07-21T19:12:44.340 INFO:teuthology.orchestra.run.smithi123.stdout:695 2023-07-21T19:12:44.340 INFO:teuthology.orchestra.run.smithi123.stdout:695.out 2023-07-21T19:12:44.340 INFO:teuthology.orchestra.run.smithi123.stdout:696 2023-07-21T19:12:44.340 INFO:teuthology.orchestra.run.smithi123.stdout:696.out 2023-07-21T19:12:44.341 INFO:teuthology.orchestra.run.smithi123.stdout:697 2023-07-21T19:12:44.341 INFO:teuthology.orchestra.run.smithi123.stdout:697.out 2023-07-21T19:12:44.341 INFO:teuthology.orchestra.run.smithi123.stdout:698 2023-07-21T19:12:44.341 INFO:teuthology.orchestra.run.smithi123.stdout:698.out 2023-07-21T19:12:44.341 INFO:teuthology.orchestra.run.smithi123.stdout:699 2023-07-21T19:12:44.342 INFO:teuthology.orchestra.run.smithi123.stdout:699.out 2023-07-21T19:12:44.342 INFO:teuthology.orchestra.run.smithi123.stdout:700 2023-07-21T19:12:44.342 INFO:teuthology.orchestra.run.smithi123.stdout:700.out 2023-07-21T19:12:44.342 INFO:teuthology.orchestra.run.smithi123.stdout:701 2023-07-21T19:12:44.343 INFO:teuthology.orchestra.run.smithi123.stdout:701.out 2023-07-21T19:12:44.343 INFO:teuthology.orchestra.run.smithi123.stdout:702 2023-07-21T19:12:44.343 INFO:teuthology.orchestra.run.smithi123.stdout:702.out 2023-07-21T19:12:44.343 INFO:teuthology.orchestra.run.smithi123.stdout:703 2023-07-21T19:12:44.344 INFO:teuthology.orchestra.run.smithi123.stdout:703.out 2023-07-21T19:12:44.344 INFO:teuthology.orchestra.run.smithi123.stdout:704 2023-07-21T19:12:44.344 INFO:teuthology.orchestra.run.smithi123.stdout:704.out 2023-07-21T19:12:44.344 INFO:teuthology.orchestra.run.smithi123.stdout:705 2023-07-21T19:12:44.345 INFO:teuthology.orchestra.run.smithi123.stdout:705.out 2023-07-21T19:12:44.345 INFO:teuthology.orchestra.run.smithi123.stdout:706 2023-07-21T19:12:44.345 INFO:teuthology.orchestra.run.smithi123.stdout:706.out 2023-07-21T19:12:44.345 INFO:teuthology.orchestra.run.smithi123.stdout:707 2023-07-21T19:12:44.346 INFO:teuthology.orchestra.run.smithi123.stdout:707.out 2023-07-21T19:12:44.346 INFO:teuthology.orchestra.run.smithi123.stdout:708 2023-07-21T19:12:44.346 INFO:teuthology.orchestra.run.smithi123.stdout:708.out 2023-07-21T19:12:44.346 INFO:teuthology.orchestra.run.smithi123.stdout:709 2023-07-21T19:12:44.347 INFO:teuthology.orchestra.run.smithi123.stdout:709.out 2023-07-21T19:12:44.347 INFO:teuthology.orchestra.run.smithi123.stdout:710 2023-07-21T19:12:44.347 INFO:teuthology.orchestra.run.smithi123.stdout:710.out 2023-07-21T19:12:44.348 INFO:teuthology.orchestra.run.smithi123.stdout:711 2023-07-21T19:12:44.348 INFO:teuthology.orchestra.run.smithi123.stdout:711.out 2023-07-21T19:12:44.348 INFO:teuthology.orchestra.run.smithi123.stdout:712 2023-07-21T19:12:44.348 INFO:teuthology.orchestra.run.smithi123.stdout:712.out 2023-07-21T19:12:44.349 INFO:teuthology.orchestra.run.smithi123.stdout:713 2023-07-21T19:12:44.349 INFO:teuthology.orchestra.run.smithi123.stdout:713.out 2023-07-21T19:12:44.349 INFO:teuthology.orchestra.run.smithi123.stdout:714 2023-07-21T19:12:44.349 INFO:teuthology.orchestra.run.smithi123.stdout:714.out 2023-07-21T19:12:44.350 INFO:teuthology.orchestra.run.smithi123.stdout:715 2023-07-21T19:12:44.350 INFO:teuthology.orchestra.run.smithi123.stdout:715.out 2023-07-21T19:12:44.350 INFO:teuthology.orchestra.run.smithi123.stdout:716 2023-07-21T19:12:44.350 INFO:teuthology.orchestra.run.smithi123.stdout:716.out 2023-07-21T19:12:44.351 INFO:teuthology.orchestra.run.smithi123.stdout:717 2023-07-21T19:12:44.351 INFO:teuthology.orchestra.run.smithi123.stdout:717.out 2023-07-21T19:12:44.351 INFO:teuthology.orchestra.run.smithi123.stdout:718 2023-07-21T19:12:44.352 INFO:teuthology.orchestra.run.smithi123.stdout:718.out 2023-07-21T19:12:44.352 INFO:teuthology.orchestra.run.smithi123.stdout:719 2023-07-21T19:12:44.352 INFO:teuthology.orchestra.run.smithi123.stdout:719.out 2023-07-21T19:12:44.352 INFO:teuthology.orchestra.run.smithi123.stdout:720 2023-07-21T19:12:44.353 INFO:teuthology.orchestra.run.smithi123.stdout:720.out 2023-07-21T19:12:44.353 INFO:teuthology.orchestra.run.smithi123.stdout:721 2023-07-21T19:12:44.353 INFO:teuthology.orchestra.run.smithi123.stdout:721.out 2023-07-21T19:12:44.353 INFO:teuthology.orchestra.run.smithi123.stdout:722 2023-07-21T19:12:44.353 INFO:teuthology.orchestra.run.smithi123.stdout:722.out 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:723 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:723.out 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:724 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:724.out 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:725 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:725.out 2023-07-21T19:12:44.354 INFO:teuthology.orchestra.run.smithi123.stdout:726 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:726.out 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:727 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:727.out 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:728 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:728.out 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:729 2023-07-21T19:12:44.355 INFO:teuthology.orchestra.run.smithi123.stdout:729.out 2023-07-21T19:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout:group.list 2023-07-21T19:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout:Makefile 2023-07-21T19:12:44.357 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-21T19:12:45.080 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:12:45.104 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:12:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:12:56.090 INFO:teuthology.orchestra.run.smithi123.stdout:generic/001 11s 2023-07-21T19:12:56.116 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/001 2023-07-21T19:12:56.116 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:12:56.131 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:12:56.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[46849]: fuse finished with error 0 and tester_r 0 2023-07-21T19:12:56.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:12:56.164 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-21T19:12:56.871 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:12:56.890 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:12:56.890 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:12:58.630 INFO:teuthology.orchestra.run.smithi123.stdout:generic/002 2s 2023-07-21T19:12:58.654 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/002 2023-07-21T19:12:58.655 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:12:58.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:12:58.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:12:58.699 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-21T19:12:59.407 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:12:59.428 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:12:59.428 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:00.010 INFO:teuthology.orchestra.run.smithi123.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:13:00.028 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/003 2023-07-21T19:13:00.028 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/003 2023-07-21T19:13:00.028 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:13:00.039 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:00.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:13:00.076 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-21T19:13:00.775 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:13:00.796 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:13:00.796 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:01.446 INFO:teuthology.orchestra.run.smithi123.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-21T19:13:01.467 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/004 2023-07-21T19:13:01.467 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/004 2023-07-21T19:13:01.467 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:13:01.478 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:01.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:13:01.512 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-21T19:13:02.208 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:13:02.231 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:13:02.231 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:04.336 INFO:teuthology.orchestra.run.smithi123.stdout:generic/005 2s 2023-07-21T19:13:04.361 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/005 2023-07-21T19:13:04.362 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:13:04.375 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:04.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:13:04.416 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-21T19:13:05.092 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:13:05.114 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:13:05.114 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:13:07.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:07.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:37.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:37.883 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:06.276 INFO:teuthology.orchestra.run.smithi123.stdout:generic/006 61s 2023-07-21T19:14:06.302 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/006 2023-07-21T19:14:06.303 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:14:06.315 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:14:06.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:14:06.347 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-21T19:14:07.040 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:14:07.061 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:14:07.062 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:14:07.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:07.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:43.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:43.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:13.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:13.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:43.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:43.439 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:16:13.534 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:16:13.541 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:16:43.513 INFO:teuthology.orchestra.run.smithi123.stdout:generic/007 156s 2023-07-21T19:16:43.544 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/007 2023-07-21T19:16:43.544 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:16:43.556 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:43.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:16:43.606 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:16:43.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:16:43.621 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-21T19:16:44.398 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:16:44.419 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:16:44.419 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-21T19:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/008 2023-07-21T19:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/008 2023-07-21T19:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:47.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:16:47.081 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-21T19:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:50.527 INFO:teuthology.orchestra.run.smithi123.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-21T19:16:50.549 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/009 2023-07-21T19:16:50.550 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/009 2023-07-21T19:16:50.550 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:16:50.564 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:50.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:16:50.602 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-21T19:16:51.298 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:16:51.322 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:16:51.322 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:51.863 INFO:teuthology.orchestra.run.smithi123.stdout:generic/010 [not run] /tmp/tmp.pvIJ2qKH9pxfstests-dev/src/dbtest not built 2023-07-21T19:16:51.885 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/010 2023-07-21T19:16:51.885 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/010 2023-07-21T19:16:51.885 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:16:51.897 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:16:51.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:16:51.931 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-21T19:16:52.643 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:16:52.666 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:16:52.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:17:13.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:17:13.828 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:17:44.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:17:44.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:17:48.653 INFO:teuthology.orchestra.run.smithi123.stdout:generic/011 56s 2023-07-21T19:17:48.677 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/011 2023-07-21T19:17:48.677 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:17:48.691 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:17:48.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:17:48.745 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-21T19:17:49.454 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:17:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:17:49.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:17:52.448 INFO:teuthology.orchestra.run.smithi123.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:17:52.468 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/012 2023-07-21T19:17:52.469 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/012 2023-07-21T19:17:52.469 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:17:52.482 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:17:52.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:17:52.526 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-21T19:17:53.232 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:17:53.255 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:17:53.255 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:18:14.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:18:14.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:18:46.349 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:18:46.354 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:19:23.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:19:23.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:19:47.360 INFO:teuthology.orchestra.run.smithi123.stdout:generic/013 114s 2023-07-21T19:19:47.389 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/013 2023-07-21T19:19:47.390 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:19:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:19:47.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:19:47.439 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-21T19:19:48.174 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:19:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:19:48.194 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:19:55.199 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:19:55.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:19:55.262 INFO:tasks.ceph.mds.b.smithi145.stderr:2023-07-21T19:19:55.267+0000 7f982bd4a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40629) UID: 0 2023-07-21T19:19:55.263 INFO:tasks.ceph.mds.d.smithi145.stderr:2023-07-21T19:19:55.267+0000 7fb21321d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40629) UID: 0 2023-07-21T19:23:34.966 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:23:34.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:24:07.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:24:07.339 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:24:37.496 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:24:37.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:25:01.323 INFO:teuthology.orchestra.run.smithi123.stdout:generic/014 313s 2023-07-21T19:25:01.345 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/014 2023-07-21T19:25:01.345 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:01.356 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:01.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:01.397 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-21T19:25:02.050 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:02.068 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:02.583 INFO:teuthology.orchestra.run.smithi123.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:25:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/015 2023-07-21T19:25:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/015 2023-07-21T19:25:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:02.614 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:02.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:02.650 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-21T19:25:03.315 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:03.333 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:03.333 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:06.199 INFO:teuthology.orchestra.run.smithi123.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:25:06.213 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/016 2023-07-21T19:25:06.214 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/016 2023-07-21T19:25:06.214 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:06.229 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:06.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:06.268 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-21T19:25:07.211 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:07.227 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:07.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:25:07.586 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:25:07.718 INFO:teuthology.orchestra.run.smithi123.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:25:07.734 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/017 2023-07-21T19:25:07.734 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/017 2023-07-21T19:25:07.735 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:07.747 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:07.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:07.778 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-21T19:25:08.457 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:08.474 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:08.475 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:08.943 INFO:teuthology.orchestra.run.smithi123.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:25:08.958 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/018 2023-07-21T19:25:08.958 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/018 2023-07-21T19:25:08.958 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:08.966 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:09.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:09.003 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-21T19:25:09.661 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:09.679 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:09.680 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:10.171 INFO:teuthology.orchestra.run.smithi123.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:25:10.188 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/019 2023-07-21T19:25:10.188 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/019 2023-07-21T19:25:10.188 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:10.197 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:10.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:10.235 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-21T19:25:10.894 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:10.915 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:10.915 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:29.572 INFO:teuthology.orchestra.run.smithi123.stdout:generic/020 - output mismatch (see /tmp/tmp.pvIJ2qKH9pxfstests-dev/results//generic/020.out.bad) 2023-07-21T19:25:29.584 INFO:teuthology.orchestra.run.smithi123.stdout: --- tests/generic/020.out 2023-07-21 19:09:39.038039248 +0000 2023-07-21T19:25:29.585 INFO:teuthology.orchestra.run.smithi123.stdout: +++ /tmp/tmp.pvIJ2qKH9pxfstests-dev/results//generic/020.out.bad 2023-07-21 19:25:29.576140751 +0000 2023-07-21T19:25:29.585 INFO:teuthology.orchestra.run.smithi123.stdout: @@ -47,9 +47,13 @@ 2023-07-21T19:25:29.585 INFO:teuthology.orchestra.run.smithi123.stdout: user.snrub="fish2\012" 2023-07-21T19:25:29.585 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:29.586 INFO:teuthology.orchestra.run.smithi123.stdout: *** really long value 2023-07-21T19:25:29.586 INFO:teuthology.orchestra.run.smithi123.stdout: -0000000 00 2023-07-21T19:25:29.586 INFO:teuthology.orchestra.run.smithi123.stdout: -* 2023-07-21T19:25:29.586 INFO:teuthology.orchestra.run.smithi123.stdout: -ATTRSIZE 2023-07-21T19:25:29.587 INFO:teuthology.orchestra.run.smithi123.stdout: +attr_set: No space left on device 2023-07-21T19:25:29.587 INFO:teuthology.orchestra.run.smithi123.stdout: +Could not set "long_attr" for 2023-07-21T19:25:29.587 INFO:teuthology.orchestra.run.smithi123.stdout: +attr_get: No data available 2023-07-21T19:25:29.588 INFO:teuthology.orchestra.run.smithi123.stdout: +Could not get "long_attr" for 2023-07-21T19:25:29.588 INFO:teuthology.orchestra.run.smithi123.stdout: +0000000 2023-07-21T19:25:29.588 INFO:teuthology.orchestra.run.smithi123.stdout: +attr_remove: No data available 2023-07-21T19:25:29.588 INFO:teuthology.orchestra.run.smithi123.stdout: +Could not remove "long_attr" for 2023-07-21T19:25:29.589 INFO:teuthology.orchestra.run.smithi123.stdout: *** set/get/remove really long names (expect failure) 2023-07-21T19:25:29.589 INFO:teuthology.orchestra.run.smithi123.stdout: attr_set: Invalid argument 2023-07-21T19:25:29.589 INFO:teuthology.orchestra.run.smithi123.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-07-21T19:25:29.593 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/020 2023-07-21T19:25:29.594 INFO:teuthology.orchestra.run.smithi123.stdout:Failures: generic/020 2023-07-21T19:25:29.594 INFO:teuthology.orchestra.run.smithi123.stdout:Failed 1 of 1 tests 2023-07-21T19:25:29.605 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:29.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T19:25:29.794 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-21T19:25:29.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-07-21T19:25:29.795 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-21T19:25:30.609 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:30.628 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:30.628 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:33.461 INFO:teuthology.orchestra.run.smithi123.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:25:33.476 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/021 2023-07-21T19:25:33.476 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/021 2023-07-21T19:25:33.476 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:33.488 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:33.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:33.522 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-21T19:25:34.498 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:34.519 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:34.519 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:37.424 INFO:teuthology.orchestra.run.smithi123.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:25:37.438 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/022 2023-07-21T19:25:37.439 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/022 2023-07-21T19:25:37.439 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:25:37.447 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:25:37.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:25:37.591 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-21T19:25:37.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:25:37.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:25:38.435 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:25:38.449 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:25:38.450 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:26:10.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:26:10.019 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:26:40.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:26:40.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:26:55.825 INFO:teuthology.orchestra.run.smithi123.stdout:generic/023 77s 2023-07-21T19:26:55.849 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/023 2023-07-21T19:26:55.850 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:26:55.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:26:55.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:26:55.906 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-21T19:26:56.894 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:26:56.915 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:26:56.916 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:26:57.579 INFO:teuthology.orchestra.run.smithi123.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-21T19:26:57.600 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/024 2023-07-21T19:26:57.600 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/024 2023-07-21T19:26:57.600 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:26:57.612 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:26:57.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:26:57.855 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-21T19:26:58.599 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:26:58.621 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:26:58.622 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:26:59.315 INFO:teuthology.orchestra.run.smithi123.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-21T19:26:59.336 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/025 2023-07-21T19:26:59.336 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/025 2023-07-21T19:26:59.336 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:26:59.350 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:26:59.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:26:59.452 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-21T19:27:00.323 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:00.346 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:01.074 INFO:teuthology.orchestra.run.smithi123.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-07-21T19:27:01.095 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/026 2023-07-21T19:27:01.095 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/026 2023-07-21T19:27:01.095 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:01.107 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:01.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:01.146 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-21T19:27:01.838 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:01.861 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:01.861 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:02.435 INFO:teuthology.orchestra.run.smithi123.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:02.454 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/027 2023-07-21T19:27:02.454 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/027 2023-07-21T19:27:02.454 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:02.468 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:02.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:02.503 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-21T19:27:03.226 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:03.248 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:03.249 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:08.884 INFO:teuthology.orchestra.run.smithi123.stdout:generic/028 5s 2023-07-21T19:27:08.912 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/028 2023-07-21T19:27:08.912 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:08.927 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:08.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:08.959 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-21T19:27:09.650 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:09.671 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:09.671 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:10.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:27:10.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:27:10.252 INFO:teuthology.orchestra.run.smithi123.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:10.267 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/029 2023-07-21T19:27:10.267 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/029 2023-07-21T19:27:10.267 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:10.276 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:10.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:10.302 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-21T19:27:11.066 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:11.088 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:11.089 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:11.682 INFO:teuthology.orchestra.run.smithi123.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:11.700 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/030 2023-07-21T19:27:11.701 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/030 2023-07-21T19:27:11.701 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:11.715 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:11.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:11.749 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-21T19:27:12.452 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:12.474 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:12.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:13.061 INFO:teuthology.orchestra.run.smithi123.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:13.082 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/031 2023-07-21T19:27:13.083 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/031 2023-07-21T19:27:13.083 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:13.096 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:13.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:13.136 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-21T19:27:13.819 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:13.840 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:13.841 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:14.431 INFO:teuthology.orchestra.run.smithi123.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:14.450 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/032 2023-07-21T19:27:14.451 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/032 2023-07-21T19:27:14.451 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:14.463 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:14.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:14.498 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-21T19:27:15.219 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:15.242 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:15.242 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:15.814 INFO:teuthology.orchestra.run.smithi123.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:15.833 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/033 2023-07-21T19:27:15.834 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/033 2023-07-21T19:27:15.834 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:15.848 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:15.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:15.881 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-21T19:27:16.577 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:16.600 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:16.600 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:17.219 INFO:teuthology.orchestra.run.smithi123.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:17.238 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/034 2023-07-21T19:27:17.238 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/034 2023-07-21T19:27:17.239 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:17.252 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:17.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:17.291 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-21T19:27:17.975 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:17.999 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:18.000 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:18.766 INFO:teuthology.orchestra.run.smithi123.stdout:generic/035 0s 2023-07-21T19:27:19.286 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/035 2023-07-21T19:27:19.286 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:19.299 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:19.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:19.401 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-21T19:27:20.281 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:20.304 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:20.304 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:31.173 INFO:teuthology.orchestra.run.smithi123.stdout:generic/036 11s 2023-07-21T19:27:31.200 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/036 2023-07-21T19:27:31.200 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:31.211 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:31.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:31.318 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-21T19:27:32.269 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:32.294 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:32.294 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:32.890 INFO:teuthology.orchestra.run.smithi123.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:32.910 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/037 2023-07-21T19:27:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/037 2023-07-21T19:27:32.911 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:32.924 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:32.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:32.958 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-21T19:27:33.659 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:33.683 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:33.684 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:34.274 INFO:teuthology.orchestra.run.smithi123.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:34.294 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/038 2023-07-21T19:27:34.294 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/038 2023-07-21T19:27:34.294 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:34.306 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:34.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:34.344 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-21T19:27:35.060 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:35.083 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:35.084 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:35.726 INFO:teuthology.orchestra.run.smithi123.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:35.747 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/039 2023-07-21T19:27:35.747 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/039 2023-07-21T19:27:35.747 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:35.760 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:35.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:35.799 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-21T19:27:36.500 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:36.519 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:36.519 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:37.131 INFO:teuthology.orchestra.run.smithi123.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:37.152 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/040 2023-07-21T19:27:37.152 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/040 2023-07-21T19:27:37.152 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:37.164 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:37.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:37.201 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-21T19:27:37.909 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:37.933 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:37.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:38.590 INFO:teuthology.orchestra.run.smithi123.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:38.609 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/041 2023-07-21T19:27:38.610 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/041 2023-07-21T19:27:38.610 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:38.624 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:38.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:38.662 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-21T19:27:39.363 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:39.384 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:39.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:39.977 INFO:teuthology.orchestra.run.smithi123.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:39.996 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/042 2023-07-21T19:27:39.996 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/042 2023-07-21T19:27:39.996 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:40.011 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:40.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:40.044 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-21T19:27:40.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:27:40.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:27:40.736 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:40.757 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:40.758 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:41.347 INFO:teuthology.orchestra.run.smithi123.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:41.368 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/043 2023-07-21T19:27:41.368 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/043 2023-07-21T19:27:41.369 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:41.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:41.417 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-21T19:27:42.107 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:42.129 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:42.129 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:42.709 INFO:teuthology.orchestra.run.smithi123.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:42.727 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/044 2023-07-21T19:27:42.727 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/044 2023-07-21T19:27:42.728 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:42.739 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:42.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:42.772 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-21T19:27:43.473 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:43.496 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:43.496 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:44.097 INFO:teuthology.orchestra.run.smithi123.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:44.118 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/045 2023-07-21T19:27:44.119 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/045 2023-07-21T19:27:44.119 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:44.134 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:44.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:44.166 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-21T19:27:44.841 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:44.863 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:45.430 INFO:teuthology.orchestra.run.smithi123.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:45.448 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/046 2023-07-21T19:27:45.448 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/046 2023-07-21T19:27:45.448 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:45.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:45.495 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-21T19:27:46.209 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:46.230 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:46.819 INFO:teuthology.orchestra.run.smithi123.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:46.839 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/047 2023-07-21T19:27:46.840 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/047 2023-07-21T19:27:46.840 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:46.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:46.888 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-21T19:27:47.580 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:47.602 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:48.197 INFO:teuthology.orchestra.run.smithi123.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:48.218 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/048 2023-07-21T19:27:48.219 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/048 2023-07-21T19:27:48.219 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:48.232 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:48.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:48.269 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-21T19:27:48.963 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:48.985 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:48.985 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:49.574 INFO:teuthology.orchestra.run.smithi123.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:49.593 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/049 2023-07-21T19:27:49.594 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/049 2023-07-21T19:27:49.594 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:49.607 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:49.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:49.640 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-21T19:27:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:50.337 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:50.338 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:50.969 INFO:teuthology.orchestra.run.smithi123.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:50.986 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/050 2023-07-21T19:27:50.986 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/050 2023-07-21T19:27:50.986 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:50.998 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:51.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:51.026 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-21T19:27:51.735 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:51.757 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:51.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:52.336 INFO:teuthology.orchestra.run.smithi123.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:52.355 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/051 2023-07-21T19:27:52.356 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/051 2023-07-21T19:27:52.356 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:52.367 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:52.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:52.403 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-21T19:27:53.101 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:53.122 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:53.122 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:53.730 INFO:teuthology.orchestra.run.smithi123.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:53.745 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/052 2023-07-21T19:27:53.745 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/052 2023-07-21T19:27:53.745 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:53.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:53.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:53.789 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-21T19:27:54.478 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:54.501 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:54.501 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:55.097 INFO:teuthology.orchestra.run.smithi123.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:55.116 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/053 2023-07-21T19:27:55.116 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/053 2023-07-21T19:27:55.116 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:55.130 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:55.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:55.165 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-21T19:27:55.860 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:55.883 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:55.883 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:56.490 INFO:teuthology.orchestra.run.smithi123.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:56.508 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/054 2023-07-21T19:27:56.508 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/054 2023-07-21T19:27:56.509 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:56.520 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:56.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:56.553 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-21T19:27:57.260 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:57.284 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:57.284 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:57.891 INFO:teuthology.orchestra.run.smithi123.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:57.910 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/055 2023-07-21T19:27:57.911 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/055 2023-07-21T19:27:57.911 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:57.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:57.960 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-21T19:27:58.664 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:27:58.687 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:27:58.688 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:59.361 INFO:teuthology.orchestra.run.smithi123.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:27:59.381 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/056 2023-07-21T19:27:59.381 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/056 2023-07-21T19:27:59.381 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:27:59.395 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:27:59.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:27:59.428 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-21T19:28:00.148 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:00.170 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:00.170 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:00.790 INFO:teuthology.orchestra.run.smithi123.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/057 2023-07-21T19:28:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/057 2023-07-21T19:28:00.807 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:00.819 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:00.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:00.853 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-21T19:28:01.550 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:01.573 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:04.448 INFO:teuthology.orchestra.run.smithi123.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:28:04.466 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/058 2023-07-21T19:28:04.466 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/058 2023-07-21T19:28:04.467 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:04.479 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:04.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:04.529 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-21T19:28:05.491 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:05.510 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:05.510 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:06.126 INFO:teuthology.orchestra.run.smithi123.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:06.146 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/059 2023-07-21T19:28:06.146 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/059 2023-07-21T19:28:06.147 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:06.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:06.193 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-21T19:28:06.882 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:06.904 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:06.904 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:09.613 INFO:teuthology.orchestra.run.smithi123.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:28:09.633 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/060 2023-07-21T19:28:09.634 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/060 2023-07-21T19:28:09.634 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:09.646 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:09.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:09.690 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-21T19:28:10.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:28:10.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:28:10.584 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:10.604 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:10.604 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:13.216 INFO:teuthology.orchestra.run.smithi123.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:28:13.234 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/061 2023-07-21T19:28:13.235 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/061 2023-07-21T19:28:13.235 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:13.246 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:13.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:13.299 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-21T19:28:14.265 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:14.286 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:14.286 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:14.881 INFO:teuthology.orchestra.run.smithi123.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:14.897 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/062 2023-07-21T19:28:14.897 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/062 2023-07-21T19:28:14.897 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:14.909 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:14.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:14.948 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-21T19:28:15.647 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:15.666 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:15.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:18.270 INFO:teuthology.orchestra.run.smithi123.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-21T19:28:18.289 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/063 2023-07-21T19:28:18.290 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/063 2023-07-21T19:28:18.290 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:18.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:18.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:18.339 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-21T19:28:19.377 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:19.400 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:19.401 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:19.999 INFO:teuthology.orchestra.run.smithi123.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:20.017 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/064 2023-07-21T19:28:20.018 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/064 2023-07-21T19:28:20.018 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:20.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:20.067 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-21T19:28:20.764 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:20.786 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:20.787 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:21.411 INFO:teuthology.orchestra.run.smithi123.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:21.431 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/065 2023-07-21T19:28:21.432 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/065 2023-07-21T19:28:21.432 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:21.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:21.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:21.479 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-21T19:28:22.207 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:22.229 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:22.230 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:22.867 INFO:teuthology.orchestra.run.smithi123.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:22.885 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/066 2023-07-21T19:28:22.885 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/066 2023-07-21T19:28:22.886 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:22.899 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:22.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:22.939 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-21T19:28:23.641 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:23.665 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:23.665 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:24.342 INFO:teuthology.orchestra.run.smithi123.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:24.361 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/067 2023-07-21T19:28:24.361 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/067 2023-07-21T19:28:24.362 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:24.376 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:24.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:24.414 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-21T19:28:25.121 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:25.142 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:25.142 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:25.758 INFO:teuthology.orchestra.run.smithi123.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:25.779 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/068 2023-07-21T19:28:25.779 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/068 2023-07-21T19:28:25.780 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:25.794 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:25.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:25.824 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-21T19:28:26.516 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:26.538 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:26.539 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:27.136 INFO:teuthology.orchestra.run.smithi123.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:28:27.154 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/069 2023-07-21T19:28:27.155 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/069 2023-07-21T19:28:27.155 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:28:27.167 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:27.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:28:27.204 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-21T19:28:27.902 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:28:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:28:27.921 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:28:40.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:28:40.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:29:10.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:29:10.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:29:40.874 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:29:40.880 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:30:11.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:30:11.842 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:30:23.068 INFO:teuthology.orchestra.run.smithi123.stdout:generic/070 116s 2023-07-21T19:30:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/070 2023-07-21T19:30:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:30:23.107 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:23.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:30:23.147 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-21T19:30:24.095 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:30:24.115 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:30:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:24.603 INFO:teuthology.orchestra.run.smithi123.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:30:24.618 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/071 2023-07-21T19:30:24.618 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/071 2023-07-21T19:30:24.618 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:30:24.626 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:24.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:30:24.664 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-21T19:30:25.282 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:30:25.303 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:30:25.303 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:27.899 INFO:teuthology.orchestra.run.smithi123.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-21T19:30:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/072 2023-07-21T19:30:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/072 2023-07-21T19:30:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:30:27.929 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:27.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:30:27.966 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-21T19:30:28.583 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:30:28.601 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:30:28.602 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:29.098 INFO:teuthology.orchestra.run.smithi123.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T19:30:29.111 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/073 2023-07-21T19:30:29.112 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/073 2023-07-21T19:30:29.112 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T19:30:29.124 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:29.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T19:30:29.155 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-21T19:30:29.804 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T19:30:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T19:30:29.820 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T19:30:41.989 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:30:41.995 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:31:12.155 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:31:12.160 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:31:49.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:31:49.867 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:32:20.011 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:32:20.016 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:32:50.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:32:50.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:33:20.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:33:20.286 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:33:50.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:33:50.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:34:20.606 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:34:20.615 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:34:50.761 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:34:50.765 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:35:26.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:35:26.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:35:58.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:35:58.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:35:58.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:35:58.477+0000 7f5bae2ab700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-07-21T19:35:58.465 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:35:58.477+0000 7f9086bf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-07-21T19:35:58.466 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:35:58.477+0000 7f05fc9aa700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-07-21T19:35:58.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:35:58.477+0000 7f1a5f11b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-07-21T19:41:55.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:41:55.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:41:55.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:41:55.113+0000 7f1a5f11b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123011) UID: 0 2023-07-21T19:41:55.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:41:55.113+0000 7f5bae2ab700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123011) UID: 0 2023-07-21T19:41:55.098 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:41:55.113+0000 7f9086bf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123011) UID: 0 2023-07-21T19:41:55.101 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:41:55.113+0000 7f05fc9aa700 -1 received signal: Hangup from (PID: 123011) UID: 0 2023-07-21T19:41:55.196 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:41:55.211+0000 7f8603fa6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40782) UID: 0 2023-07-21T19:41:55.196 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:41:55.211+0000 7f1819bb8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40782) UID: 0 2023-07-21T19:41:55.197 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:41:55.211+0000 7f658800e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40782) UID: 0 2023-07-21T19:41:55.197 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:41:55.211+0000 7fbbd89c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40782) UID: 0 2023-07-21T19:47:34.813 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:47:34.819 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:47:34.857 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:47:34.855+0000 7f1819bb8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40813) UID: 0 2023-07-21T19:47:34.858 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:47:34.855+0000 7f8603fa6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40813) UID: 0 2023-07-21T19:47:34.858 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:47:34.855+0000 7f658800e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40813) UID: 0 2023-07-21T19:47:34.859 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:47:34.855+0000 7fbbd89c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40813) UID: 0 2023-07-21T19:47:34.952 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:47:34.946+0000 7f9086bf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126437) UID: 0 2023-07-21T19:47:34.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:47:34.946+0000 7f1a5f11b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126437) UID: 0 2023-07-21T19:47:34.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:47:34.946+0000 7f5bae2ab700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126437) UID: 0 2023-07-21T19:47:34.968 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:47:34.966+0000 7f05fc9aa700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126437) UID: 0 2023-07-21T19:53:47.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:53:47.717 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:53:47.811 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T19:53:47.787+0000 7f1819bb8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40843) UID: 0 2023-07-21T19:53:47.812 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T19:53:47.787+0000 7f8603fa6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40843) UID: 0 2023-07-21T19:53:47.812 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T19:53:47.787+0000 7f658800e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40843) UID: 0 2023-07-21T19:53:47.812 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T19:53:47.787+0000 7fbbd89c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40843) UID: 0 2023-07-21T19:53:47.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T19:53:47.801+0000 7f5bae2ab700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129940) UID: 0 2023-07-21T19:53:47.825 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T19:53:47.801+0000 7f05fc9aa700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129940) UID: 0 2023-07-21T19:53:47.825 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T19:53:47.801+0000 7f9086bf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129940) UID: 0 2023-07-21T19:53:47.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T19:53:47.801+0000 7f1a5f11b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129940) UID: 0 2023-07-21T20:01:07.216 INFO:teuthology.orchestra.run.smithi123.stdout:generic/074 1838s 2023-07-21T20:01:07.450 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/074 2023-07-21T20:01:07.451 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:01:07.466 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:01:07.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:01:07.496 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-21T20:01:09.297 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:01:09.315 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:01:09.315 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:20.738 INFO:teuthology.orchestra.run.smithi123.stdout:generic/075 71s 2023-07-21T20:02:20.757 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/075 2023-07-21T20:02:20.757 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:20.768 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:20.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:20.883 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-21T20:02:21.747 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:21.766 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:21.766 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:22.316 INFO:teuthology.orchestra.run.smithi123.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:22.334 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/076 2023-07-21T20:02:22.335 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/076 2023-07-21T20:02:22.335 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:22.347 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:22.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:22.378 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-21T20:02:23.006 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:23.027 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:23.027 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:25.687 INFO:teuthology.orchestra.run.smithi123.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:25.708 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/077 2023-07-21T20:02:25.709 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/077 2023-07-21T20:02:25.709 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:25.717 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:25.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:25.748 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-21T20:02:26.379 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:26.399 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:26.400 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:26.991 INFO:teuthology.orchestra.run.smithi123.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-21T20:02:27.009 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/078 2023-07-21T20:02:27.010 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/078 2023-07-21T20:02:27.010 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:27.020 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:27.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:27.112 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-21T20:02:28.048 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:28.069 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:28.069 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:28.697 INFO:teuthology.orchestra.run.smithi123.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-21T20:02:28.714 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/079 2023-07-21T20:02:28.715 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/079 2023-07-21T20:02:28.715 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:28.730 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:28.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:28.758 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-21T20:02:29.402 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:29.422 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:29.423 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:32.143 INFO:teuthology.orchestra.run.smithi123.stdout:generic/080 3s 2023-07-21T20:02:32.167 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/080 2023-07-21T20:02:32.167 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:32.178 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:32.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:32.209 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-21T20:02:32.824 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:32.843 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:32.843 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:33.387 INFO:teuthology.orchestra.run.smithi123.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:33.405 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/081 2023-07-21T20:02:33.406 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/081 2023-07-21T20:02:33.406 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:33.415 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:33.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:33.446 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-21T20:02:34.079 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:34.099 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:34.099 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:34.673 INFO:teuthology.orchestra.run.smithi123.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:34.691 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/082 2023-07-21T20:02:34.692 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/082 2023-07-21T20:02:34.692 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:34.703 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:34.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:34.733 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-21T20:02:35.363 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:35.383 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:35.383 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:35.923 INFO:teuthology.orchestra.run.smithi123.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:35.940 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/083 2023-07-21T20:02:35.941 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/083 2023-07-21T20:02:35.941 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:35.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:35.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:35.990 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-21T20:02:36.603 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:36.625 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:36.626 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:37.180 INFO:teuthology.orchestra.run.smithi123.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:37.199 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/084 2023-07-21T20:02:37.199 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/084 2023-07-21T20:02:37.199 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:37.210 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:37.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:37.242 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-21T20:02:37.872 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:37.891 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:37.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:38.559 INFO:teuthology.orchestra.run.smithi123.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-07-21T20:02:38.574 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/085 2023-07-21T20:02:38.574 INFO:teuthology.orchestra.run.smithi123.stdout:Not run: generic/085 2023-07-21T20:02:38.574 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:02:38.585 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:02:38.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:02:38.616 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-21T20:02:39.256 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:02:39.275 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:02:39.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:01.543 INFO:teuthology.orchestra.run.smithi123.stdout:generic/086 22s 2023-07-21T20:03:01.826 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/086 2023-07-21T20:03:01.827 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:03:01.837 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:01.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:03:01.979 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-21T20:03:06.128 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:03:06.148 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:03:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:07.287 INFO:teuthology.orchestra.run.smithi123.stdout:generic/087 1s 2023-07-21T20:03:07.310 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/087 2023-07-21T20:03:07.310 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:03:07.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:07.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:03:07.354 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-21T20:03:08.351 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:03:08.371 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:03:08.371 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:09.030 INFO:teuthology.orchestra.run.smithi123.stdout:generic/088 0s 2023-07-21T20:03:09.055 INFO:teuthology.orchestra.run.smithi123.stdout:Ran: generic/088 2023-07-21T20:03:09.055 INFO:teuthology.orchestra.run.smithi123.stdout:Passed all 1 tests 2023-07-21T20:03:09.066 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:09.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-21T20:03:09.128 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/tmp.pvIJ2qKH9pxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-21T20:03:10.090 INFO:teuthology.orchestra.run.smithi123.stdout:FSTYP -- ceph-fuse 2023-07-21T20:03:10.110 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM -- Linux/x86_64 smithi123 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-21T20:03:10.111 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T20:03:53.604 INFO:tasks.ceph.mds.d.smithi145.stderr:/build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb20ba0e700 time 2023-07-21T20:03:53.564501+0000 2023-07-21T20:03:53.605 INFO:tasks.ceph.mds.d.smithi145.stderr:/build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-21T20:03:53.709 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.710 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7fb217d2026d] 2023-07-21T20:03:53.710 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.710 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.710 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.710 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.711 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: clone() 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr:*** Caught signal (Aborted) ** 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr: in thread 7fb20ba0e700 thread_name:MR_Finisher 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr:2023-07-21T20:03:53.664+0000 7fb20ba0e700 -1 /build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb20ba0e700 time 2023-07-21T20:03:53.564501+0000 2023-07-21T20:03:53.712 INFO:tasks.ceph.mds.d.smithi145.stderr:/build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7fb217d2026d] 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.713 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.714 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.715 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.715 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: clone() 2023-07-21T20:03:53.715 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.728 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.728 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb21886f420] 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: gsignal() 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: abort() 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7fb217d202c7] 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.729 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.730 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.731 INFO:tasks.ceph.mds.d.smithi145.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.731 INFO:tasks.ceph.mds.d.smithi145.stderr: 17: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.731 INFO:tasks.ceph.mds.d.smithi145.stderr: 18: clone() 2023-07-21T20:03:53.731 INFO:tasks.ceph.mds.d.smithi145.stderr:2023-07-21T20:03:53.684+0000 7fb20ba0e700 -1 *** Caught signal (Aborted) ** 2023-07-21T20:03:53.732 INFO:tasks.ceph.mds.d.smithi145.stderr: in thread 7fb20ba0e700 thread_name:MR_Finisher 2023-07-21T20:03:53.732 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.732 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.732 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb21886f420] 2023-07-21T20:03:53.732 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: gsignal() 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: abort() 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7fb217d202c7] 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.733 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.734 INFO:tasks.ceph.mds.d.smithi145.stderr: 17: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.735 INFO:tasks.ceph.mds.d.smithi145.stderr: 18: clone() 2023-07-21T20:03:53.735 INFO:tasks.ceph.mds.d.smithi145.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T20:03:53.735 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.758 INFO:tasks.ceph.mds.d.smithi145.stderr: -1> 2023-07-21T20:03:53.664+0000 7fb20ba0e700 -1 /build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb20ba0e700 time 2023-07-21T20:03:53.564501+0000 2023-07-21T20:03:53.759 INFO:tasks.ceph.mds.d.smithi145.stderr:/build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-21T20:03:53.759 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.760 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.760 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7fb217d2026d] 2023-07-21T20:03:53.760 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.760 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.761 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.761 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.761 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.762 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.762 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.762 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.762 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.763 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.763 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.763 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.763 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.764 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: clone() 2023-07-21T20:03:53.764 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.764 INFO:tasks.ceph.mds.d.smithi145.stderr: 0> 2023-07-21T20:03:53.684+0000 7fb20ba0e700 -1 *** Caught signal (Aborted) ** 2023-07-21T20:03:53.765 INFO:tasks.ceph.mds.d.smithi145.stderr: in thread 7fb20ba0e700 thread_name:MR_Finisher 2023-07-21T20:03:53.765 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.765 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.765 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb21886f420] 2023-07-21T20:03:53.765 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: gsignal() 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: abort() 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7fb217d202c7] 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.766 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.767 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.767 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.767 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.767 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: 17: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: 18: clone() 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T20:03:53.768 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.772 INFO:tasks.ceph.mds.d.smithi145.stderr: -1> 2023-07-21T20:03:53.664+0000 7fb20ba0e700 -1 /build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb20ba0e700 time 2023-07-21T20:03:53.564501+0000 2023-07-21T20:03:53.772 INFO:tasks.ceph.mds.d.smithi145.stderr:/build/ceph-18.0.0-4746-g81cf785a/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7fb217d2026d] 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.773 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.774 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.774 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.774 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.774 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.774 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.774 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.775 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.775 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.775 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.775 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: clone() 2023-07-21T20:03:53.775 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.775 INFO:tasks.ceph.mds.d.smithi145.stderr: 0> 2023-07-21T20:03:53.684+0000 7fb20ba0e700 -1 *** Caught signal (Aborted) ** 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: in thread 7fb20ba0e700 thread_name:MR_Finisher 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: ceph version 18.0.0-4746-g81cf785a (81cf785aa7781c4e08381c540f890cb9bc987ef9) reef (dev) 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb21886f420] 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: 2: gsignal() 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: 3: abort() 2023-07-21T20:03:53.776 INFO:tasks.ceph.mds.d.smithi145.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7fb217d202c7] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x320429) [0x7fb217d20429] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564a10ac9952] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564a10ab34ec] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x564a10ab3d50] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564a10ab47af] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x564a1091f60d] 2023-07-21T20:03:53.777 INFO:tasks.ceph.mds.d.smithi145.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564a10920450] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2e1) [0x564a1093d971] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 13: (MDSContext::complete(int)+0x5f) [0x564a10bf435f] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 14: (MDSIOContextBase::complete(int)+0x514) [0x564a10bf4ac4] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x564a10bf4e5b] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7fb217dc6e9d] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 17: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb218863609] 2023-07-21T20:03:53.778 INFO:tasks.ceph.mds.d.smithi145.stderr: 18: clone() 2023-07-21T20:03:53.779 INFO:tasks.ceph.mds.d.smithi145.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T20:03:53.779 INFO:tasks.ceph.mds.d.smithi145.stderr: 2023-07-21T20:03:55.596 INFO:tasks.ceph.mds.d.smithi145.stderr:daemon-helper: command crashed with signal 6 2023-07-21T20:04:00.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-21T20:04:07.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-07-21T20:04:11.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:04:11.122 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:04:11.202 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T20:04:11.159+0000 7f05fc9aa700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140992) UID: 0 2023-07-21T20:04:11.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T20:04:11.159+0000 7f1a5f11b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140992) UID: 0 2023-07-21T20:04:11.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T20:04:11.159+0000 7f5bae2ab700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140992) UID: 0 2023-07-21T20:04:11.203 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T20:04:11.159+0000 7f9086bf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140992) UID: 0 2023-07-21T20:04:14.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-07-21T20:04:20.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-07-21T20:04:26.153 INFO:tasks.ceph.mds.c.smithi123.stderr:2023-07-21T20:04:26.107+0000 7f7727e05700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T20:04:27.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2023-07-21T20:04:34.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~33s 2023-07-21T20:04:40.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2023-07-21T20:04:47.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-07-21T20:04:53.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~53s 2023-07-21T20:05:00.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~59s 2023-07-21T20:05:07.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~66s 2023-07-21T20:05:13.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~73s 2023-07-21T20:05:20.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~79s 2023-07-21T20:05:26.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~86s 2023-07-21T20:05:33.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~93s 2023-07-21T20:05:40.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~99s 2023-07-21T20:05:46.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~106s 2023-07-21T20:05:53.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~112s 2023-07-21T20:05:59.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~119s 2023-07-21T20:06:06.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~126s 2023-07-21T20:06:13.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~132s 2023-07-21T20:06:19.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~139s 2023-07-21T20:06:26.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~145s 2023-07-21T20:06:33.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~152s 2023-07-21T20:06:39.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~159s 2023-07-21T20:06:46.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2023-07-21T20:06:52.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2023-07-21T20:06:59.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~178s 2023-07-21T20:06:59.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:06:59.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:07:06.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2023-07-21T20:07:12.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-07-21T20:07:19.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~198s 2023-07-21T20:07:25.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~205s 2023-07-21T20:07:29.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:07:29.936 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:07:32.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~212s 2023-07-21T20:07:39.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~218s 2023-07-21T20:07:45.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~225s 2023-07-21T20:07:52.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~231s 2023-07-21T20:07:58.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~238s 2023-07-21T20:08:00.067 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:08:00.073 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:08:05.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~245s 2023-07-21T20:08:12.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~251s 2023-07-21T20:08:18.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~258s 2023-07-21T20:08:25.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~264s 2023-07-21T20:08:30.169 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:08:30.175 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:08:32.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~271s 2023-07-21T20:08:38.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~278s 2023-07-21T20:08:45.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~284s 2023-07-21T20:08:51.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~291s 2023-07-21T20:08:58.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~297s 2023-07-21T20:09:00.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:09:00.259 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:09:05.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~304s 2023-07-21T20:09:05.068 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-21T20:09:05.068 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T20:09:05.069 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T20:09:05.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18492 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.845xdYTdCWtest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-07-21T20:09:05.103 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi123.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-07-21T20:09:05.103 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T20:09:05.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T20:09:05.104 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T20:09:05.200 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-21T20:09:05.200 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T20:09:05.211 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352340k,nr_inodes=4088085,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18492 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.845xdYTdCWtest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-07-21T20:09:05.211 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi123.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-07-21T20:09:05.211 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T20:09:05.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T20:09:05.212 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-21T20:09:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-21T20:09:05.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T20:09:05.277 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T20:09:05.278 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T20:09:05.379 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352300k,nr_inodes=4088075,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T20:09:05.380 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi145.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-07-21T20:09:05.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T20:09:05.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T20:09:05.380 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T20:09:05.469 INFO:teuthology.orchestra.run.smithi145.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-21T20:09:05.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T20:09:05.471 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-07-21T20:09:05.471 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T20:09:05.488 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352300k,nr_inodes=4088075,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T20:09:05.488 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi145.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-07-21T20:09:05.489 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T20:09:05.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T20:09:05.489 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-21T20:09:05.554 INFO:teuthology.orchestra.run.smithi145.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-21T20:09:05.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T20:09:07.163 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-21T20:09:07.163 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-21T20:09:07.164 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-21T20:09:07.164 INFO:tasks.ceph.osd.3:Sent signal 15 2023-07-21T20:09:07.164 INFO:tasks.ceph.osd.4:Sent signal 15 2023-07-21T20:09:07.165 INFO:tasks.ceph.osd.5:Sent signal 15 2023-07-21T20:09:07.165 INFO:tasks.ceph.osd.6:Sent signal 15 2023-07-21T20:09:07.165 INFO:tasks.ceph.osd.7:Sent signal 15 2023-07-21T20:09:07.166 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-21T20:09:07.166 INFO:tasks.ceph.mds.c:Sent signal 15 2023-07-21T20:09:07.166 INFO:tasks.ceph.mds.b:Sent signal 15 2023-07-21T20:09:07.166 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-21T20:09:07.167 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-21T20:09:07.167 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-21T20:09:07.167 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-21T20:09:07.167 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-21T20:09:07.168 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f1819bb8700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 35122) UID: 0 2023-07-21T20:09:07.168 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f1819bb8700 -1 osd.4 46 *** Got signal Terminated *** 2023-07-21T20:09:07.168 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f1819bb8700 -1 osd.4 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.169 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f658800e700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 35125) UID: 0 2023-07-21T20:09:07.169 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f658800e700 -1 osd.5 46 *** Got signal Terminated *** 2023-07-21T20:09:07.169 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f658800e700 -1 osd.5 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.169 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f8603fa6700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 35124) UID: 0 2023-07-21T20:09:07.169 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f8603fa6700 -1 osd.6 46 *** Got signal Terminated *** 2023-07-21T20:09:07.170 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f8603fa6700 -1 osd.6 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.170 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T20:09:07.117+0000 7fbbd89c4700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35128) UID: 0 2023-07-21T20:09:07.170 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T20:09:07.117+0000 7fbbd89c4700 -1 osd.7 46 *** Got signal Terminated *** 2023-07-21T20:09:07.170 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-07-21T20:09:07.117+0000 7fbbd89c4700 -1 osd.7 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.171 INFO:tasks.ceph.mds.b.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f982bd4a700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 40490) UID: 0 2023-07-21T20:09:07.171 INFO:tasks.ceph.mds.b.smithi145.stderr:2023-07-21T20:09:07.117+0000 7f982bd4a700 -1 mds.b *** got signal Terminated *** 2023-07-21T20:09:07.171 INFO:tasks.ceph.mon.b.smithi145.stderr:2023-07-21T20:09:07.117+0000 7fcfcf3ff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 34787) UID: 0 2023-07-21T20:09:07.171 INFO:tasks.ceph.mon.b.smithi145.stderr:2023-07-21T20:09:07.117+0000 7fcfcf3ff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-21T20:09:07.172 INFO:tasks.ceph.mon.c.smithi145.stderr:2023-07-21T20:09:07.121+0000 7f28ccbff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 34789) UID: 0 2023-07-21T20:09:07.172 INFO:tasks.ceph.mon.c.smithi145.stderr:2023-07-21T20:09:07.121+0000 7f28ccbff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-21T20:09:07.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f1a5f11b700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 34934) UID: 0 2023-07-21T20:09:07.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f1a5f11b700 -1 osd.0 46 *** Got signal Terminated *** 2023-07-21T20:09:07.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f1a5f11b700 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f5bae2ab700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 34936) UID: 0 2023-07-21T20:09:07.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f5bae2ab700 -1 osd.1 46 *** Got signal Terminated *** 2023-07-21T20:09:07.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f5bae2ab700 -1 osd.1 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.173 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f9086bf1700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 34940) UID: 0 2023-07-21T20:09:07.174 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f9086bf1700 -1 osd.2 46 *** Got signal Terminated *** 2023-07-21T20:09:07.174 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f9086bf1700 -1 osd.2 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.174 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f05fc9aa700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 34937) UID: 0 2023-07-21T20:09:07.174 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f05fc9aa700 -1 osd.3 46 *** Got signal Terminated *** 2023-07-21T20:09:07.174 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-07-21T20:09:07.117+0000 7f05fc9aa700 -1 osd.3 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T20:09:07.175 INFO:tasks.ceph.mds.a.smithi123.stderr:2023-07-21T20:09:07.121+0000 7fac449de700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 46018) UID: 0 2023-07-21T20:09:07.175 INFO:tasks.ceph.mds.a.smithi123.stderr:2023-07-21T20:09:07.121+0000 7fac449de700 -1 mds.a *** got signal Terminated *** 2023-07-21T20:09:07.175 INFO:tasks.ceph.mds.c.smithi123.stderr:2023-07-21T20:09:07.121+0000 7f772be0d700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 46015) UID: 0 2023-07-21T20:09:07.175 INFO:tasks.ceph.mds.c.smithi123.stderr:2023-07-21T20:09:07.121+0000 7f772be0d700 -1 mds.c *** got signal Terminated *** 2023-07-21T20:09:07.176 INFO:tasks.ceph.mon.a.smithi123.stderr:2023-07-21T20:09:07.121+0000 7fd144fff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 34810) UID: 0 2023-07-21T20:09:07.176 INFO:tasks.ceph.mon.a.smithi123.stderr:2023-07-21T20:09:07.121+0000 7fd144fff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-21T20:09:07.176 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T20:09:07.121+0000 7f21671a2700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 34815) UID: 0 2023-07-21T20:09:07.176 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-07-21T20:09:07.121+0000 7f21671a2700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-21T20:09:07.370 INFO:tasks.ceph.mgr.x.smithi145.stderr:daemon-helper: command crashed with signal 15 2023-07-21T20:09:30.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:09:30.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:10:00.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:10:00.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:10:30.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:10:30.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:11:00.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:11:00.961 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:11:31.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:11:31.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:12:01.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:12:01.233 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:12:31.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:12:31.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:13:01.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:13:01.502 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:13:31.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:13:31.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:14:01.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:14:01.724 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:14:31.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:14:31.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:15:02.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:15:02.010 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:15:32.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:15:32.096 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:16:02.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:16:02.251 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:16:32.397 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:16:32.404 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:17:02.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:17:02.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:17:32.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:17:32.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:18:02.723 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:18:02.731 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:18:32.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:18:32.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:19:03.031 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:19:03.039 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:19:33.201 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:19:33.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:20:03.332 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:20:03.340 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:20:33.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:20:33.506 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:21:03.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:21:03.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:21:33.786 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:21:33.794 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:22:04.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:22:04.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:22:34.283 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:22:34.291 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:23:04.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:23:04.452 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:23:34.588 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:23:34.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:24:04.734 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:24:04.741 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:24:34.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:24:34.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:25:05.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:25:05.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:25:35.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:25:35.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:26:05.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:26:05.279 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:26:35.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:26:35.441 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:27:05.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:27:05.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:27:35.748 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:27:35.755 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:28:05.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:28:05.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:28:36.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:28:36.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:29:06.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:29:06.190 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:29:36.326 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:29:36.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:30:06.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:30:06.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:30:36.633 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:30:36.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:31:06.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:31:06.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:31:36.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:31:36.946 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:32:07.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:32:07.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:32:37.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:32:37.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:33:07.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:33:07.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:33:37.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:33:37.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:34:07.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:34:07.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:34:37.934 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:34:37.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:35:08.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:35:08.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:35:38.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:35:38.240 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:36:08.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:36:08.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:36:38.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:36:38.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:37:08.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:37:08.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:37:38.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:37:38.886 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:38:09.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:38:09.013 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:38:39.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:38:39.162 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:39:09.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:39:09.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:39:39.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:39:39.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:40:09.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:40:09.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:40:39.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:40:39.916 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:41:10.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:41:10.086 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:41:40.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:41:40.228 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:42:10.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:42:10.383 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:42:40.571 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:42:40.579 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:43:10.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:43:10.734 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:43:40.881 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:43:40.889 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:44:11.064 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:44:11.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:44:41.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:44:41.242 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:45:11.362 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:45:11.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:45:41.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:45:41.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:46:11.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:46:11.678 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:46:41.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:46:41.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:47:12.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:47:12.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:47:42.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:47:42.255 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:48:12.401 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:48:12.409 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:48:42.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:48:42.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:49:12.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:49:12.663 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:49:42.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:49:42.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:50:12.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:50:12.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:50:43.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:50:43.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:51:13.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:51:13.286 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:51:43.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:51:43.450 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:52:13.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:52:13.602 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:52:43.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:52:43.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:53:13.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:53:13.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:53:44.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:53:44.073 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:54:14.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:54:14.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:54:44.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:54:44.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:55:14.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:55:14.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:55:44.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:55:44.689 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:56:14.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:56:14.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:56:44.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:56:44.996 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:57:15.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:57:15.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:57:45.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:57:45.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:58:15.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:58:15.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:58:45.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:58:45.612 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:59:15.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:59:15.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:59:45.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T20:59:45.867 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:00:16.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:00:16.016 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:00:46.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:00:46.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:01:16.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:01:16.338 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:01:46.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:01:46.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:02:16.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:02:16.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:02:47.010 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:02:47.017 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:03:17.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:03:17.158 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:03:47.226 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:03:47.233 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:04:17.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:04:17.385 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:04:47.533 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:04:47.541 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:05:17.686 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:05:17.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:05:47.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:05:47.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:06:17.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:06:18.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:06:48.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:06:48.276 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:07:18.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:07:18.430 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:07:48.623 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:07:48.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:08:18.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:08:18.773 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:08:49.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:08:49.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:09:19.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:09:19.173 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:09:49.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:09:49.319 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:10:19.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:10:19.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:10:49.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:10:49.620 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:11:19.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:11:19.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:11:49.912 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:11:49.921 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:12:20.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:12:20.070 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:12:50.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:12:50.231 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:13:20.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:13:20.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:13:50.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:13:50.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:14:20.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:14:20.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:14:50.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:14:51.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:15:21.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:15:21.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:15:51.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:15:51.437 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:16:21.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:16:21.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:16:51.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:16:51.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:17:21.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:17:21.933 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:17:52.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:17:52.096 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:18:22.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:18:22.259 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:18:52.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:18:52.401 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:19:22.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:19:22.547 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:19:52.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:19:52.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:20:22.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:20:22.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:20:52.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:20:52.949 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:21:23.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:21:23.094 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:21:53.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:21:53.260 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:22:23.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:22:23.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:22:53.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:22:53.773 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:23:23.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:23:23.935 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:23:54.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:23:54.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:24:24.267 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:24:24.275 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:24:54.420 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:24:54.428 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:25:24.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:25:24.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:25:54.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:25:54.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:26:24.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:26:24.893 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:26:55.048 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:26:55.056 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:27:25.207 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:27:25.215 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:27:55.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:27:55.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:28:25.594 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:28:25.602 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:28:55.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:28:55.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:29:25.845 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:29:25.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:29:56.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:29:56.029 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:30:26.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:30:26.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:30:56.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:30:56.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:31:26.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:31:26.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:31:56.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:31:56.639 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T21:32:19.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T21:32:19.263 INFO:teuthology.orchestra.run.smithi123.stdout:generic/089 2023-07-21T21:32:19.263 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-21T21:32:19.263 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-07-21T21:32:19.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:32:19.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:32:19.951 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner[Errno 104] Connection reset by peer 2023-07-21T21:32:19.954 ERROR:paramiko.transport:Traceback (most recent call last): 2023-07-21T21:32:19.954 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-07-21T21:32:19.955 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-07-21T21:32:19.955 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-07-21T21:32:19.955 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-07-21T21:32:19.955 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 607, in _read_timeout 2023-07-21T21:32:19.956 ERROR:paramiko.transport: x = self.__socket.recv(128) 2023-07-21T21:32:19.956 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv 2023-07-21T21:32:19.956 ERROR:paramiko.transport: return self._sock.recv(*args) 2023-07-21T21:32:19.956 ERROR:paramiko.transport:ConnectionResetError: [Errno 104] Connection reset by peer 2023-07-21T21:32:19.957 ERROR:paramiko.transport: 2023-07-21T21:32:19.957 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-07-21T21:32:19.957 ERROR:paramiko.transport: 2023-07-21T21:32:19.957 ERROR:paramiko.transport:Traceback (most recent call last): 2023-07-21T21:32:19.957 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-07-21T21:32:19.958 ERROR:paramiko.transport: self._check_banner() 2023-07-21T21:32:19.958 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-07-21T21:32:19.958 ERROR:paramiko.transport: raise SSHException( 2023-07-21T21:32:19.958 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer 2023-07-21T21:32:19.958 ERROR:paramiko.transport: 2023-07-21T21:32:19.959 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: No SSH private key found! 2023-07-21T21:32:19.959 DEBUG:teuthology.orchestra.remote:Error reading SSH protocol banner[Errno 104] Connection reset by peer 2023-07-21T21:32:26.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:32:26.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:32:28.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:32:28.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:01.424 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:01.425 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:10.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:10.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:15.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:15.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:18.512 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:18.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:21.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:21.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:21.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:21.585 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-21T21:33:21.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:21.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:31.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:31.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:36.598 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:37.744 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:40.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:40.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:45.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:33:45.073 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-21T21:33:45.080 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 2023-07-21T21:33:45.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:33:45.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:33:53.680 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:34:05.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:34:05.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:34:13.776 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:34:16.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:34:16.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:34:24.848 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:34:24.849 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-21T21:34:24.849 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2023-07-21T21:34:24.850 INFO:tasks.cephfs_test_runner:ERROR 2023-07-21T21:34:24.850 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.851 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-21T21:34:24.851 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T21:34:24.852 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T21:34:24.852 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-21T21:34:24.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-07-21T21:34:24.853 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-07-21T21:34:24.854 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-07-21T21:34:24.854 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-07-21T21:34:24.855 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-07-21T21:34:24.855 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-07-21T21:34:24.855 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-07-21T21:34:24.856 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-07-21T21:34:24.856 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-07-21T21:34:24.858 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-07-21T21:34:24.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-07-21T21:34:24.858 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-07-21T21:34:24.859 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run 2023-07-21T21:34:24.859 INFO:tasks.cephfs_test_runner: raise Exception(f'Cannot connect to remote host {self.shortname}') 2023-07-21T21:34:24.859 INFO:tasks.cephfs_test_runner:Exception: Cannot connect to remote host smithi123 2023-07-21T21:34:24.859 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.860 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-21T21:34:24.860 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T21:34:24.860 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T21:34:24.861 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-21T21:34:24.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-07-21T21:34:24.861 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-07-21T21:34:24.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-07-21T21:34:24.861 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-07-21T21:34:24.862 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run 2023-07-21T21:34:24.862 INFO:tasks.cephfs_test_runner: raise Exception(f'Cannot connect to remote host {self.shortname}') 2023-07-21T21:34:24.862 INFO:tasks.cephfs_test_runner:Exception: Cannot connect to remote host smithi123 2023-07-21T21:34:24.862 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.862 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T21:34:24.863 INFO:tasks.cephfs_test_runner:Ran 1 test in 8738.910s 2023-07-21T21:34:24.863 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.863 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-07-21T21:34:24.863 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.864 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-21T21:34:24.864 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T21:34:24.864 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T21:34:24.865 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-21T21:34:24.865 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-07-21T21:34:24.865 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-07-21T21:34:24.866 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-07-21T21:34:24.866 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-07-21T21:34:24.866 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-07-21T21:34:24.866 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-07-21T21:34:24.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-07-21T21:34:24.867 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-07-21T21:34:24.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-07-21T21:34:24.867 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-07-21T21:34:24.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-07-21T21:34:24.869 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-07-21T21:34:24.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run 2023-07-21T21:34:24.869 INFO:tasks.cephfs_test_runner: raise Exception(f'Cannot connect to remote host {self.shortname}') 2023-07-21T21:34:24.869 INFO:tasks.cephfs_test_runner:Exception: Cannot connect to remote host smithi123 2023-07-21T21:34:24.869 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.870 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-21T21:34:24.870 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T21:34:24.870 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T21:34:24.870 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-21T21:34:24.871 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-07-21T21:34:24.871 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-07-21T21:34:24.871 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-07-21T21:34:24.871 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-07-21T21:34:24.871 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run 2023-07-21T21:34:24.872 INFO:tasks.cephfs_test_runner: raise Exception(f'Cannot connect to remote host {self.shortname}') 2023-07-21T21:34:24.872 INFO:tasks.cephfs_test_runner:Exception: Cannot connect to remote host smithi123 2023-07-21T21:34:24.872 INFO:tasks.cephfs_test_runner: 2023-07-21T21:34:24.872 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T21:34:24.949 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9bd78e1a9e41460abb23edaa7c42997d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-21T21:34:24.951 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-21T21:34:24.963 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-21T21:34:24.982 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-21T21:34:24.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:34:24.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:34:33.040 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:34:42.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:34:42.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:34:50.128 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:02.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:02.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:35:10.224 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:13.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:13.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:35:21.296 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:21.297 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-21T21:35:21.297 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 2023-07-21T21:35:21.303 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-21T21:35:21.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T21:35:21.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:21.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:35:24.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:33.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:33.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:35:40.308 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:52.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:52.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:35:52.464 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:55.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:55.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:35:58.448 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:35:58.449 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-21T21:35:58.449 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2744, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2576, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2342, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 2023-07-21T21:35:58.460 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-21T21:35:58.461 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T21:35:58.461 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.465 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T21:35:58.466 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T21:35:58.466 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.467 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T21:35:58.468 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T21:35:58.468 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.469 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T21:35:58.469 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T21:35:58.470 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:35:58.471 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2744, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2576, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2342, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi145 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-07-21T21:35:58.483 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T21:35:58.485 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-21T21:35:58.486 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-21T21:35:58.486 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.487 INFO:tasks.ceph.osd.0:Stopped 2023-07-21T21:35:58.487 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-21T21:35:58.488 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.488 INFO:tasks.ceph.osd.1:Stopped 2023-07-21T21:35:58.489 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-21T21:35:58.489 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.490 INFO:tasks.ceph.osd.2:Stopped 2023-07-21T21:35:58.490 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-21T21:35:58.491 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.491 INFO:tasks.ceph.osd.3:Stopped 2023-07-21T21:35:58.492 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-21T21:35:58.492 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.492 INFO:tasks.ceph.osd.4:Stopped 2023-07-21T21:35:58.493 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-21T21:35:58.493 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.494 INFO:tasks.ceph.osd.5:Stopped 2023-07-21T21:35:58.494 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-21T21:35:58.495 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.495 INFO:tasks.ceph.osd.6:Stopped 2023-07-21T21:35:58.496 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-21T21:35:58.496 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.497 INFO:tasks.ceph.osd.7:Stopped 2023-07-21T21:35:58.497 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-21T21:35:58.498 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-21T21:35:58.498 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.499 INFO:tasks.ceph.mgr.y:Stopped 2023-07-21T21:35:58.499 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-21T21:35:58.500 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:35:58.501 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2744, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2576, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2342, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi145 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-07-21T21:35:58.514 INFO:tasks.ceph.mgr.x:Stopped 2023-07-21T21:35:58.514 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-21T21:35:58.515 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-21T21:35:58.515 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.516 INFO:tasks.ceph.mon.a:Stopped 2023-07-21T21:35:58.516 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-21T21:35:58.517 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.517 INFO:tasks.ceph.mon.b:Stopped 2023-07-21T21:35:58.520 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-21T21:35:58.521 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T21:35:58.521 INFO:tasks.ceph.mon.c:Stopped 2023-07-21T21:35:58.522 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-21T21:35:58.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:35:58.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:36:01.524 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T21:36:10.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T21:36:10.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:36:47.033 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed. 2023-07-21T21:36:47.039 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-21T21:36:47.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T22:36:59.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T22:36:59.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:36:59.205 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-21T22:36:59.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T22:36:59.277 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-21T22:36:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:grep: /var/log/ceph/ceph.log: No such file or directory 2023-07-21T22:36:59.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T22:36:59.352 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-21T22:37:00.003 INFO:teuthology.orchestra.run.smithi123.stderr:umount: /var/lib/ceph/osd/ceph-0: no mount point specified. 2023-07-21T22:37:00.004 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:37:00.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-07-21T22:37:00.112 INFO:teuthology.orchestra.run.smithi123.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-07-21T22:37:00.113 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.113 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.113 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root txt REG 8,1 102120 16840 /usr/lib/systemd/systemd 2023-07-21T22:37:00.114 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.114 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.114 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.115 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.115 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.116 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 593150 111 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-21T22:37:00.116 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.116 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.116 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.118 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.118 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.118 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.118 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.118 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.119 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.119 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.119 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 107984 9595 /usr/lib64/libkmod.so.2.3.6 2023-07-21T22:37:00.119 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 3640680 43416 /usr/lib64/systemd/libsystemd-shared-252.so 2023-07-21T22:37:00.119 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.120 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.120 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.120 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.120 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 21219 28863 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-21T22:37:00.121 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 2112568 43415 /usr/lib64/systemd/libsystemd-core-252.so 2023-07-21T22:37:00.121 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.121 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.121 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.121 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.122 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.122 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-07-21T22:37:00.122 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 4u a_inode 0,14 0 12292 [eventpoll:5,6,8,9,11,14,15,16,17,18,41,42,44,45,47,51,60,61,66,67,68,71,72,74,75,76,80,88,89,98,101,102...] 2023-07-21T22:37:00.122 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 5u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.122 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 6r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.123 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-07-21T22:37:00.123 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 8u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.123 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 9u a_inode 0,14 0 12292 [eventpoll:10,13] 2023-07-21T22:37:00.123 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 10r REG 0,20 0 12396 /proc/1/mountinfo 2023-07-21T22:37:00.123 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 11r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.124 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 12u netlink 0t0 18636 AUDIT 2023-07-21T22:37:00.124 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 13r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.124 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-07-21T22:37:00.124 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 15u netlink 0t0 18628 KOBJECT_UEVENT 2023-07-21T22:37:00.125 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 16u unix 0xffff903dd81ec840 0t0 18630 /run/systemd/private type=STREAM (LISTEN) 2023-07-21T22:37:00.125 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 17r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.125 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 18u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.125 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 19r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.125 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 21u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.126 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 22u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.126 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 23u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.126 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 24u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.126 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 25u unix 0xffff903dc47bbb80 0t0 12243 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.126 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 26u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.127 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-07-21T22:37:00.127 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 28u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.127 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 30u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.127 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 31u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.127 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 32u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.128 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 36u a_inode 0,14 0 12292 bpf-prog 2023-07-21T22:37:00.128 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 41u unix 0xffff903dd80efb40 0t0 12398 /run/systemd/notify type=DGRAM (CONNECTED) 2023-07-21T22:37:00.128 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 42u unix 0xffff903dd80ef700 0t0 12399 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.128 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 43u unix 0xffff903dd80eaa80 0t0 12400 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.129 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 44u unix 0xffff903dd80e0440 0t0 12404 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-07-21T22:37:00.129 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 45u unix 0xffff903dd80e1100 0t0 12403 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-07-21T22:37:00.129 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 47u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.129 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 49u netlink 0t0 12197 KOBJECT_UEVENT 2023-07-21T22:37:00.129 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 50u unix 0xffff903dc47baec0 0t0 12195 /run/udev/control type=SEQPACKET (LISTEN) 2023-07-21T22:37:00.130 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 51u unix 0xffff903dc47b4840 0t0 12181 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-07-21T22:37:00.130 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 55u unix 0xffff903dd80e8cc0 0t0 12413 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-07-21T22:37:00.130 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 56u unix 0xffff903dd80e3740 0t0 12415 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-07-21T22:37:00.130 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 60u unix 0xffff903dd80e1540 0t0 12753 type=STREAM (CONNECTED) 2023-07-21T22:37:00.130 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 61u unix 0xffff903dc47bbfc0 0t0 12193 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-07-21T22:37:00.131 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 63u CHR 10,242 0t0 165 /dev/rfkill 2023-07-21T22:37:00.131 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 66u unix 0xffff903dd8195d80 0t0 17133 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.131 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 67u unix 0xffff903dd80e3b80 0t0 20569 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.131 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 68u unix 0xffff903dd81ebb80 0t0 20600 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.131 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 69u unix 0xffff903dd827b300 0t0 17249 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.132 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 70u unix 0xffff903dd81ea200 0t0 17258 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.132 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 71u unix 0xffff903dd8190000 0t0 17259 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.132 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 72u unix 0xffff903dd827aa80 0t0 17260 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.132 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 73u unix 0xffff903dd81e9100 0t0 17264 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.132 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 74u unix 0xffff903dd80e4840 0t0 2508 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.133 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 75u unix 0xffff903dc7b62200 0t0 2509 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.133 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 76u unix 0xffff903dd8190440 0t0 2510 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.133 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 79u unix 0xffff903dd8279540 0t0 20629 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.133 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 80u unix 0xffff903dd81ed940 0t0 2715 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.133 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 81u unix 0xffff903dd81ee1c0 0t0 20058 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.134 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 86u unix 0xffff903dd80e8880 0t0 12411 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-07-21T22:37:00.134 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 87u unix 0xffff903dd80e72c0 0t0 12745 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-07-21T22:37:00.134 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 88r FIFO 0,13 0t0 12178 pipe 2023-07-21T22:37:00.135 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 89u unix 0xffff903dd80e4400 0t0 12747 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-07-21T22:37:00.135 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 90u unix 0xffff903dc47b0000 0t0 12183 /run/rpcbind.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.136 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 91u IPv4 15584 0t0 TCP *:sunrpc (LISTEN) 2023-07-21T22:37:00.136 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 92u IPv4 17049 0t0 UDP *:sunrpc 2023-07-21T22:37:00.137 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 96u IPv6 12579 0t0 TCP *:sunrpc (LISTEN) 2023-07-21T22:37:00.137 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 97u IPv6 17055 0t0 UDP *:sunrpc 2023-07-21T22:37:00.137 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 98u FIFO 0,24 0t0 444 /run/initctl 2023-07-21T22:37:00.138 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 101u FIFO 0,24 0t0 438 /run/dmeventd-server 2023-07-21T22:37:00.138 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 1 root 102u FIFO 0,24 0t0 439 /run/dmeventd-client 2023-07-21T22:37:00.139 INFO:teuthology.orchestra.run.smithi123.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.139 INFO:teuthology.orchestra.run.smithi123.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.140 INFO:teuthology.orchestra.run.smithi123.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-07-21T22:37:00.140 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.141 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.141 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-07-21T22:37:00.142 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.142 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.142 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-07-21T22:37:00.142 INFO:teuthology.orchestra.run.smithi123.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.143 INFO:teuthology.orchestra.run.smithi123.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.143 INFO:teuthology.orchestra.run.smithi123.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-07-21T22:37:00.143 INFO:teuthology.orchestra.run.smithi123.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.144 INFO:teuthology.orchestra.run.smithi123.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.144 INFO:teuthology.orchestra.run.smithi123.stdout:netns 6 root txt unknown /proc/6/exe 2023-07-21T22:37:00.145 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.145 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.145 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-07-21T22:37:00.146 INFO:teuthology.orchestra.run.smithi123.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.146 INFO:teuthology.orchestra.run.smithi123.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.146 INFO:teuthology.orchestra.run.smithi123.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-07-21T22:37:00.146 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.146 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.147 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-07-21T22:37:00.147 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.147 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.147 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-07-21T22:37:00.148 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.148 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.148 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-07-21T22:37:00.148 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.148 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.149 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2023-07-21T22:37:00.149 INFO:teuthology.orchestra.run.smithi123.stdout:pr/ttyS1 16 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.149 INFO:teuthology.orchestra.run.smithi123.stdout:pr/ttyS1 16 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.149 INFO:teuthology.orchestra.run.smithi123.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe 2023-07-21T22:37:00.150 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.150 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.150 INFO:teuthology.orchestra.run.smithi123.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2023-07-21T22:37:00.150 INFO:teuthology.orchestra.run.smithi123.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.150 INFO:teuthology.orchestra.run.smithi123.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.150 INFO:teuthology.orchestra.run.smithi123.stdout:migration 18 root txt unknown /proc/18/exe 2023-07-21T22:37:00.151 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.151 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.151 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 19 root txt unknown /proc/19/exe 2023-07-21T22:37:00.151 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 20 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.151 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 20 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.152 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 20 root txt unknown /proc/20/exe 2023-07-21T22:37:00.152 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.152 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.152 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-07-21T22:37:00.153 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.153 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.153 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-07-21T22:37:00.153 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.153 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.154 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-07-21T22:37:00.154 INFO:teuthology.orchestra.run.smithi123.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.154 INFO:teuthology.orchestra.run.smithi123.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.154 INFO:teuthology.orchestra.run.smithi123.stdout:migration 24 root txt unknown /proc/24/exe 2023-07-21T22:37:00.154 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.155 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.155 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-07-21T22:37:00.155 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.155 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.155 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-07-21T22:37:00.156 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.156 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.156 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-07-21T22:37:00.156 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.156 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.157 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-07-21T22:37:00.157 INFO:teuthology.orchestra.run.smithi123.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.157 INFO:teuthology.orchestra.run.smithi123.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.157 INFO:teuthology.orchestra.run.smithi123.stdout:migration 30 root txt unknown /proc/30/exe 2023-07-21T22:37:00.158 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.158 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.158 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-07-21T22:37:00.158 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 32 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.158 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 32 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.159 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 32 root txt unknown /proc/32/exe 2023-07-21T22:37:00.159 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.159 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.159 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-07-21T22:37:00.159 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.160 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.160 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-07-21T22:37:00.160 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.160 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.160 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-07-21T22:37:00.161 INFO:teuthology.orchestra.run.smithi123.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.161 INFO:teuthology.orchestra.run.smithi123.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.161 INFO:teuthology.orchestra.run.smithi123.stdout:migration 36 root txt unknown /proc/36/exe 2023-07-21T22:37:00.161 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.162 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.162 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-07-21T22:37:00.162 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 38 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.162 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 38 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.162 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 38 root txt unknown /proc/38/exe 2023-07-21T22:37:00.163 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.163 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.163 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-07-21T22:37:00.163 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.164 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.164 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-07-21T22:37:00.164 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.165 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.165 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-07-21T22:37:00.166 INFO:teuthology.orchestra.run.smithi123.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.166 INFO:teuthology.orchestra.run.smithi123.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.166 INFO:teuthology.orchestra.run.smithi123.stdout:migration 42 root txt unknown /proc/42/exe 2023-07-21T22:37:00.167 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.167 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.168 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-07-21T22:37:00.168 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 44 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.169 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 44 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.169 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 44 root txt unknown /proc/44/exe 2023-07-21T22:37:00.169 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.170 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.170 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-07-21T22:37:00.170 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.171 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.171 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-07-21T22:37:00.171 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.171 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.171 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-07-21T22:37:00.172 INFO:teuthology.orchestra.run.smithi123.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.172 INFO:teuthology.orchestra.run.smithi123.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.172 INFO:teuthology.orchestra.run.smithi123.stdout:migration 48 root txt unknown /proc/48/exe 2023-07-21T22:37:00.172 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.172 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.173 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-07-21T22:37:00.173 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 50 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.173 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 50 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.173 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 50 root txt unknown /proc/50/exe 2023-07-21T22:37:00.174 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.174 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.174 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-07-21T22:37:00.174 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.174 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-07-21T22:37:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-07-21T22:37:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.176 INFO:teuthology.orchestra.run.smithi123.stdout:migration 54 root txt unknown /proc/54/exe 2023-07-21T22:37:00.176 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.176 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.176 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-07-21T22:37:00.177 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.177 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.177 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-07-21T22:37:00.177 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.177 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.178 INFO:teuthology.orchestra.run.smithi123.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-07-21T22:37:00.178 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.178 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.178 INFO:teuthology.orchestra.run.smithi123.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-07-21T22:37:00.178 INFO:teuthology.orchestra.run.smithi123.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.179 INFO:teuthology.orchestra.run.smithi123.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.179 INFO:teuthology.orchestra.run.smithi123.stdout:migration 60 root txt unknown /proc/60/exe 2023-07-21T22:37:00.179 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.180 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.180 INFO:teuthology.orchestra.run.smithi123.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-07-21T22:37:00.181 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.181 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.182 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-07-21T22:37:00.182 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.182 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.183 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 67 root txt unknown /proc/67/exe 2023-07-21T22:37:00.183 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 69 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.183 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 69 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.183 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 69 root txt unknown /proc/69/exe 2023-07-21T22:37:00.183 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.184 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.184 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-07-21T22:37:00.184 INFO:teuthology.orchestra.run.smithi123.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-07-21T22:37:00.184 INFO:teuthology.orchestra.run.smithi123.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-07-21T22:37:00.184 INFO:teuthology.orchestra.run.smithi123.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-07-21T22:37:00.185 INFO:teuthology.orchestra.run.smithi123.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.185 INFO:teuthology.orchestra.run.smithi123.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.185 INFO:teuthology.orchestra.run.smithi123.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-07-21T22:37:00.185 INFO:teuthology.orchestra.run.smithi123.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.185 INFO:teuthology.orchestra.run.smithi123.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.186 INFO:teuthology.orchestra.run.smithi123.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-07-21T22:37:00.186 INFO:teuthology.orchestra.run.smithi123.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.186 INFO:teuthology.orchestra.run.smithi123.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.186 INFO:teuthology.orchestra.run.smithi123.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-07-21T22:37:00.186 INFO:teuthology.orchestra.run.smithi123.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.187 INFO:teuthology.orchestra.run.smithi123.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.187 INFO:teuthology.orchestra.run.smithi123.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-07-21T22:37:00.187 INFO:teuthology.orchestra.run.smithi123.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.187 INFO:teuthology.orchestra.run.smithi123.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.187 INFO:teuthology.orchestra.run.smithi123.stdout:writeback 77 root txt unknown /proc/77/exe 2023-07-21T22:37:00.188 INFO:teuthology.orchestra.run.smithi123.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.188 INFO:teuthology.orchestra.run.smithi123.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.188 INFO:teuthology.orchestra.run.smithi123.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-07-21T22:37:00.188 INFO:teuthology.orchestra.run.smithi123.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.188 INFO:teuthology.orchestra.run.smithi123.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.189 INFO:teuthology.orchestra.run.smithi123.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-07-21T22:37:00.189 INFO:teuthology.orchestra.run.smithi123.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.189 INFO:teuthology.orchestra.run.smithi123.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.189 INFO:teuthology.orchestra.run.smithi123.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-07-21T22:37:00.189 INFO:teuthology.orchestra.run.smithi123.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.190 INFO:teuthology.orchestra.run.smithi123.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.190 INFO:teuthology.orchestra.run.smithi123.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-07-21T22:37:00.190 INFO:teuthology.orchestra.run.smithi123.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.190 INFO:teuthology.orchestra.run.smithi123.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.190 INFO:teuthology.orchestra.run.smithi123.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-07-21T22:37:00.190 INFO:teuthology.orchestra.run.smithi123.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.191 INFO:teuthology.orchestra.run.smithi123.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.191 INFO:teuthology.orchestra.run.smithi123.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-07-21T22:37:00.191 INFO:teuthology.orchestra.run.smithi123.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.191 INFO:teuthology.orchestra.run.smithi123.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.191 INFO:teuthology.orchestra.run.smithi123.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-07-21T22:37:00.192 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 85 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.192 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 85 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.192 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 85 root txt unknown /proc/85/exe 2023-07-21T22:37:00.192 INFO:teuthology.orchestra.run.smithi123.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.192 INFO:teuthology.orchestra.run.smithi123.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.193 INFO:teuthology.orchestra.run.smithi123.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2023-07-21T22:37:00.193 INFO:teuthology.orchestra.run.smithi123.stdout:md 87 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.193 INFO:teuthology.orchestra.run.smithi123.stdout:md 87 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.193 INFO:teuthology.orchestra.run.smithi123.stdout:md 87 root txt unknown /proc/87/exe 2023-07-21T22:37:00.193 INFO:teuthology.orchestra.run.smithi123.stdout:edac-poll 88 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.194 INFO:teuthology.orchestra.run.smithi123.stdout:edac-poll 88 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.194 INFO:teuthology.orchestra.run.smithi123.stdout:edac-poll 88 root txt unknown /proc/88/exe 2023-07-21T22:37:00.194 INFO:teuthology.orchestra.run.smithi123.stdout:watchdogd 89 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.194 INFO:teuthology.orchestra.run.smithi123.stdout:watchdogd 89 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.194 INFO:teuthology.orchestra.run.smithi123.stdout:watchdogd 89 root txt unknown /proc/89/exe 2023-07-21T22:37:00.195 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 91 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.195 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 91 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.195 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 91 root txt unknown /proc/91/exe 2023-07-21T22:37:00.195 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 92 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.195 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 92 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.196 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 92 root txt unknown /proc/92/exe 2023-07-21T22:37:00.196 INFO:teuthology.orchestra.run.smithi123.stdout:kswapd0 93 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.196 INFO:teuthology.orchestra.run.smithi123.stdout:kswapd0 93 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.196 INFO:teuthology.orchestra.run.smithi123.stdout:kswapd0 93 root txt unknown /proc/93/exe 2023-07-21T22:37:00.196 INFO:teuthology.orchestra.run.smithi123.stdout:kthrotld 99 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.197 INFO:teuthology.orchestra.run.smithi123.stdout:kthrotld 99 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.197 INFO:teuthology.orchestra.run.smithi123.stdout:kthrotld 99 root txt unknown /proc/99/exe 2023-07-21T22:37:00.197 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 104 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.197 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 104 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.197 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 104 root txt unknown /proc/104/exe 2023-07-21T22:37:00.198 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 105 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.198 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 105 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.198 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 105 root txt unknown /proc/105/exe 2023-07-21T22:37:00.198 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 106 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.198 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 106 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.199 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 106 root txt unknown /proc/106/exe 2023-07-21T22:37:00.199 INFO:teuthology.orchestra.run.smithi123.stdout:acpi_ther 107 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.199 INFO:teuthology.orchestra.run.smithi123.stdout:acpi_ther 107 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.199 INFO:teuthology.orchestra.run.smithi123.stdout:acpi_ther 107 root txt unknown /proc/107/exe 2023-07-21T22:37:00.199 INFO:teuthology.orchestra.run.smithi123.stdout:kmpath_rd 108 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.199 INFO:teuthology.orchestra.run.smithi123.stdout:kmpath_rd 108 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.200 INFO:teuthology.orchestra.run.smithi123.stdout:kmpath_rd 108 root txt unknown /proc/108/exe 2023-07-21T22:37:00.200 INFO:teuthology.orchestra.run.smithi123.stdout:kaluad 109 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.200 INFO:teuthology.orchestra.run.smithi123.stdout:kaluad 109 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.200 INFO:teuthology.orchestra.run.smithi123.stdout:kaluad 109 root txt unknown /proc/109/exe 2023-07-21T22:37:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:mld 110 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:mld 110 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:mld 110 root txt unknown /proc/110/exe 2023-07-21T22:37:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 111 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 111 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 111 root txt unknown /proc/111/exe 2023-07-21T22:37:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:ipv6_addr 112 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:ipv6_addr 112 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:ipv6_addr 112 root txt unknown /proc/112/exe 2023-07-21T22:37:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:kstrp 121 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:kstrp 121 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:kstrp 121 root txt unknown /proc/121/exe 2023-07-21T22:37:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 129 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 129 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 129 root txt unknown /proc/129/exe 2023-07-21T22:37:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:zswap-shr 134 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:zswap-shr 134 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:zswap-shr 134 root txt unknown /proc/134/exe 2023-07-21T22:37:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 246 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 246 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 246 root txt unknown /proc/246/exe 2023-07-21T22:37:00.205 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 249 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.205 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 249 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.205 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 249 root txt unknown /proc/249/exe 2023-07-21T22:37:00.205 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 251 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.205 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 251 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.206 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 251 root txt unknown /proc/251/exe 2023-07-21T22:37:00.206 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 300 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.206 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 300 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.206 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 300 root txt unknown /proc/300/exe 2023-07-21T22:37:00.206 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 301 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.207 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 301 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.207 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 301 root txt unknown /proc/301/exe 2023-07-21T22:37:00.207 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 304 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.207 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 304 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.207 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 304 root txt unknown /proc/304/exe 2023-07-21T22:37:00.208 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 305 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.208 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 305 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.208 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 305 root txt unknown /proc/305/exe 2023-07-21T22:37:00.208 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 394 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.208 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 394 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.209 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/1 394 root txt unknown /proc/394/exe 2023-07-21T22:37:00.209 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 427 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.209 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 427 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.209 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 427 root txt unknown /proc/427/exe 2023-07-21T22:37:00.209 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 436 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.210 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 436 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.210 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/0 436 root txt unknown /proc/436/exe 2023-07-21T22:37:00.210 INFO:teuthology.orchestra.run.smithi123.stdout:ata_sff 438 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.210 INFO:teuthology.orchestra.run.smithi123.stdout:ata_sff 438 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.210 INFO:teuthology.orchestra.run.smithi123.stdout:ata_sff 438 root txt unknown /proc/438/exe 2023-07-21T22:37:00.211 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-wq 442 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.211 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-wq 442 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.211 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-wq 442 root txt unknown /proc/442/exe 2023-07-21T22:37:00.211 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-rese 447 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.211 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-rese 447 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.211 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-rese 447 root txt unknown /proc/447/exe 2023-07-21T22:37:00.212 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-dele 448 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.212 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-dele 448 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.212 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-dele 448 root txt unknown /proc/448/exe 2023-07-21T22:37:00.212 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-auth 449 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.212 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-auth 449 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.213 INFO:teuthology.orchestra.run.smithi123.stdout:nvme-auth 449 root txt unknown /proc/449/exe 2023-07-21T22:37:00.213 INFO:teuthology.orchestra.run.smithi123.stdout:ixgbe 452 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.213 INFO:teuthology.orchestra.run.smithi123.stdout:ixgbe 452 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.213 INFO:teuthology.orchestra.run.smithi123.stdout:ixgbe 452 root txt unknown /proc/452/exe 2023-07-21T22:37:00.213 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_0 453 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.214 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_0 453 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.214 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_0 453 root txt unknown /proc/453/exe 2023-07-21T22:37:00.214 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.214 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.214 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2023-07-21T22:37:00.215 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_1 455 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.215 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_1 455 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.215 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_1 455 root txt unknown /proc/455/exe 2023-07-21T22:37:00.215 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.215 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.216 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2023-07-21T22:37:00.216 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_2 457 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.216 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_2 457 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.216 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_2 457 root txt unknown /proc/457/exe 2023-07-21T22:37:00.216 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 458 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.217 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 458 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.217 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 458 root txt unknown /proc/458/exe 2023-07-21T22:37:00.217 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_3 459 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.217 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_3 459 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.217 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_3 459 root txt unknown /proc/459/exe 2023-07-21T22:37:00.218 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 460 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.218 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 460 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.218 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 460 root txt unknown /proc/460/exe 2023-07-21T22:37:00.218 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_4 464 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.218 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_4 464 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.219 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_4 464 root txt unknown /proc/464/exe 2023-07-21T22:37:00.219 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 465 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.219 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 465 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.219 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 465 root txt unknown /proc/465/exe 2023-07-21T22:37:00.219 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_5 466 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.220 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_5 466 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.220 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_5 466 root txt unknown /proc/466/exe 2023-07-21T22:37:00.220 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 467 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.220 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 467 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.220 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 467 root txt unknown /proc/467/exe 2023-07-21T22:37:00.221 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_6 468 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.221 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_6 468 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.221 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_6 468 root txt unknown /proc/468/exe 2023-07-21T22:37:00.221 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 469 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.221 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 469 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.222 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 469 root txt unknown /proc/469/exe 2023-07-21T22:37:00.222 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_7 470 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.222 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_7 470 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.222 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_7 470 root txt unknown /proc/470/exe 2023-07-21T22:37:00.222 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 471 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 471 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 471 root txt unknown /proc/471/exe 2023-07-21T22:37:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_8 472 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_8 472 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_8 472 root txt unknown /proc/472/exe 2023-07-21T22:37:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 474 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.224 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 474 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.224 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 474 root txt unknown /proc/474/exe 2023-07-21T22:37:00.224 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_9 475 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.224 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_9 475 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.224 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_eh_9 475 root txt unknown /proc/475/exe 2023-07-21T22:37:00.225 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 476 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.225 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 476 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.225 INFO:teuthology.orchestra.run.smithi123.stdout:scsi_tmf_ 476 root txt unknown /proc/476/exe 2023-07-21T22:37:00.225 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 477 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.225 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 477 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 477 root txt unknown /proc/477/exe 2023-07-21T22:37:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 478 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 478 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 478 root txt unknown /proc/478/exe 2023-07-21T22:37:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 479 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.227 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 479 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.227 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 479 root txt unknown /proc/479/exe 2023-07-21T22:37:00.227 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 480 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.227 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 480 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.227 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 480 root txt unknown /proc/480/exe 2023-07-21T22:37:00.228 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 483 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.228 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 483 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.228 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 483 root txt unknown /proc/483/exe 2023-07-21T22:37:00.228 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 504 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.228 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 504 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.229 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/6 504 root txt unknown /proc/504/exe 2023-07-21T22:37:00.229 INFO:teuthology.orchestra.run.smithi123.stdout:jbd2/sda1 507 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.229 INFO:teuthology.orchestra.run.smithi123.stdout:jbd2/sda1 507 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.229 INFO:teuthology.orchestra.run.smithi123.stdout:jbd2/sda1 507 root txt unknown /proc/507/exe 2023-07-21T22:37:00.229 INFO:teuthology.orchestra.run.smithi123.stdout:ext4-rsv- 508 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.230 INFO:teuthology.orchestra.run.smithi123.stdout:ext4-rsv- 508 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.230 INFO:teuthology.orchestra.run.smithi123.stdout:ext4-rsv- 508 root txt unknown /proc/508/exe 2023-07-21T22:37:00.230 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.230 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.230 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root txt REG 8,1 185480 16847 /usr/lib/systemd/systemd-journald 2023-07-21T22:37:00.231 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.231 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.231 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.231 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.231 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.232 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.232 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.232 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.232 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.232 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.233 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.233 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.233 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.233 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.233 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.234 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.234 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.234 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.234 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.234 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 3640680 43416 /usr/lib64/systemd/libsystemd-shared-252.so 2023-07-21T22:37:00.234 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.235 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 107984 9595 /usr/lib64/libkmod.so.2.3.6 2023-07-21T22:37:00.235 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.235 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.235 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.235 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.236 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.236 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.236 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.236 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-07-21T22:37:00.236 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.237 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 1w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.237 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 2w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.237 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 3u unix 0xffff903dd80e8880 0t0 12411 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-07-21T22:37:00.237 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 4u unix 0xffff903dd80e8cc0 0t0 12413 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-07-21T22:37:00.237 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 5u unix 0xffff903dd80e3740 0t0 12415 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-07-21T22:37:00.238 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-07-21T22:37:00.238 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 7u a_inode 0,14 0 12292 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,22,23,24,25,26,27,28,30,31,34] 2023-07-21T22:37:00.238 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-07-21T22:37:00.238 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 9u unix 0xffff903dc7b63b80 0t0 17533 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-07-21T22:37:00.238 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 10r REG 0,20 0 29 /proc/sys/kernel/hostname 2023-07-21T22:37:00.239 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 11u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.239 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 12u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.239 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 13u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.239 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 14u unix 0xffff903dd8e22640 0t0 17534 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.239 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 15u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.240 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 16u REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.240 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 17u unix 0xffff903dd81ebb80 0t0 20600 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.240 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 18u unix 0xffff903dd827b300 0t0 17249 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.240 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 19u unix 0xffff903dd80e3b80 0t0 20569 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.240 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 20u unix 0xffff903dd8195d80 0t0 17133 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.241 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 22u unix 0xffff903dd8190000 0t0 17259 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.241 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 23u unix 0xffff903dd81ea200 0t0 17258 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.241 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 24u unix 0xffff903dd827aa80 0t0 17260 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.241 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 25u unix 0xffff903dd80e4840 0t0 2508 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.241 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 26u unix 0xffff903dc7b62200 0t0 2509 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.242 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 27u unix 0xffff903dd8190440 0t0 2510 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.242 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 28u unix 0xffff903dd81e9100 0t0 17264 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.242 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 30u unix 0xffff903dd81ee1c0 0t0 20058 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.242 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 31u unix 0xffff903dd8279540 0t0 20629 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.242 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-j 577 root 34u unix 0xffff903dd81ed940 0t0 2715 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-07-21T22:37:00.243 INFO:teuthology.orchestra.run.smithi123.stdout:ext4lazyi 583 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.243 INFO:teuthology.orchestra.run.smithi123.stdout:ext4lazyi 583 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.243 INFO:teuthology.orchestra.run.smithi123.stdout:ext4lazyi 583 root txt unknown /proc/583/exe 2023-07-21T22:37:00.243 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.243 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.244 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root txt REG 8,1 589464 11010 /usr/bin/udevadm 2023-07-21T22:37:00.244 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 11730661 54360 /etc/udev/hwdb.bin 2023-07-21T22:37:00.244 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 593150 111 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-21T22:37:00.244 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 21219 28863 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-21T22:37:00.244 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 562753 395461 /usr/lib/modules/5.14.0-342.el9.x86_64/modules.symbols.bin 2023-07-21T22:37:00.245 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 818383 395458 /usr/lib/modules/5.14.0-342.el9.x86_64/modules.alias.bin 2023-07-21T22:37:00.245 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 379510 395467 /usr/lib/modules/5.14.0-342.el9.x86_64/modules.dep.bin 2023-07-21T22:37:00.245 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.245 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.245 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.246 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.246 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.246 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.246 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.246 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.247 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.247 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.247 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.247 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.247 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.249 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 3640680 43416 /usr/lib64/systemd/libsystemd-shared-252.so 2023-07-21T22:37:00.249 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.249 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.249 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.249 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.250 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.250 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.250 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.250 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 107984 9595 /usr/lib64/libkmod.so.2.3.6 2023-07-21T22:37:00.250 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 11698 395462 /usr/lib/modules/5.14.0-342.el9.x86_64/modules.builtin.bin 2023-07-21T22:37:00.251 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.251 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.251 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.251 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 1u unix 0xffff903dd81961c0 0t0 19565 type=STREAM (CONNECTED) 2023-07-21T22:37:00.251 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 2u unix 0xffff903dd81961c0 0t0 19565 type=STREAM (CONNECTED) 2023-07-21T22:37:00.252 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 3u netlink 0t0 12197 KOBJECT_UEVENT 2023-07-21T22:37:00.252 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 4u unix 0xffff903dc47baec0 0t0 12195 /run/udev/control type=SEQPACKET (LISTEN) 2023-07-21T22:37:00.252 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 5u unix 0xffff903dd8333fc0 0t0 19577 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.252 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 6u unix 0xffff903dd8332ec0 0t0 19581 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.252 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 7u unix 0xffff903dd8333b80 0t0 19582 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.253 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.253 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 9u a_inode 0,14 0 12292 [eventpoll:3,4,6,8,10,11,14] 2023-07-21T22:37:00.253 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 10u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.253 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 11u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.253 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 12r REG 8,1 11730661 54360 /etc/udev/hwdb.bin 2023-07-21T22:37:00.253 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-u 596 root 14u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.254 INFO:teuthology.orchestra.run.smithi123.stdout:ipmi-msgh 641 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.254 INFO:teuthology.orchestra.run.smithi123.stdout:ipmi-msgh 641 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.254 INFO:teuthology.orchestra.run.smithi123.stdout:ipmi-msgh 641 root txt unknown /proc/641/exe 2023-07-21T22:37:00.254 INFO:teuthology.orchestra.run.smithi123.stdout:kipmi0 662 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.254 INFO:teuthology.orchestra.run.smithi123.stdout:kipmi0 662 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.255 INFO:teuthology.orchestra.run.smithi123.stdout:kipmi0 662 root txt unknown /proc/662/exe 2023-07-21T22:37:00.255 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 667 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.255 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 667 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.255 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 667 root txt unknown /proc/667/exe 2023-07-21T22:37:00.255 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.256 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.256 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc txt REG 8,1 61200 2298 /usr/bin/rpcbind 2023-07-21T22:37:00.256 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.256 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.257 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.257 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.257 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.257 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.257 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.257 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.258 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.258 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.258 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.258 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.258 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.259 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.259 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.259 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.259 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.259 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.260 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.260 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.260 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 196120 10846 /usr/lib64/libtirpc.so.3.0.0 2023-07-21T22:37:00.260 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.260 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.261 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 1u unix 0xffff903dd80e2ec0 0t0 12722 type=STREAM (CONNECTED) 2023-07-21T22:37:00.261 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 2u unix 0xffff903dd80e2ec0 0t0 12722 type=STREAM (CONNECTED) 2023-07-21T22:37:00.261 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 3u unix 0xffff903dc47b0000 0t0 12183 /run/rpcbind.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.261 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 4u IPv4 15584 0t0 TCP *:sunrpc (LISTEN) 2023-07-21T22:37:00.261 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 5u IPv4 17049 0t0 UDP *:sunrpc 2023-07-21T22:37:00.262 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 6u IPv6 12579 0t0 TCP *:sunrpc (LISTEN) 2023-07-21T22:37:00.262 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 7u IPv6 17055 0t0 UDP *:sunrpc 2023-07-21T22:37:00.262 INFO:teuthology.orchestra.run.smithi123.stdout:rpcbind 687 rpc 8rW REG 0,24 0 1070 /run/rpcbind/rpcbind.lock 2023-07-21T22:37:00.262 INFO:teuthology.orchestra.run.smithi123.stdout:rpciod 688 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.262 INFO:teuthology.orchestra.run.smithi123.stdout:rpciod 688 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.263 INFO:teuthology.orchestra.run.smithi123.stdout:rpciod 688 root txt unknown /proc/688/exe 2023-07-21T22:37:00.263 INFO:teuthology.orchestra.run.smithi123.stdout:xprtiod 689 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.263 INFO:teuthology.orchestra.run.smithi123.stdout:xprtiod 689 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.263 INFO:teuthology.orchestra.run.smithi123.stdout:xprtiod 689 root txt unknown /proc/689/exe 2023-07-21T22:37:00.263 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.264 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.264 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root txt REG 8,1 145776 11191 /usr/sbin/auditd 2023-07-21T22:37:00.264 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.264 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.264 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.265 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.265 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.265 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.265 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.265 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.266 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.266 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.266 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.266 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.266 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 144728 9145 /usr/lib64/libauparse.so.0.0.0 2023-07-21T22:37:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.268 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 3u netlink 0t0 12726 AUDIT 2023-07-21T22:37:00.268 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 4w REG 8,1 5024143 59403 /var/log/audit/audit.log 2023-07-21T22:37:00.268 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 6u unix 0xffff903dd80ed940 0t0 12729 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.268 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 7u unix 0xffff903dd80e6a40 0t0 12728 type=STREAM (CONNECTED) 2023-07-21T22:37:00.269 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 8u unix 0xffff903dd80e2640 0t0 12730 type=STREAM (CONNECTED) 2023-07-21T22:37:00.269 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 9u unix 0xffff903dd80e6e80 0t0 12731 type=STREAM (CONNECTED) 2023-07-21T22:37:00.269 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 root 10u a_inode 0,14 0 12292 [eventfd:0] 2023-07-21T22:37:00.269 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.269 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.270 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root txt REG 8,1 145776 11191 /usr/sbin/auditd 2023-07-21T22:37:00.270 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.270 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.270 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.270 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.270 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.271 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.271 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.271 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.271 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.271 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.272 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.272 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.272 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.272 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 144728 9145 /usr/lib64/libauparse.so.0.0.0 2023-07-21T22:37:00.272 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.273 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.273 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.273 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.274 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.274 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 3u netlink 0t0 12726 AUDIT 2023-07-21T22:37:00.274 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 4w REG 8,1 5024143 59403 /var/log/audit/audit.log 2023-07-21T22:37:00.274 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 6u unix 0xffff903dd80ed940 0t0 12729 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.275 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 7u unix 0xffff903dd80e6a40 0t0 12728 type=STREAM (CONNECTED) 2023-07-21T22:37:00.275 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 8u unix 0xffff903dd80e2640 0t0 12730 type=STREAM (CONNECTED) 2023-07-21T22:37:00.275 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 9u unix 0xffff903dd80e6e80 0t0 12731 type=STREAM (CONNECTED) 2023-07-21T22:37:00.275 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 691 auditd root 10u a_inode 0,14 0 12292 [eventfd:0] 2023-07-21T22:37:00.276 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.276 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.276 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root txt REG 8,1 145776 11191 /usr/sbin/auditd 2023-07-21T22:37:00.276 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.276 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.277 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.277 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.277 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.277 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.277 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.278 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.278 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.278 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.278 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.278 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.279 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.279 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 144728 9145 /usr/lib64/libauparse.so.0.0.0 2023-07-21T22:37:00.279 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.279 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.279 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.280 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.280 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.280 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 3u netlink 0t0 12726 AUDIT 2023-07-21T22:37:00.280 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 4w REG 8,1 5024143 59403 /var/log/audit/audit.log 2023-07-21T22:37:00.280 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 6u unix 0xffff903dd80ed940 0t0 12729 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.281 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 7u unix 0xffff903dd80e6a40 0t0 12728 type=STREAM (CONNECTED) 2023-07-21T22:37:00.281 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 8u unix 0xffff903dd80e2640 0t0 12730 type=STREAM (CONNECTED) 2023-07-21T22:37:00.281 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 9u unix 0xffff903dd80e6e80 0t0 12731 type=STREAM (CONNECTED) 2023-07-21T22:37:00.281 INFO:teuthology.orchestra.run.smithi123.stdout:auditd 690 693 auditd root 10u a_inode 0,14 0 12292 [eventfd:0] 2023-07-21T22:37:00.281 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.282 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.282 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root txt REG 8,1 19624 11329 /usr/sbin/sedispatch 2023-07-21T22:37:00.282 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.282 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.283 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.283 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.283 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.283 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.283 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.284 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.284 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.284 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.284 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.284 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.285 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 144728 9145 /usr/lib64/libauparse.so.0.0.0 2023-07-21T22:37:00.285 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.285 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.285 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.285 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root 0u unix 0xffff903dd80e2a80 0t0 12727 type=STREAM (CONNECTED) 2023-07-21T22:37:00.286 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.286 INFO:teuthology.orchestra.run.smithi123.stdout:sedispatc 692 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.286 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.286 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.286 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus txt REG 8,1 131896 10627 /usr/bin/dbus-broker-launch 2023-07-21T22:37:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus DEL REG 0,1 3072 /memfd:dbus-broker-log 2023-07-21T22:37:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.288 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.288 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.288 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.288 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.288 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.289 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.289 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.289 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.289 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.289 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.290 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.290 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.290 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.290 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 1u unix 0xffff903dd81eaec0 0t0 18707 type=STREAM (CONNECTED) 2023-07-21T22:37:00.290 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 2u unix 0xffff903dd81eaec0 0t0 18707 type=STREAM (CONNECTED) 2023-07-21T22:37:00.291 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 3u unix 0xffff903dd80e72c0 0t0 12745 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-07-21T22:37:00.291 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 4u unix 0xffff903dd81f5940 0t0 18717 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.291 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 5u a_inode 0,14 0 12292 [eventpoll:6,7,8,9,10,11] 2023-07-21T22:37:00.291 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 6u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.292 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 7r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.292 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 8u unix 0xffff903dd81eb300 0t0 18719 type=STREAM (CONNECTED) 2023-07-21T22:37:00.292 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 9u unix 0xffff903dd81ea640 0t0 18724 type=STREAM (CONNECTED) 2023-07-21T22:37:00.292 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 10u a_inode 0,14 0 12292 [pidfd:714] 2023-07-21T22:37:00.292 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 11u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 713 dbus 12u REG 0,1 2097152 3072 /memfd:dbus-broker-log (deleted) 2023-07-21T22:37:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus txt REG 8,1 236336 10626 /usr/bin/dbus-broker 2023-07-21T22:37:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.294 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.294 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.294 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.294 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.294 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.295 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.295 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.295 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.295 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.295 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 1u unix 0xffff903dd81eaec0 0t0 18707 type=STREAM (CONNECTED) 2023-07-21T22:37:00.296 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 2u unix 0xffff903dd81eaec0 0t0 18707 type=STREAM (CONNECTED) 2023-07-21T22:37:00.296 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 3u sock 0,8 0t0 20603 protocol: NETLINK 2023-07-21T22:37:00.296 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 4u unix 0xffff903dd81f5940 0t0 18717 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.296 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 5u a_inode 0,14 0 12292 [eventpoll:6,7,8,9,10,11,12,13,17,18,19] 2023-07-21T22:37:00.297 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 6u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.297 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 7u unix 0xffff903dd80e72c0 0t0 12745 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-07-21T22:37:00.297 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 8u unix 0xffff903dd80e1980 0t0 19665 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.297 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 9u unix 0xffff903dd81e8cc0 0t0 18720 type=STREAM (CONNECTED) 2023-07-21T22:37:00.297 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 10u unix 0xffff903dd81eee80 0t0 19667 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 11u unix 0xffff903dd81eea40 0t0 19674 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 12u unix 0xffff903dc7b66e80 0t0 20623 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 13u unix 0xffff903dd80e7700 0t0 20625 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 17u unix 0xffff903dd81e9dc0 0t0 21879 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 18u unix 0xffff903dc7b61100 0t0 21921 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.299 INFO:teuthology.orchestra.run.smithi123.stdout:dbus-brok 714 dbus 19u unix 0xffff903dd81ed0c0 0t0 24599 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.299 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.299 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.299 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root txt REG 8,1 3537496 11048 /usr/sbin/NetworkManager 2023-07-21T22:37:00.299 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.300 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 317560 45279 /usr/lib64/NetworkManager/1.41.8-1.el9/libnm-settings-plugin-ifcfg-rh.so 2023-07-21T22:37:00.300 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.300 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 62456 9196 /usr/lib64/libjansson.so.4.14.0 2023-07-21T22:37:00.300 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 31792 10368 /usr/lib64/libteamdctl.so.0.1.5 2023-07-21T22:37:00.300 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 52920 46945 /usr/lib64/NetworkManager/1.41.8-1.el9/libnm-device-plugin-team.so 2023-07-21T22:37:00.301 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.301 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.301 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.301 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.301 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.302 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.302 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 138712 9304 /usr/lib64/libbrotlicommon.so.1.0.9 2023-07-21T22:37:00.302 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.302 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 366424 9825 /usr/lib64/libevent-2.1.so.7.0.1 2023-07-21T22:37:00.302 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.303 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.303 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.303 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.303 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.303 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.304 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.304 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.304 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 70400 10834 /usr/lib64/liblber.so.2.0.200 2023-07-21T22:37:00.304 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 417696 10838 /usr/lib64/libldap_r.so.2.0.200 2023-07-21T22:37:00.304 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.305 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.305 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.305 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.305 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 53048 9306 /usr/lib64/libbrotlidec.so.1.0.9 2023-07-21T22:37:00.305 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.305 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.306 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.306 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 77488 9302 /usr/lib64/libpsl.so.5.3.3 2023-07-21T22:37:00.306 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 479560 10896 /usr/lib64/libssh.so.4.9.4 2023-07-21T22:37:00.306 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 169704 10791 /usr/lib64/libnghttp2.so.14.20.1 2023-07-21T22:37:00.306 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.307 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.307 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.307 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.307 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 626152 9403 /usr/lib64/libhogweed.so.6.5 2023-07-21T22:37:00.307 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 1591920 9148 /usr/lib64/libunistring.so.2.1.0 2023-07-21T22:37:00.308 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.308 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.308 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.308 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.309 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.309 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 340456 9405 /usr/lib64/libnettle.so.8.5 2023-07-21T22:37:00.309 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 94112 9315 /usr/lib64/libtasn1.so.6.6.0 2023-07-21T22:37:00.309 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 130952 9186 /usr/lib64/libidn2.so.0.3.7 2023-07-21T22:37:00.309 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.310 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.310 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.310 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.310 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.310 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 662296 10900 /usr/lib64/libcurl.so.4.7.0 2023-07-21T22:37:00.310 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.311 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 2291592 9409 /usr/lib64/libgnutls.so.30.33.1 2023-07-21T22:37:00.311 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.311 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.311 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 32408 10748 /usr/lib64/libndp.so.0.2.0 2023-07-21T22:37:00.311 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 200136 9539 /usr/lib64/libudev.so.1.7.5 2023-07-21T22:37:00.312 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.312 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.312 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.312 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.312 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.313 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.313 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.313 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.313 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.313 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 1u unix 0xffff903dd827bb80 0t0 2464 type=STREAM (CONNECTED) 2023-07-21T22:37:00.314 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 2u unix 0xffff903dd827bb80 0t0 2464 type=STREAM (CONNECTED) 2023-07-21T22:37:00.314 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 3u a_inode 0,14 0 12292 [eventfd:6] 2023-07-21T22:37:00.314 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 4u a_inode 0,14 0 12292 [eventfd:7] 2023-07-21T22:37:00.314 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 5u unix 0xffff903dd80eea40 0t0 12816 type=DGRAM (UNCONNECTED) 2023-07-21T22:37:00.322 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 6u unix 0xffff903dd80e0880 0t0 12817 type=STREAM (CONNECTED) 2023-07-21T22:37:00.322 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 7u a_inode 0,14 0 12292 [eventfd:8] 2023-07-21T22:37:00.323 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 8r REG 0,4 0 4026531840 net 2023-07-21T22:37:00.323 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 9r REG 0,4 0 4026532495 mnt 2023-07-21T22:37:00.323 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 10u netlink 0t0 12821 KOBJECT_UEVENT 2023-07-21T22:37:00.323 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 11u netlink 0t0 12822 GENERIC 2023-07-21T22:37:00.323 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 12u netlink 0t0 12823 GENERIC 2023-07-21T22:37:00.324 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 13u netlink 0t0 12824 ROUTE 2023-07-21T22:37:00.324 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 14r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.324 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 15r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.324 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 16u netlink 0t0 2512 KOBJECT_UEVENT 2023-07-21T22:37:00.324 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 17u unix 0xffff903dd81eaa80 0t0 18792 type=STREAM (CONNECTED) 2023-07-21T22:37:00.325 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 18u a_inode 0,14 0 12292 [eventpoll] 2023-07-21T22:37:00.325 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 19w FIFO 0,24 0t0 1173 /run/systemd/inhibit/1.ref 2023-07-21T22:37:00.325 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 20u a_inode 0,14 0 12292 [eventpoll:21,27] 2023-07-21T22:37:00.325 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 21u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.325 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 23u raw6 0t0 17400 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-07-21T22:37:00.326 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 root 27u IPv4 23566 0t0 UDP smithi123.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-21T22:37:00.326 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.326 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.326 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root txt REG 8,1 3537496 11048 /usr/sbin/NetworkManager 2023-07-21T22:37:00.326 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.327 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 317560 45279 /usr/lib64/NetworkManager/1.41.8-1.el9/libnm-settings-plugin-ifcfg-rh.so 2023-07-21T22:37:00.327 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.327 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 62456 9196 /usr/lib64/libjansson.so.4.14.0 2023-07-21T22:37:00.327 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 31792 10368 /usr/lib64/libteamdctl.so.0.1.5 2023-07-21T22:37:00.327 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 52920 46945 /usr/lib64/NetworkManager/1.41.8-1.el9/libnm-device-plugin-team.so 2023-07-21T22:37:00.328 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.328 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.328 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.328 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.328 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.329 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.329 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 138712 9304 /usr/lib64/libbrotlicommon.so.1.0.9 2023-07-21T22:37:00.329 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.329 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 366424 9825 /usr/lib64/libevent-2.1.so.7.0.1 2023-07-21T22:37:00.329 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.330 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.330 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.330 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.330 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.330 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.331 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.331 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.331 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 70400 10834 /usr/lib64/liblber.so.2.0.200 2023-07-21T22:37:00.331 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 417696 10838 /usr/lib64/libldap_r.so.2.0.200 2023-07-21T22:37:00.331 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.332 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.332 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.332 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.332 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 53048 9306 /usr/lib64/libbrotlidec.so.1.0.9 2023-07-21T22:37:00.332 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.333 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.333 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.333 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 77488 9302 /usr/lib64/libpsl.so.5.3.3 2023-07-21T22:37:00.333 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 479560 10896 /usr/lib64/libssh.so.4.9.4 2023-07-21T22:37:00.333 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 169704 10791 /usr/lib64/libnghttp2.so.14.20.1 2023-07-21T22:37:00.334 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.334 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.334 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.334 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.334 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 626152 9403 /usr/lib64/libhogweed.so.6.5 2023-07-21T22:37:00.335 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 1591920 9148 /usr/lib64/libunistring.so.2.1.0 2023-07-21T22:37:00.335 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.335 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.335 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.335 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.336 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.336 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 340456 9405 /usr/lib64/libnettle.so.8.5 2023-07-21T22:37:00.336 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 94112 9315 /usr/lib64/libtasn1.so.6.6.0 2023-07-21T22:37:00.336 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 130952 9186 /usr/lib64/libidn2.so.0.3.7 2023-07-21T22:37:00.336 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.337 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.337 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.337 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.337 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.337 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 662296 10900 /usr/lib64/libcurl.so.4.7.0 2023-07-21T22:37:00.338 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.338 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 2291592 9409 /usr/lib64/libgnutls.so.30.33.1 2023-07-21T22:37:00.338 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.338 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.338 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 32408 10748 /usr/lib64/libndp.so.0.2.0 2023-07-21T22:37:00.339 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 200136 9539 /usr/lib64/libudev.so.1.7.5 2023-07-21T22:37:00.339 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.339 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.339 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.339 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.341 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 1u unix 0xffff903dd827bb80 0t0 2464 type=STREAM (CONNECTED) 2023-07-21T22:37:00.341 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 2u unix 0xffff903dd827bb80 0t0 2464 type=STREAM (CONNECTED) 2023-07-21T22:37:00.341 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 3u a_inode 0,14 0 12292 [eventfd:6] 2023-07-21T22:37:00.341 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 4u a_inode 0,14 0 12292 [eventfd:7] 2023-07-21T22:37:00.341 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 5u unix 0xffff903dd80eea40 0t0 12816 type=DGRAM (UNCONNECTED) 2023-07-21T22:37:00.342 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 6u unix 0xffff903dd80e0880 0t0 12817 type=STREAM (CONNECTED) 2023-07-21T22:37:00.342 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 7u a_inode 0,14 0 12292 [eventfd:8] 2023-07-21T22:37:00.342 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 8r REG 0,4 0 4026531840 net 2023-07-21T22:37:00.342 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 9r REG 0,4 0 4026532495 mnt 2023-07-21T22:37:00.342 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 10u netlink 0t0 12821 KOBJECT_UEVENT 2023-07-21T22:37:00.343 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 11u netlink 0t0 12822 GENERIC 2023-07-21T22:37:00.343 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 12u netlink 0t0 12823 GENERIC 2023-07-21T22:37:00.343 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 13u netlink 0t0 12824 ROUTE 2023-07-21T22:37:00.343 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 14r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.343 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 15r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.344 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 16u netlink 0t0 2512 KOBJECT_UEVENT 2023-07-21T22:37:00.344 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 17u unix 0xffff903dd81eaa80 0t0 18792 type=STREAM (CONNECTED) 2023-07-21T22:37:00.344 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 18u a_inode 0,14 0 12292 [eventpoll] 2023-07-21T22:37:00.344 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 19w FIFO 0,24 0t0 1173 /run/systemd/inhibit/1.ref 2023-07-21T22:37:00.344 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 20u a_inode 0,14 0 12292 [eventpoll:21,27] 2023-07-21T22:37:00.345 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 21u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.345 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 23u raw6 0t0 17400 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-07-21T22:37:00.345 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 739 gmain root 27u IPv4 23566 0t0 UDP smithi123.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-21T22:37:00.345 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.345 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root txt REG 8,1 3537496 11048 /usr/sbin/NetworkManager 2023-07-21T22:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 317560 45279 /usr/lib64/NetworkManager/1.41.8-1.el9/libnm-settings-plugin-ifcfg-rh.so 2023-07-21T22:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 62456 9196 /usr/lib64/libjansson.so.4.14.0 2023-07-21T22:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 31792 10368 /usr/lib64/libteamdctl.so.0.1.5 2023-07-21T22:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 52920 46945 /usr/lib64/NetworkManager/1.41.8-1.el9/libnm-device-plugin-team.so 2023-07-21T22:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.348 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.348 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.348 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 138712 9304 /usr/lib64/libbrotlicommon.so.1.0.9 2023-07-21T22:37:00.348 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 366424 9825 /usr/lib64/libevent-2.1.so.7.0.1 2023-07-21T22:37:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 70400 10834 /usr/lib64/liblber.so.2.0.200 2023-07-21T22:37:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 417696 10838 /usr/lib64/libldap_r.so.2.0.200 2023-07-21T22:37:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 53048 9306 /usr/lib64/libbrotlidec.so.1.0.9 2023-07-21T22:37:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 77488 9302 /usr/lib64/libpsl.so.5.3.3 2023-07-21T22:37:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 479560 10896 /usr/lib64/libssh.so.4.9.4 2023-07-21T22:37:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 169704 10791 /usr/lib64/libnghttp2.so.14.20.1 2023-07-21T22:37:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 626152 9403 /usr/lib64/libhogweed.so.6.5 2023-07-21T22:37:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 1591920 9148 /usr/lib64/libunistring.so.2.1.0 2023-07-21T22:37:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 340456 9405 /usr/lib64/libnettle.so.8.5 2023-07-21T22:37:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 94112 9315 /usr/lib64/libtasn1.so.6.6.0 2023-07-21T22:37:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 130952 9186 /usr/lib64/libidn2.so.0.3.7 2023-07-21T22:37:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 662296 10900 /usr/lib64/libcurl.so.4.7.0 2023-07-21T22:37:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 2291592 9409 /usr/lib64/libgnutls.so.30.33.1 2023-07-21T22:37:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 32408 10748 /usr/lib64/libndp.so.0.2.0 2023-07-21T22:37:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 200136 9539 /usr/lib64/libudev.so.1.7.5 2023-07-21T22:37:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.360 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 1u unix 0xffff903dd827bb80 0t0 2464 type=STREAM (CONNECTED) 2023-07-21T22:37:00.360 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 2u unix 0xffff903dd827bb80 0t0 2464 type=STREAM (CONNECTED) 2023-07-21T22:37:00.360 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 3u a_inode 0,14 0 12292 [eventfd:6] 2023-07-21T22:37:00.360 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 4u a_inode 0,14 0 12292 [eventfd:7] 2023-07-21T22:37:00.361 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 5u unix 0xffff903dd80eea40 0t0 12816 type=DGRAM (UNCONNECTED) 2023-07-21T22:37:00.361 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 6u unix 0xffff903dd80e0880 0t0 12817 type=STREAM (CONNECTED) 2023-07-21T22:37:00.361 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 7u a_inode 0,14 0 12292 [eventfd:8] 2023-07-21T22:37:00.361 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 8r REG 0,4 0 4026531840 net 2023-07-21T22:37:00.361 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-07-21T22:37:00.362 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 10u netlink 0t0 12821 KOBJECT_UEVENT 2023-07-21T22:37:00.362 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 11u netlink 0t0 12822 GENERIC 2023-07-21T22:37:00.362 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 12u netlink 0t0 12823 GENERIC 2023-07-21T22:37:00.362 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 13u netlink 0t0 12824 ROUTE 2023-07-21T22:37:00.362 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 14r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.362 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 15r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.363 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 16u netlink 0t0 2512 KOBJECT_UEVENT 2023-07-21T22:37:00.363 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 17u unix 0xffff903dd81eaa80 0t0 18792 type=STREAM (CONNECTED) 2023-07-21T22:37:00.363 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 18u a_inode 0,14 0 12292 [eventpoll] 2023-07-21T22:37:00.363 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 19w FIFO 0,24 0t0 1173 /run/systemd/inhibit/1.ref 2023-07-21T22:37:00.363 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 20u a_inode 0,14 0 12292 [eventpoll:21,27] 2023-07-21T22:37:00.364 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 21u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.364 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 23u raw6 0t0 17400 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-07-21T22:37:00.364 INFO:teuthology.orchestra.run.smithi123.stdout:NetworkMa 715 748 gdbus root 27u IPv4 23566 0t0 UDP smithi123.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-21T22:37:00.364 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.364 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.365 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root txt REG 8,1 61904 12068 /usr/sbin/irqbalance 2023-07-21T22:37:00.365 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.365 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.365 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.365 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 54392 9412 /usr/lib64/libnuma.so.1.0.0 2023-07-21T22:37:00.366 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.366 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.366 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.366 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.366 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root 1u unix 0xffff903dd81ebfc0 0t0 18725 type=STREAM (CONNECTED) 2023-07-21T22:37:00.367 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root 2u unix 0xffff903dd81ebfc0 0t0 18725 type=STREAM (CONNECTED) 2023-07-21T22:37:00.367 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root 3u a_inode 0,14 0 12292 [eventfd:1] 2023-07-21T22:37:00.367 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root 4u a_inode 0,14 0 12292 [eventfd:2] 2023-07-21T22:37:00.367 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 root 5u unix 0xffff903dd80e50c0 0t0 12790 /run/irqbalance/irqbalance718.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.367 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.368 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.368 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root txt REG 8,1 61904 12068 /usr/sbin/irqbalance 2023-07-21T22:37:00.368 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.368 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.368 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.369 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 54392 9412 /usr/lib64/libnuma.so.1.0.0 2023-07-21T22:37:00.369 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.369 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.369 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.369 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.370 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root 1u unix 0xffff903dd81ebfc0 0t0 18725 type=STREAM (CONNECTED) 2023-07-21T22:37:00.370 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root 2u unix 0xffff903dd81ebfc0 0t0 18725 type=STREAM (CONNECTED) 2023-07-21T22:37:00.370 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root 3u a_inode 0,14 0 12292 [eventfd:1] 2023-07-21T22:37:00.370 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root 4u a_inode 0,14 0 12292 [eventfd:2] 2023-07-21T22:37:00.370 INFO:teuthology.orchestra.run.smithi123.stdout:irqbalanc 718 726 gmain root 5u unix 0xffff903dd80e50c0 0t0 12790 /run/irqbalance/irqbalance718.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.370 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.371 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.371 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt txt REG 8,1 32280 10707 /usr/bin/lsmd 2023-07-21T22:37:00.371 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.371 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt mem REG 8,1 56912 10225 /usr/lib64/libconfig.so.11.0.2 2023-07-21T22:37:00.371 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.372 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.372 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt 1u unix 0xffff903dd8194840 0t0 19669 type=STREAM (CONNECTED) 2023-07-21T22:37:00.372 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt 2u unix 0xffff903dd8194840 0t0 19669 type=STREAM (CONNECTED) 2023-07-21T22:37:00.372 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt 3uW REG 0,24 0 1110 /run/lsm/ipc/.lsmd-ipc-lock 2023-07-21T22:37:00.372 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt 5u unix 0xffff903dd827bfc0 0t0 2483 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-07-21T22:37:00.373 INFO:teuthology.orchestra.run.smithi123.stdout:lsmd 719 libstoragemgmt 6u unix 0xffff903dd827a200 0t0 2484 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-07-21T22:37:00.373 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.373 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.373 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root txt REG 8,1 180192 11906 /usr/sbin/mcelog 2023-07-21T22:37:00.374 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.374 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.374 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.374 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root 1u unix 0xffff903dd8278cc0 0t0 2474 type=STREAM (CONNECTED) 2023-07-21T22:37:00.374 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root 2u unix 0xffff903dd8278cc0 0t0 2474 type=STREAM (CONNECTED) 2023-07-21T22:37:00.374 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-07-21T22:37:00.375 INFO:teuthology.orchestra.run.smithi123.stdout:mcelog 720 root 4u unix 0xffff903dd827ee80 0t0 2482 /var/run/mcelog-client type=STREAM (LISTEN) 2023-07-21T22:37:00.375 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.375 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.375 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.375 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.376 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.376 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.376 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.376 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.376 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.377 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.377 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.377 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.377 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.377 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.378 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.378 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.378 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.378 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.378 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.379 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.379 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.379 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.379 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.379 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.380 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.380 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.380 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.380 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.380 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.381 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.381 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.381 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.381 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.381 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.382 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.382 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.382 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.382 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.382 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.383 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.383 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.383 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.383 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.383 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.383 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.384 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.384 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.384 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.384 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.384 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.385 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.385 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.385 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.385 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.385 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.386 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.386 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.386 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.386 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.387 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.387 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.387 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.387 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.387 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.387 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.388 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.388 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.388 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.388 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.388 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.389 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.389 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.389 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.389 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.389 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.390 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.390 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.390 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.390 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.390 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.391 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.391 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 737 gmain polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.391 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.391 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.391 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.392 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.392 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.392 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.392 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.392 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.393 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.393 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.393 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.393 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.393 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.394 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.394 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.394 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.394 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.394 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.395 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.395 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.395 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.395 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.395 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.395 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.396 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.396 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.396 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.396 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.396 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.397 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.397 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.397 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.397 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.397 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.398 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.398 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.398 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.398 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.398 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.399 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.399 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 738 gdbus polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.399 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.399 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.399 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.400 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.400 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.400 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.400 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.400 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.401 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.401 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.401 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.401 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.401 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.402 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.402 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.402 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.402 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.402 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.403 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.403 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.403 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.403 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.403 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.404 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.404 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.404 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.404 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.404 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.405 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.405 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.405 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.405 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.405 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.406 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.406 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.406 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.406 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.406 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.406 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.407 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.407 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 740 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.407 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.407 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.407 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.408 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.408 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.408 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.408 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.408 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.409 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.409 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.409 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.409 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.409 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.410 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.410 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.410 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.410 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.410 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.411 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.411 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.411 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.411 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.411 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.412 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.412 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.412 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.412 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.412 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.413 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.413 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.413 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.413 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.413 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.414 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.414 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.414 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.414 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.414 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.415 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.415 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.415 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 741 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.415 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.415 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.417 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.417 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.417 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.417 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.417 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.418 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.418 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.418 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.418 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.418 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.418 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.419 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.419 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.419 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.419 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.419 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.420 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.420 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.420 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.420 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.420 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.421 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.421 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.421 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.421 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.421 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.422 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.422 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.422 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.422 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.422 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.423 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.423 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.423 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 742 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.423 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.423 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.424 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.424 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.424 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.424 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.424 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.425 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.425 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.425 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.425 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.425 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.426 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.426 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.426 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.426 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.426 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.427 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.427 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.427 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.427 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.427 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.428 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.428 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.428 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.428 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.428 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.428 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.429 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.429 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.429 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.429 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.429 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.430 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.430 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.430 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.430 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.430 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.431 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.431 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.431 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 743 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.431 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.431 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.432 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.432 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.432 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.432 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.432 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.433 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.433 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.433 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.433 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.433 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.434 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.434 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.434 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.434 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.434 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.435 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.435 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.435 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.435 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.435 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.436 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.436 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.436 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.436 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.436 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.438 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.438 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.438 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.438 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.439 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.439 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.439 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.439 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 744 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.439 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.440 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.440 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.440 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.440 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.440 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.442 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.442 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.442 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.442 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.442 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.443 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.443 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.443 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.443 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.443 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.444 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.444 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.444 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.444 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.444 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.445 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.445 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.445 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.445 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.445 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.446 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.446 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.446 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.446 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.446 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.446 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.447 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.447 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.447 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 745 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.447 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.447 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.448 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.448 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.448 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.448 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.448 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.449 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.449 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.449 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.449 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.449 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.450 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.450 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.450 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.450 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.450 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.451 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.451 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.451 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.451 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.451 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.452 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.452 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.452 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.452 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.452 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.453 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.453 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.453 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.453 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.453 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.454 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.454 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.454 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.454 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.454 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.455 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.455 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.455 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.455 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 746 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.455 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.455 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.456 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.456 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.456 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.456 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.456 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.457 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.457 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.457 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.457 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.457 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.458 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.458 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.458 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.458 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.458 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.459 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.459 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.459 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.459 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.459 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.460 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.460 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.460 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.460 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.460 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.461 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.461 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.461 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.461 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.461 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.461 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.462 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.462 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.462 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.462 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.462 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.463 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.463 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.463 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 747 JS\x20Hel polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.463 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.463 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.464 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd txt REG 8,1 146624 43518 /usr/lib/polkit-1/polkitd 2023-07-21T22:37:00.464 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.464 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.464 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.464 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.465 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.465 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.465 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.465 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.465 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.466 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.466 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.466 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 29047400 31108 /usr/lib64/polkit-1/libmozjs-78.so 2023-07-21T22:37:00.466 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.466 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.467 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.467 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.467 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.467 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.467 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.468 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.468 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.468 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.468 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.468 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.469 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.469 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 132488 9593 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-21T22:37:00.469 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.469 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.469 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.470 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.470 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 3r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.470 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 4u a_inode 0,14 0 12292 [eventfd:3] 2023-07-21T22:37:00.470 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 5u a_inode 0,14 0 12292 [eventfd:4] 2023-07-21T22:37:00.470 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 6u unix 0xffff903dc7b62640 0t0 22547 type=STREAM (CONNECTED) 2023-07-21T22:37:00.471 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 7u a_inode 0,14 0 12292 [eventfd:5] 2023-07-21T22:37:00.471 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 8r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.471 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 9u a_inode 0,14 0 12292 [eventfd:9] 2023-07-21T22:37:00.471 INFO:teuthology.orchestra.run.smithi123.stdout:polkitd 721 759 polkitd polkitd 10u unix 0xffff903dcb6a6600 0t0 21874 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.471 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root txt REG 8,1 306888 16849 /usr/lib/systemd/systemd-logind 2023-07-21T22:37:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 593150 111 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-21T22:37:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.473 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.473 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.473 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.473 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.473 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.473 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 21219 28863 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-21T22:37:00.474 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.474 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.474 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.474 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.474 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.475 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.475 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.475 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 3640680 43416 /usr/lib64/systemd/libsystemd-shared-252.so 2023-07-21T22:37:00.475 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.475 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.476 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.476 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.476 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.476 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.477 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.477 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 107984 9595 /usr/lib64/libkmod.so.2.3.6 2023-07-21T22:37:00.477 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.477 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.478 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.478 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.478 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.478 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.478 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.478 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.479 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 1u unix 0xffff903dd81ecc80 0t0 18740 type=STREAM (CONNECTED) 2023-07-21T22:37:00.479 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 2u unix 0xffff903dd81ecc80 0t0 18740 type=STREAM (CONNECTED) 2023-07-21T22:37:00.479 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 3u unix 0xffff903dd81f50c0 0t0 18765 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.479 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 4u a_inode 0,14 0 12292 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20,21,22] 2023-07-21T22:37:00.479 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 5u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.480 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 6u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.480 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 7r REG 0,21 4096 22877 /sys/devices/virtual/tty/tty0/active 2023-07-21T22:37:00.480 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 8u netlink 0t0 18776 KOBJECT_UEVENT 2023-07-21T22:37:00.480 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 9r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.480 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 10r FIFO 0,24 0t0 1173 /run/systemd/inhibit/1.ref 2023-07-21T22:37:00.481 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 11u netlink 0t0 18777 KOBJECT_UEVENT 2023-07-21T22:37:00.481 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 12u netlink 0t0 18778 KOBJECT_UEVENT 2023-07-21T22:37:00.481 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 13u netlink 0t0 18779 KOBJECT_UEVENT 2023-07-21T22:37:00.481 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 14u unix 0xffff903dd81e8440 0t0 18780 type=STREAM (CONNECTED) 2023-07-21T22:37:00.481 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 15u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 16u CHR 13,65 0t0 126 /dev/input/event1 2023-07-21T22:37:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 17u CHR 13,64 0t0 125 /dev/input/event0 2023-07-21T22:37:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 18u CHR 13,66 0t0 155 /dev/input/event2 2023-07-21T22:37:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-07-21T22:37:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 20r FIFO 0,24 0t0 1634 /run/systemd/sessions/4.ref 2023-07-21T22:37:00.483 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 21r FIFO 0,24 0t0 1254 /run/systemd/sessions/3.ref 2023-07-21T22:37:00.483 INFO:teuthology.orchestra.run.smithi123.stdout:systemd-l 725 root 22r FIFO 0,24 0t0 1647 /run/systemd/sessions/5.ref 2023-07-21T22:37:00.483 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.483 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.483 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:00.484 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.484 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.484 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.484 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.484 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.485 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.485 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.485 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.485 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.485 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.486 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.486 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.486 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.486 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.486 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.487 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.487 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.487 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.487 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.487 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.488 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.488 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.488 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.488 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.488 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.489 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.489 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.489 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.489 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root 1u unix 0xffff903dc7b63fc0 0t0 22548 type=STREAM (CONNECTED) 2023-07-21T22:37:00.489 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root 2u unix 0xffff903dc7b63fc0 0t0 22548 type=STREAM (CONNECTED) 2023-07-21T22:37:00.490 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root 3u IPv4 17359 0t0 TCP *:ssh (LISTEN) 2023-07-21T22:37:00.490 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 751 root 4u IPv6 17361 0t0 TCP *:ssh (LISTEN) 2023-07-21T22:37:00.490 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.490 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.490 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root txt REG 8,1 15448 9913 /usr/bin/python3.9 2023-07-21T22:37:00.491 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 200136 9539 /usr/lib64/libudev.so.1.7.5 2023-07-21T22:37:00.491 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 130456 32336 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.491 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 107744 32339 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.491 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 204696 31136 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-21T22:37:00.491 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.492 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.492 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.492 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.492 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.492 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.493 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.493 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.493 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 143200 9609 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-21T22:37:00.493 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 357112 33457 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.493 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.493 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.494 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 24736 33337 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-07-21T22:37:00.494 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.494 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 71416 32375 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.494 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.494 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.495 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.495 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.495 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.495 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.495 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.496 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.496 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 171376 33336 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-07-21T22:37:00.496 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 23800 32354 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.496 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.496 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 46560 32348 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.497 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 76792 9115 /usr/lib64/libbz2.so.1.0.8 2023-07-21T22:37:00.497 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 29232 32326 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.497 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 41752 32384 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.497 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.497 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 50224 32325 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.498 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.498 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 20000 32370 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.498 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 69040 32344 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.498 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 24160 32356 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.498 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 124192 32352 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 56416 32361 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 68000 32365 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 23832 32369 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 15984 32324 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.500 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 71616 32371 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.500 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.500 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 3474032 9915 /usr/lib64/libpython3.9.so.1.0 2023-07-21T22:37:00.500 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 15560 32351 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.500 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 28064 32345 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.501 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 37592 32378 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.501 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 101216 32357 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.501 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.501 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.501 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 20528 32355 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.502 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.502 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.502 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 1u unix 0xffff903dd8195500 0t0 19696 type=STREAM (CONNECTED) 2023-07-21T22:37:00.502 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 2u unix 0xffff903dd8195500 0t0 19696 type=STREAM (CONNECTED) 2023-07-21T22:37:00.502 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 3w REG 8,1 15044 1713 /var/log/tuned/tuned.log 2023-07-21T22:37:00.503 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 4u sock 0,8 0t0 22579 protocol: NETLINK 2023-07-21T22:37:00.503 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 5u unix 0xffff903dc7b64c80 0t0 22583 type=STREAM (CONNECTED) 2023-07-21T22:37:00.503 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 6u a_inode 0,14 0 12292 [eventfd:17] 2023-07-21T22:37:00.503 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 7u unix 0xffff903dd827f2c0 0t0 2623 type=STREAM (CONNECTED) 2023-07-21T22:37:00.503 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 root 8u unix 0xffff903dd827c400 0t0 2624 type=STREAM (CONNECTED) 2023-07-21T22:37:00.504 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.504 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.504 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root txt REG 8,1 15448 9913 /usr/bin/python3.9 2023-07-21T22:37:00.504 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 200136 9539 /usr/lib64/libudev.so.1.7.5 2023-07-21T22:37:00.504 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 130456 32336 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.505 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 107744 32339 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.505 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 204696 31136 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-21T22:37:00.505 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.505 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.505 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.506 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.506 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.506 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.506 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.506 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.507 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 143200 9609 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-21T22:37:00.507 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 357112 33457 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.507 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.507 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.507 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 24736 33337 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-07-21T22:37:00.507 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 71416 32375 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.509 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.509 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.509 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.509 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.509 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 171376 33336 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-07-21T22:37:00.510 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 23800 32354 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.510 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.510 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 46560 32348 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.510 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 76792 9115 /usr/lib64/libbz2.so.1.0.8 2023-07-21T22:37:00.510 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 29232 32326 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.511 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 41752 32384 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.511 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.511 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 50224 32325 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.511 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.511 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 20000 32370 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.512 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 69040 32344 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.512 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 24160 32356 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.512 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 124192 32352 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.512 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 56416 32361 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.512 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 68000 32365 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.513 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 23832 32369 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.513 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.513 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 15984 32324 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.513 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 71616 32371 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.513 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.514 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 3474032 9915 /usr/lib64/libpython3.9.so.1.0 2023-07-21T22:37:00.514 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 15560 32351 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.514 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 28064 32345 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.514 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 37592 32378 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.514 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 101216 32357 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.515 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.515 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.515 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 20528 32355 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.515 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.515 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.516 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 1u unix 0xffff903dd8195500 0t0 19696 type=STREAM (CONNECTED) 2023-07-21T22:37:00.516 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 2u unix 0xffff903dd8195500 0t0 19696 type=STREAM (CONNECTED) 2023-07-21T22:37:00.516 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 3w REG 8,1 15044 1713 /var/log/tuned/tuned.log 2023-07-21T22:37:00.516 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 4u sock 0,8 0t0 22579 protocol: NETLINK 2023-07-21T22:37:00.516 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 5u unix 0xffff903dc7b64c80 0t0 22583 type=STREAM (CONNECTED) 2023-07-21T22:37:00.517 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 6u a_inode 0,14 0 12292 [eventfd:17] 2023-07-21T22:37:00.517 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 7u unix 0xffff903dd827f2c0 0t0 2623 type=STREAM (CONNECTED) 2023-07-21T22:37:00.517 INFO:teuthology.orchestra.run.smithi123.stdout:tuned 752 862 tuned root 8u unix 0xffff903dd827c400 0t0 2624 type=STREAM (CONNECTED) 2023-07-21T22:37:00.517 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.517 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.518 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root txt REG 8,1 128840 2325 /usr/sbin/gssproxy 2023-07-21T22:37:00.518 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.518 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.518 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.518 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 70960 2316 /usr/lib64/libev.so.4.0.0 2023-07-21T22:37:00.519 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.519 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.519 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.519 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 16168 2319 /usr/lib64/libverto-libev.so.1.0.0 2023-07-21T22:37:00.519 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.519 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.520 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.520 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.520 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.520 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 15912 9178 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-21T22:37:00.520 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 20304 9382 /usr/lib64/libpath_utils.so.1.0.1 2023-07-21T22:37:00.521 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 58392 9180 /usr/lib64/libcollection.so.4.1.1 2023-07-21T22:37:00.521 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.521 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.521 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.521 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.522 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.522 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 143040 10810 /usr/lib64/libgssrpc.so.4.2 2023-07-21T22:37:00.522 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.522 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 16056 9182 /usr/lib64/libref_array.so.1.2.1 2023-07-21T22:37:00.522 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 120640 9384 /usr/lib64/libini_config.so.5.2.1 2023-07-21T22:37:00.523 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 28472 10806 /usr/lib64/libverto.so.1.0.0 2023-07-21T22:37:00.523 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.523 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.523 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.523 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.524 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.524 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.524 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.524 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.524 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.525 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.525 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.525 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.525 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 1u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.525 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 2u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.526 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 3u unix 0xffff903dd838b740 0t0 17324 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.526 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 4r FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.526 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 5u a_inode 0,14 0 12292 [eventpoll:4,6,7,8] 2023-07-21T22:37:00.526 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 6u a_inode 0,14 0 12292 [eventfd:13] 2023-07-21T22:37:00.526 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 7u unix 0xffff903dc8308cc0 0t0 17325 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.527 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 8u unix 0xffff903dc830b300 0t0 17326 /run/gssproxy.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.527 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 root 9w FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.527 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.527 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.527 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root txt REG 8,1 128840 2325 /usr/sbin/gssproxy 2023-07-21T22:37:00.528 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.528 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.528 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.528 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 70960 2316 /usr/lib64/libev.so.4.0.0 2023-07-21T22:37:00.528 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 16168 2319 /usr/lib64/libverto-libev.so.1.0.0 2023-07-21T22:37:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 15912 9178 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-21T22:37:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 20304 9382 /usr/lib64/libpath_utils.so.1.0.1 2023-07-21T22:37:00.531 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 58392 9180 /usr/lib64/libcollection.so.4.1.1 2023-07-21T22:37:00.531 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.531 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.531 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.531 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 143040 10810 /usr/lib64/libgssrpc.so.4.2 2023-07-21T22:37:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 16056 9182 /usr/lib64/libref_array.so.1.2.1 2023-07-21T22:37:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 120640 9384 /usr/lib64/libini_config.so.5.2.1 2023-07-21T22:37:00.532 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 28472 10806 /usr/lib64/libverto.so.1.0.0 2023-07-21T22:37:00.533 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.533 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.533 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.533 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.533 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.534 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.534 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.534 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.534 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.534 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.535 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.535 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.535 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 1u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.535 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 2u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.535 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 3u unix 0xffff903dd838b740 0t0 17324 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.536 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 4r FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.536 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 5u a_inode 0,14 0 12292 [eventpoll:4,6,7,8] 2023-07-21T22:37:00.536 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 6u a_inode 0,14 0 12292 [eventfd:13] 2023-07-21T22:37:00.536 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 7u unix 0xffff903dc8308cc0 0t0 17325 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.536 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 8u unix 0xffff903dc830b300 0t0 17326 /run/gssproxy.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.537 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 762 gssproxy root 9w FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.537 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.537 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.537 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root txt REG 8,1 128840 2325 /usr/sbin/gssproxy 2023-07-21T22:37:00.537 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.538 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.538 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.538 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 70960 2316 /usr/lib64/libev.so.4.0.0 2023-07-21T22:37:00.538 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.538 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.539 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.539 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 16168 2319 /usr/lib64/libverto-libev.so.1.0.0 2023-07-21T22:37:00.539 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.539 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.539 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.540 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.540 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.540 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 15912 9178 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-21T22:37:00.540 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 20304 9382 /usr/lib64/libpath_utils.so.1.0.1 2023-07-21T22:37:00.540 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 58392 9180 /usr/lib64/libcollection.so.4.1.1 2023-07-21T22:37:00.541 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.541 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.541 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.541 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.541 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.542 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 143040 10810 /usr/lib64/libgssrpc.so.4.2 2023-07-21T22:37:00.542 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.542 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 16056 9182 /usr/lib64/libref_array.so.1.2.1 2023-07-21T22:37:00.542 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 120640 9384 /usr/lib64/libini_config.so.5.2.1 2023-07-21T22:37:00.542 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 28472 10806 /usr/lib64/libverto.so.1.0.0 2023-07-21T22:37:00.542 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.543 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.543 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.543 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.543 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.543 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.544 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.544 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.544 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.544 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.544 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.545 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.545 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 1u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.545 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 2u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.545 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 3u unix 0xffff903dd838b740 0t0 17324 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.545 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 4r FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.546 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 5u a_inode 0,14 0 12292 [eventpoll:4,6,7,8] 2023-07-21T22:37:00.546 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 6u a_inode 0,14 0 12292 [eventfd:13] 2023-07-21T22:37:00.546 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 7u unix 0xffff903dc8308cc0 0t0 17325 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.546 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 8u unix 0xffff903dc830b300 0t0 17326 /run/gssproxy.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.546 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 763 gssproxy root 9w FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.547 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.547 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.547 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root txt REG 8,1 128840 2325 /usr/sbin/gssproxy 2023-07-21T22:37:00.547 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.547 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.548 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.548 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 70960 2316 /usr/lib64/libev.so.4.0.0 2023-07-21T22:37:00.548 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.548 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.548 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.549 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 16168 2319 /usr/lib64/libverto-libev.so.1.0.0 2023-07-21T22:37:00.549 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.549 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.549 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.549 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.550 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.550 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 15912 9178 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-21T22:37:00.550 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 20304 9382 /usr/lib64/libpath_utils.so.1.0.1 2023-07-21T22:37:00.550 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 58392 9180 /usr/lib64/libcollection.so.4.1.1 2023-07-21T22:37:00.550 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.551 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.551 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.551 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.551 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.551 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 143040 10810 /usr/lib64/libgssrpc.so.4.2 2023-07-21T22:37:00.551 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 16056 9182 /usr/lib64/libref_array.so.1.2.1 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 120640 9384 /usr/lib64/libini_config.so.5.2.1 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 28472 10806 /usr/lib64/libverto.so.1.0.0 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.553 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.553 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.553 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.553 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.553 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.554 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.554 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.554 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.554 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.554 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.555 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 1u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.555 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 2u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.555 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 3u unix 0xffff903dd838b740 0t0 17324 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.555 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 4r FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.555 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 5u a_inode 0,14 0 12292 [eventpoll:4,6,7,8] 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 6u a_inode 0,14 0 12292 [eventfd:13] 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 7u unix 0xffff903dc8308cc0 0t0 17325 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 8u unix 0xffff903dc830b300 0t0 17326 /run/gssproxy.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 764 gssproxy root 9w FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root txt REG 8,1 128840 2325 /usr/sbin/gssproxy 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 70960 2316 /usr/lib64/libev.so.4.0.0 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 16168 2319 /usr/lib64/libverto-libev.so.1.0.0 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 15912 9178 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 20304 9382 /usr/lib64/libpath_utils.so.1.0.1 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 58392 9180 /usr/lib64/libcollection.so.4.1.1 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.561 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.561 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.561 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.561 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 143040 10810 /usr/lib64/libgssrpc.so.4.2 2023-07-21T22:37:00.561 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 16056 9182 /usr/lib64/libref_array.so.1.2.1 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 120640 9384 /usr/lib64/libini_config.so.5.2.1 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 28472 10806 /usr/lib64/libverto.so.1.0.0 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 1u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 2u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 3u unix 0xffff903dd838b740 0t0 17324 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 4r FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 5u a_inode 0,14 0 12292 [eventpoll:4,6,7,8] 2023-07-21T22:37:00.566 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 6u a_inode 0,14 0 12292 [eventfd:13] 2023-07-21T22:37:00.566 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 7u unix 0xffff903dc8308cc0 0t0 17325 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.566 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 8u unix 0xffff903dc830b300 0t0 17326 /run/gssproxy.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.566 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 765 gssproxy root 9w FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.566 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root txt REG 8,1 128840 2325 /usr/sbin/gssproxy 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 70960 2316 /usr/lib64/libev.so.4.0.0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 16168 2319 /usr/lib64/libverto-libev.so.1.0.0 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 15912 9178 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-21T22:37:00.570 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 20304 9382 /usr/lib64/libpath_utils.so.1.0.1 2023-07-21T22:37:00.570 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 58392 9180 /usr/lib64/libcollection.so.4.1.1 2023-07-21T22:37:00.570 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.570 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.570 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.571 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.571 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.571 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 143040 10810 /usr/lib64/libgssrpc.so.4.2 2023-07-21T22:37:00.571 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.571 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 16056 9182 /usr/lib64/libref_array.so.1.2.1 2023-07-21T22:37:00.572 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 120640 9384 /usr/lib64/libini_config.so.5.2.1 2023-07-21T22:37:00.572 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 28472 10806 /usr/lib64/libverto.so.1.0.0 2023-07-21T22:37:00.572 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.572 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.572 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.573 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.573 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.573 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.573 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.573 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.574 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.574 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.574 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.574 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.574 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 1u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.575 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 2u unix 0xffff903dd80e0000 0t0 12825 type=STREAM (CONNECTED) 2023-07-21T22:37:00.575 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 3u unix 0xffff903dd838b740 0t0 17324 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.575 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 4r FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.575 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 5u a_inode 0,14 0 12292 [eventpoll:4,6,7,8] 2023-07-21T22:37:00.575 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 6u a_inode 0,14 0 12292 [eventfd:13] 2023-07-21T22:37:00.576 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 7u unix 0xffff903dc8308cc0 0t0 17325 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.576 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 8u unix 0xffff903dc830b300 0t0 17326 /run/gssproxy.sock type=STREAM (LISTEN) 2023-07-21T22:37:00.576 INFO:teuthology.orchestra.run.smithi123.stdout:gssproxy 761 766 gssproxy root 9w FIFO 0,13 0t0 17329 pipe 2023-07-21T22:37:00.576 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root cwd DIR 8,1 4096 1685 /var/spool/at 2023-07-21T22:37:00.576 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.577 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root txt REG 8,1 32680 11887 /usr/sbin/atd 2023-07-21T22:37:00.577 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.577 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.577 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.577 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.578 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.578 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.578 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.578 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.578 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.578 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.579 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.579 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.579 INFO:teuthology.orchestra.run.smithi123.stdout:atd 768 root 3uW REG 0,24 4 1162 /run/atd.pid 2023-07-21T22:37:00.579 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.579 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.580 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root txt REG 8,1 74552 10648 /usr/sbin/crond 2023-07-21T22:37:00.580 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.580 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.580 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.580 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.581 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.581 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.581 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.581 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.581 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.582 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.582 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.582 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.582 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.582 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.583 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.583 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.583 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.583 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.583 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.584 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.584 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.584 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.584 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.584 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root 1u unix 0xffff903dd8279980 0t0 2521 type=STREAM (CONNECTED) 2023-07-21T22:37:00.585 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root 2u unix 0xffff903dd8279980 0t0 2521 type=STREAM (CONNECTED) 2023-07-21T22:37:00.585 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root 3uW REG 0,24 4 1163 /run/crond.pid 2023-07-21T22:37:00.585 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root 4u unix 0xffff903dd8275d80 0t0 2524 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.585 INFO:teuthology.orchestra.run.smithi123.stdout:crond 769 root 5r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.585 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.585 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.586 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe txt REG 8,1 80984 54567 /usr/sbin/nrpe 2023-07-21T22:37:00.586 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.586 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.586 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.586 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.587 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.587 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.587 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.587 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.587 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe 3u IPv4 23611 0t0 TCP *:nrpe (LISTEN) 2023-07-21T22:37:00.588 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe 4u unix 0xffff903dd838aa80 0t0 23603 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.588 INFO:teuthology.orchestra.run.smithi123.stdout:nrpe 883 nrpe 5u IPv6 23612 0t0 TCP *:nrpe (LISTEN) 2023-07-21T22:37:00.588 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp cwd DIR 8,1 4096 1610 /var/log/pcp/pmcd 2023-07-21T22:37:00.588 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.588 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp txt REG 8,1 124616 46968 /usr/libexec/pcp/bin/pmcd 2023-07-21T22:37:00.589 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 4449 53878 /usr/libexec/pcp/pmdas/jbd2/help.pag 2023-07-21T22:37:00.589 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 36392 53910 /usr/libexec/pcp/pmdas/mmv/pmda_mmv.so 2023-07-21T22:37:00.589 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 26392 53924 /usr/libexec/pcp/pmdas/pmcd/help.pag 2023-07-21T22:37:00.589 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 38240 53925 /usr/libexec/pcp/pmdas/pmcd/pmda_pmcd.so 2023-07-21T22:37:00.589 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.590 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.590 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.590 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.590 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.590 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.591 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.591 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.591 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.591 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.591 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.592 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.592 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.592 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.592 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.592 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.593 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.593 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.593 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.593 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.593 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.595 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.595 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 107344 12531 /usr/lib64/libpcp_pmda.so.3 2023-07-21T22:37:00.595 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 300 53877 /usr/libexec/pcp/pmdas/jbd2/help.dir 2023-07-21T22:37:00.595 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 16176 53879 /usr/libexec/pcp/pmdas/jbd2/pmda_jbd2.so 2023-07-21T22:37:00.595 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.596 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp mem REG 8,1 1380 53923 /usr/libexec/pcp/pmdas/pmcd/help.dir 2023-07-21T22:37:00.596 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 0u IPv4 20727 0t0 TCP localhost:pmcd (LISTEN) 2023-07-21T22:37:00.596 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 1w REG 8,1 2167 127 /var/log/pcp/pmcd/pmcd.log 2023-07-21T22:37:00.596 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 2w REG 8,1 2167 127 /var/log/pcp/pmcd/pmcd.log 2023-07-21T22:37:00.596 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 3u IPv6 20728 0t0 TCP localhost:pmcd (LISTEN) 2023-07-21T22:37:00.597 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 4u unix 0xffff903dc47b0440 0t0 20729 /run/pcp/pmcd.socket type=STREAM (LISTEN) 2023-07-21T22:37:00.597 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 5u unix 0xffff903dc7b60000 0t0 22635 type=STREAM (CONNECTED) 2023-07-21T22:37:00.597 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 6w FIFO 0,13 0t0 20735 pipe 2023-07-21T22:37:00.597 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 7r FIFO 0,13 0t0 20736 pipe 2023-07-21T22:37:00.597 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 8u unix 0xffff903dc7b650c0 0t0 22636 type=STREAM (CONNECTED) 2023-07-21T22:37:00.598 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 9w FIFO 0,13 0t0 12946 pipe 2023-07-21T22:37:00.598 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 10r FIFO 0,13 0t0 12947 pipe 2023-07-21T22:37:00.598 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 11w FIFO 0,13 0t0 18881 pipe 2023-07-21T22:37:00.598 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 12r FIFO 0,13 0t0 18882 pipe 2023-07-21T22:37:00.598 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 13w FIFO 0,13 0t0 18883 pipe 2023-07-21T22:37:00.599 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 14r FIFO 0,13 0t0 18884 pipe 2023-07-21T22:37:00.599 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 15w FIFO 0,13 0t0 18888 pipe 2023-07-21T22:37:00.599 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 16r FIFO 0,13 0t0 18889 pipe 2023-07-21T22:37:00.599 INFO:teuthology.orchestra.run.smithi123.stdout:pmcd 1161 pcp 17u unix 0xffff903dc7b61980 0t0 2708 /run/pcp/pmcd.socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.599 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root cwd DIR 8,1 4096 1610 /var/log/pcp/pmcd 2023-07-21T22:37:00.600 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.600 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root txt REG 8,1 57984 53942 /usr/libexec/pcp/pmdas/root/pmdaroot 2023-07-21T22:37:00.600 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.600 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.600 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.601 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.601 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.601 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.601 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.601 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.602 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.602 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.602 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.602 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.602 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.603 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.603 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.603 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.603 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.603 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.604 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.604 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.604 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.604 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.604 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.605 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.605 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.605 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.605 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.605 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 32080 12530 /usr/lib64/libpcp_mmv.so.1 2023-07-21T22:37:00.606 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 209408 11678 /usr/lib64/libuv.so.1.0.0 2023-07-21T22:37:00.606 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.606 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 107344 12531 /usr/lib64/libpcp_pmda.so.3 2023-07-21T22:37:00.606 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 531608 12533 /usr/lib64/libpcp_web.so.1 2023-07-21T22:37:00.606 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 686 53941 /usr/libexec/pcp/pmdas/root/help.pag 2023-07-21T22:37:00.606 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.607 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root mem REG 8,1 108 53940 /usr/libexec/pcp/pmdas/root/help.dir 2023-07-21T22:37:00.607 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 0r FIFO 0,13 0t0 20735 pipe 2023-07-21T22:37:00.607 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 1w FIFO 0,13 0t0 20736 pipe 2023-07-21T22:37:00.607 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 2w REG 8,1 466 1618 /var/log/pcp/pmcd/root.log 2023-07-21T22:37:00.607 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 3u unix 0xffff903dc7b60880 0t0 22634 /var/lib/pcp/pmcd/root.socket type=STREAM (LISTEN) 2023-07-21T22:37:00.608 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 4u unix 0xffff903dc7b64840 0t0 12944 /var/lib/pcp/pmcd/root.socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.608 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 5u unix 0xffff903dc7b661c0 0t0 12945 /var/lib/pcp/pmcd/root.socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.608 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 6u unix 0xffff903dd80e2200 0t0 22642 /var/lib/pcp/pmcd/root.socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.608 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaroot 1165 root 7u unix 0xffff903dd8279100 0t0 18885 /var/lib/pcp/pmcd/root.socket type=STREAM (CONNECTED) 2023-07-21T22:37:00.608 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root cwd DIR 8,1 4096 1610 /var/log/pcp/pmcd 2023-07-21T22:37:00.609 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.609 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root txt REG 8,1 184184 53934 /usr/libexec/pcp/pmdas/proc/pmdaproc 2023-07-21T22:37:00.609 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 31640 53932 /usr/libexec/pcp/pmdas/proc/help.pag 2023-07-21T22:37:00.609 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.609 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.610 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.610 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.610 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.610 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.610 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.612 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.612 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.612 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.612 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.613 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.613 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.613 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.613 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.613 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.614 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.614 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.614 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.614 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.614 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.614 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.615 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 107344 12531 /usr/lib64/libpcp_pmda.so.3 2023-07-21T22:37:00.615 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.615 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root mem REG 8,1 3300 53931 /usr/libexec/pcp/pmdas/proc/help.dir 2023-07-21T22:37:00.615 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root 0r FIFO 0,13 0t0 12946 pipe 2023-07-21T22:37:00.615 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root 1w FIFO 0,13 0t0 12947 pipe 2023-07-21T22:37:00.616 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root 2w REG 8,1 64 54369 /var/log/pcp/pmcd/proc.log 2023-07-21T22:37:00.616 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaproc 1223 root 3u unix 0xffff903dd80e3fc0 0t0 12948 type=STREAM (CONNECTED) 2023-07-21T22:37:00.616 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root cwd DIR 8,1 4096 1610 /var/log/pcp/pmcd 2023-07-21T22:37:00.616 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.616 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root txt REG 8,1 53424 53953 /usr/libexec/pcp/pmdas/xfs/pmdaxfs 2023-07-21T22:37:00.617 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 27178 53951 /usr/libexec/pcp/pmdas/xfs/help.pag 2023-07-21T22:37:00.617 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.617 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.617 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.617 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.618 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.618 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.618 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.618 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.618 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.619 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.619 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.619 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.619 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.619 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.620 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.620 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.620 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.620 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.620 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 107344 12531 /usr/lib64/libpcp_pmda.so.3 2023-07-21T22:37:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.623 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root mem REG 8,1 2496 53950 /usr/libexec/pcp/pmdas/xfs/help.dir 2023-07-21T22:37:00.623 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root 0r FIFO 0,13 0t0 18881 pipe 2023-07-21T22:37:00.623 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root 1w FIFO 0,13 0t0 18882 pipe 2023-07-21T22:37:00.623 INFO:teuthology.orchestra.run.smithi123.stdout:pmdaxfs 1232 root 2w REG 8,1 63 54370 /var/log/pcp/pmcd/xfs.log 2023-07-21T22:37:00.623 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root cwd DIR 8,1 4096 1610 /var/log/pcp/pmcd 2023-07-21T22:37:00.624 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.624 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root txt REG 8,1 271456 53904 /usr/libexec/pcp/pmdas/linux/pmdalinux 2023-07-21T22:37:00.624 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 156737 53902 /usr/libexec/pcp/pmdas/linux/help.pag 2023-07-21T22:37:00.624 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.624 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.630 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.630 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 107344 12531 /usr/lib64/libpcp_pmda.so.3 2023-07-21T22:37:00.630 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 16428 53901 /usr/libexec/pcp/pmdas/linux/help.dir 2023-07-21T22:37:00.630 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.630 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root 0r FIFO 0,13 0t0 18883 pipe 2023-07-21T22:37:00.631 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root 1w FIFO 0,13 0t0 18884 pipe 2023-07-21T22:37:00.631 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root 2w REG 8,1 285 54371 /var/log/pcp/pmcd/linux.log 2023-07-21T22:37:00.631 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root 3u unix 0xffff903dd827cc80 0t0 2679 type=STREAM (CONNECTED) 2023-07-21T22:37:00.631 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root 4r REG 0,20 0 4026532033 /proc/stat 2023-07-21T22:37:00.631 INFO:teuthology.orchestra.run.smithi123.stdout:pmdalinux 1236 root 5u sock 0,8 0t0 18954 protocol: UDP 2023-07-21T22:37:00.632 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root cwd DIR 8,1 4096 1610 /var/log/pcp/pmcd 2023-07-21T22:37:00.632 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.632 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root txt REG 8,1 29864 53895 /usr/libexec/pcp/pmdas/kvm/pmdakvm 2023-07-21T22:37:00.632 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.632 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.633 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.633 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.633 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.633 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.633 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.634 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.634 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.634 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.634 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.634 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.635 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.635 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.635 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.635 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.635 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.636 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.636 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.636 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.636 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.636 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.636 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.637 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.637 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.637 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.637 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.638 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.638 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 107344 12531 /usr/lib64/libpcp_pmda.so.3 2023-07-21T22:37:00.638 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 3147 53893 /usr/libexec/pcp/pmdas/kvm/help.pag 2023-07-21T22:37:00.638 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.638 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root mem REG 8,1 540 53892 /usr/libexec/pcp/pmdas/kvm/help.dir 2023-07-21T22:37:00.638 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root 0r FIFO 0,13 0t0 18888 pipe 2023-07-21T22:37:00.639 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root 1w FIFO 0,13 0t0 18889 pipe 2023-07-21T22:37:00.639 INFO:teuthology.orchestra.run.smithi123.stdout:pmdakvm 1241 root 2w REG 8,1 63 54372 /var/log/pcp/pmcd/kvm.log 2023-07-21T22:37:00.639 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp cwd DIR 8,1 4096 393234 /var/log/pcp/pmlogger/smithi123 2023-07-21T22:37:00.639 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.639 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp txt REG 8,1 157480 12554 /usr/bin/pmlogger 2023-07-21T22:37:00.640 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.640 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.640 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.640 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.640 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.641 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.641 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.641 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.641 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.641 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.642 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.642 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.642 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.642 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.642 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.643 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.643 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.643 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.643 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.643 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.644 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.644 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.644 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.644 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.644 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.645 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.645 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.645 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.645 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 27672 12527 /usr/lib64/libpcp_archive.so.1 2023-07-21T22:37:00.645 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.646 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 0r FIFO 0,13 0t0 20760 pipe 2023-07-21T22:37:00.646 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 1w REG 8,1 0 263664 /var/tmp/pmlogger_check.GftdlyQmS/out (deleted) 2023-07-21T22:37:00.646 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 2w REG 8,1 26469 393219 /var/log/pcp/pmlogger/smithi123/pmlogger.log 2023-07-21T22:37:00.646 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 3u unix 0xffff903dc7b61540 0t0 22692 type=STREAM (CONNECTED) 2023-07-21T22:37:00.646 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 4w REG 8,1 272 393223 /var/log/pcp/pmlogger/smithi123/20230721.22.29.index 2023-07-21T22:37:00.647 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 5w REG 8,1 239602 393224 /var/log/pcp/pmlogger/smithi123/20230721.22.29.meta 2023-07-21T22:37:00.647 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 6w REG 8,1 288612 393250 /var/log/pcp/pmlogger/smithi123/20230721.22.29.0 2023-07-21T22:37:00.647 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 7u IPv4 22700 0t0 TCP localhost:dey-sapi (LISTEN) 2023-07-21T22:37:00.647 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 8u IPv6 22701 0t0 TCP localhost:dey-sapi (LISTEN) 2023-07-21T22:37:00.647 INFO:teuthology.orchestra.run.smithi123.stdout:pmlogger 1553 pcp 9u unix 0xffff903dc7b66a40 0t0 22702 /run/pcp/pmlogger.1553.socket type=STREAM (LISTEN) 2023-07-21T22:37:00.647 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp cwd DIR 8,1 4096 1233 /var/lib/pcp 2023-07-21T22:37:00.648 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.648 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp txt REG 8,1 15504 47000 /usr/libexec/pcp/bin/pmsleep 2023-07-21T22:37:00.648 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.648 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.648 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.649 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.649 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.649 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.649 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.649 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.650 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.650 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.650 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.650 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.650 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.651 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.651 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.651 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.651 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.651 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.653 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 82624 9851 /usr/lib64/libavahi-client.so.3.2.9 2023-07-21T22:37:00.653 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 58464 9853 /usr/lib64/libavahi-common.so.3.5.4 2023-07-21T22:37:00.653 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.653 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.653 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 758088 12526 /usr/lib64/libpcp.so.3 2023-07-21T22:37:00.654 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.654 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.654 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp 1u unix 0xffff903dd81e8000 0t0 18935 type=STREAM (CONNECTED) 2023-07-21T22:37:00.654 INFO:teuthology.orchestra.run.smithi123.stdout:pmpause 1605 pcp 2u unix 0xffff903dd81e8000 0t0 18935 type=STREAM (CONNECTED) 2023-07-21T22:37:00.654 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.655 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.655 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root txt REG 8,1 58080 9631 /usr/sbin/agetty 2023-07-21T22:37:00.655 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.655 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.655 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.656 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.656 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-07-21T22:37:00.656 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-07-21T22:37:00.656 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-07-21T22:37:00.656 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1862 root 4r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.657 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.657 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.657 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root txt REG 8,1 58080 9631 /usr/sbin/agetty 2023-07-21T22:37:00.657 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.657 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.658 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.658 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.658 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.658 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.658 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.659 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.659 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.659 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.659 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.659 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.659 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.660 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.660 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.660 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-07-21T22:37:00.660 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-07-21T22:37:00.660 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-07-21T22:37:00.661 INFO:teuthology.orchestra.run.smithi123.stdout:agetty 1865 root 4r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.661 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.661 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.661 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu txt REG 8,1 102120 16840 /usr/lib/systemd/systemd 2023-07-21T22:37:00.661 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 593150 111 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-21T22:37:00.662 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.662 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.662 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.662 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.662 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.663 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.663 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.663 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 21219 28863 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-21T22:37:00.663 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.663 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.664 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.664 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.664 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.664 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.664 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.665 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.665 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.665 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.665 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.665 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.666 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.666 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.666 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 107984 9595 /usr/lib64/libkmod.so.2.3.6 2023-07-21T22:37:00.666 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 3640680 43416 /usr/lib64/systemd/libsystemd-shared-252.so 2023-07-21T22:37:00.666 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.667 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.667 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.667 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.667 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 2112568 43415 /usr/lib64/systemd/libsystemd-core-252.so 2023-07-21T22:37:00.667 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 1u unix 0xffff903dd81edd80 0t0 19417 type=STREAM (CONNECTED) 2023-07-21T22:37:00.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 2u unix 0xffff903dd81edd80 0t0 19417 type=STREAM (CONNECTED) 2023-07-21T22:37:00.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 3u unix 0xffff903dc47b8440 0t0 20863 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.669 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 4u a_inode 0,14 0 12292 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-07-21T22:37:00.669 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 5u a_inode 0,14 0 12292 [signalfd] 2023-07-21T22:37:00.669 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 6r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.669 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 7r DIR 0,25 0 3362 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-07-21T22:37:00.669 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 8u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.670 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 9u a_inode 0,14 0 12292 [eventpoll:10,13] 2023-07-21T22:37:00.670 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 10r REG 0,20 0 19446 /proc/2708/mountinfo 2023-07-21T22:37:00.670 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 11r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.670 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 12u unix 0xffff903dd81e8880 0t0 25609 /run/user/1000/bus type=STREAM (LISTEN) 2023-07-21T22:37:00.670 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 13r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.671 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-07-21T22:37:00.671 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 15u netlink 0t0 19447 KOBJECT_UEVENT 2023-07-21T22:37:00.671 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 16u unix 0xffff903dd81f6a40 0t0 19452 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-07-21T22:37:00.671 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 17u unix 0xffff903dd81f1dc0 0t0 19453 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.671 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 18u unix 0xffff903dd81f6e80 0t0 19454 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.672 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 19u unix 0xffff903dd81ed500 0t0 19455 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-07-21T22:37:00.672 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 20u unix 0xffff903dd81eb740 0t0 25601 type=STREAM (CONNECTED) 2023-07-21T22:37:00.672 INFO:teuthology.orchestra.run.smithi123.stdout:systemd 2708 ubuntu 21u a_inode 0,14 0 12292 [timerfd] 2023-07-21T22:37:00.672 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.672 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.673 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu txt REG 8,1 102120 16840 /usr/lib/systemd/systemd 2023-07-21T22:37:00.673 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.673 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:00.673 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:00.673 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:00.673 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:00.674 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:00.674 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:00.674 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:00.674 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.674 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.675 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.675 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.675 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.675 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu DEL REG 8,1 2101 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-21T22:37:00.675 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.676 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.676 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:00.676 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:00.676 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.676 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.677 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.677 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.677 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.677 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.677 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.678 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.678 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.678 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.678 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.678 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.679 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.679 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.679 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 107984 9595 /usr/lib64/libkmod.so.2.3.6 2023-07-21T22:37:00.679 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 3640680 43416 /usr/lib64/systemd/libsystemd-shared-252.so 2023-07-21T22:37:00.679 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.680 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.680 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.680 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.680 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu DEL REG 8,1 2102 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-21T22:37:00.680 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 2112568 43415 /usr/lib64/systemd/libsystemd-core-252.so 2023-07-21T22:37:00.681 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.681 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.681 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.681 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 1u unix 0xffff903dd81edd80 0t0 19417 type=STREAM (CONNECTED) 2023-07-21T22:37:00.681 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 2u unix 0xffff903dd81edd80 0t0 19417 type=STREAM (CONNECTED) 2023-07-21T22:37:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 3u a_inode 0,14 0 12292 [eventfd:10] 2023-07-21T22:37:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 4u a_inode 0,14 0 12292 [eventfd:11] 2023-07-21T22:37:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 6w FIFO 0,13 0t0 19421 pipe 2023-07-21T22:37:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:(sd-pam) 2734 ubuntu 7u unix 0xffff903dd81f1980 0t0 19436 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 2743 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 2743 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 2743 root txt unknown /proc/2743/exe 2023-07-21T22:37:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root txt REG 8,1 769552 11652 /usr/sbin/rsyslogd 2023-07-21T22:37:00.684 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.684 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 33584 11622 /usr/lib64/rsyslog/imjournal.so 2023-07-21T22:37:00.684 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 42248 11629 /usr/lib64/rsyslog/imuxsock.so 2023-07-21T22:37:00.684 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 32808 11630 /usr/lib64/rsyslog/lmnet.so 2023-07-21T22:37:00.684 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.685 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.685 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.685 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.685 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.685 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.686 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.686 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.686 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.686 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 32192 9127 /usr/lib64/libuuid.so.1.3.0 2023-07-21T22:37:00.686 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.687 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 53472 11616 /usr/lib64/libfastjson.so.4.3.0 2023-07-21T22:37:00.687 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 16032 11614 /usr/lib64/libestr.so.0.0.0 2023-07-21T22:37:00.687 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.687 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.687 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.687 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 1w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.688 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 2w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.688 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-07-21T22:37:00.688 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 4u unix 0xffff903dd81f2ec0 0t0 25809 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.688 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 5w REG 8,1 629744 1670 /var/log/secure 2023-07-21T22:37:00.689 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 6r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.689 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 7w REG 8,1 5633200 1669 /var/log/messages 2023-07-21T22:37:00.689 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 root 9r REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.689 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.689 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.690 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root txt REG 8,1 769552 11652 /usr/sbin/rsyslogd 2023-07-21T22:37:00.690 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.690 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 33584 11622 /usr/lib64/rsyslog/imjournal.so 2023-07-21T22:37:00.690 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 42248 11629 /usr/lib64/rsyslog/imuxsock.so 2023-07-21T22:37:00.690 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 32808 11630 /usr/lib64/rsyslog/lmnet.so 2023-07-21T22:37:00.690 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.691 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.691 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.691 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.691 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.691 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.692 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.692 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.692 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.692 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 32192 9127 /usr/lib64/libuuid.so.1.3.0 2023-07-21T22:37:00.692 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.693 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 53472 11616 /usr/lib64/libfastjson.so.4.3.0 2023-07-21T22:37:00.693 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 16032 11614 /usr/lib64/libestr.so.0.0.0 2023-07-21T22:37:00.693 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.693 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.693 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.694 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.694 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.694 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-07-21T22:37:00.694 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 4u unix 0xffff903dd81f2ec0 0t0 25809 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.694 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 5w REG 8,1 629744 1670 /var/log/secure 2023-07-21T22:37:00.695 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 6r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.695 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 7w REG 8,1 5633200 1669 /var/log/messages 2023-07-21T22:37:00.695 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4753 in:imjour root 9r REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.695 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.695 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.696 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root txt REG 8,1 769552 11652 /usr/sbin/rsyslogd 2023-07-21T22:37:00.696 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.696 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 33584 11622 /usr/lib64/rsyslog/imjournal.so 2023-07-21T22:37:00.696 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 42248 11629 /usr/lib64/rsyslog/imuxsock.so 2023-07-21T22:37:00.696 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 32808 11630 /usr/lib64/rsyslog/lmnet.so 2023-07-21T22:37:00.697 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.697 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.697 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.697 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.697 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.698 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.698 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.698 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.698 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.698 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 32192 9127 /usr/lib64/libuuid.so.1.3.0 2023-07-21T22:37:00.698 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.699 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 53472 11616 /usr/lib64/libfastjson.so.4.3.0 2023-07-21T22:37:00.699 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 16032 11614 /usr/lib64/libestr.so.0.0.0 2023-07-21T22:37:00.699 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.699 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.699 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.700 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.700 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.700 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-07-21T22:37:00.700 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 4u unix 0xffff903dd81f2ec0 0t0 25809 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.700 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 5w REG 8,1 629744 1670 /var/log/secure 2023-07-21T22:37:00.701 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 6r a_inode 0,14 0 12292 inotify 2023-07-21T22:37:00.701 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 7w REG 8,1 5633200 1669 /var/log/messages 2023-07-21T22:37:00.701 INFO:teuthology.orchestra.run.smithi123.stdout:rsyslogd 4747 4754 rs:main root 9r REG 0,24 16777216 58 /run/log/journal/e13cba1d25f14c51a1d04da8db823a4e/system.journal 2023-07-21T22:37:00.701 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.701 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.702 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:00.702 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.702 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 19512 26894 /usr/lib64/security/pam_lastlog.so 2023-07-21T22:37:00.702 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15184 26920 /usr/lib64/security/pam_umask.so 2023-07-21T22:37:00.702 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.703 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.703 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:00.703 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:00.703 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:00.703 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:00.704 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15264 26901 /usr/lib64/security/pam_motd.so 2023-07-21T22:37:00.704 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:00.704 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 44152 26902 /usr/lib64/security/pam_namespace.so 2023-07-21T22:37:00.704 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:00.704 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:00.705 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:00.705 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:00.705 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:00.705 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15232 26903 /usr/lib64/security/pam_nologin.so 2023-07-21T22:37:00.705 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 19368 26912 /usr/lib64/security/pam_sepermit.so 2023-07-21T22:37:00.706 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:00.706 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:00.706 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:00.706 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.706 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.707 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.707 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.707 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.707 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.707 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.708 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.708 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.708 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.708 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.708 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.709 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.709 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.709 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.709 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.709 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.710 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.710 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.710 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.710 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.710 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.710 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.711 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.711 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.711 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.711 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:00.711 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.712 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.712 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.712 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.712 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.712 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 3u unix 0xffff903dcb6a3740 0t0 29784 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.713 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 4u IPv4 28700 0t0 TCP smithi123.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:41628 (ESTABLISHED) 2023-07-21T22:37:00.713 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 6u unix 0xffff903dc7eb0000 0t0 29759 type=STREAM (CONNECTED) 2023-07-21T22:37:00.713 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 7w FIFO 0,24 0t0 1254 /run/systemd/sessions/3.ref 2023-07-21T22:37:00.713 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5764 root 8u unix 0xffff903dc7eb1100 0t0 29788 type=STREAM (CONNECTED) 2023-07-21T22:37:00.713 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.714 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.714 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:00.714 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.714 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 19512 26894 /usr/lib64/security/pam_lastlog.so 2023-07-21T22:37:00.714 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15184 26920 /usr/lib64/security/pam_umask.so 2023-07-21T22:37:00.715 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.715 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.715 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:00.715 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:00.715 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:00.716 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:00.716 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15264 26901 /usr/lib64/security/pam_motd.so 2023-07-21T22:37:00.716 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:00.716 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 44152 26902 /usr/lib64/security/pam_namespace.so 2023-07-21T22:37:00.716 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:00.717 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:00.717 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:00.717 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:00.717 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:00.717 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15232 26903 /usr/lib64/security/pam_nologin.so 2023-07-21T22:37:00.718 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 19368 26912 /usr/lib64/security/pam_sepermit.so 2023-07-21T22:37:00.718 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:00.718 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:00.718 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:00.718 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.718 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.719 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.719 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.719 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.719 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.719 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.720 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.720 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.720 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.720 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.720 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.721 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.721 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.721 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.721 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.721 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.722 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.722 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.722 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.722 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.722 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.723 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.723 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.723 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.723 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.723 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:00.724 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.724 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.724 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.724 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.724 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.725 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 3u unix 0xffff903dcb6a3740 0t0 29784 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.725 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 4u IPv4 28700 0t0 TCP smithi123.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:41628 (ESTABLISHED) 2023-07-21T22:37:00.725 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 5u unix 0xffff903dc7eb0440 0t0 29787 type=STREAM (CONNECTED) 2023-07-21T22:37:00.725 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 6u unix 0xffff903dc7eb0000 0t0 29759 type=STREAM (CONNECTED) 2023-07-21T22:37:00.725 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 5767 ubuntu 7w FIFO 0,24 0t0 1254 /run/systemd/sessions/3.ref 2023-07-21T22:37:00.725 INFO:teuthology.orchestra.run.smithi123.stdout:tls-strp 58187 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.726 INFO:teuthology.orchestra.run.smithi123.stdout:tls-strp 58187 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.726 INFO:teuthology.orchestra.run.smithi123.stdout:tls-strp 58187 root txt unknown /proc/58187/exe 2023-07-21T22:37:00.726 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.726 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.726 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root txt REG 8,1 622048 11938 /usr/sbin/smartd 2023-07-21T22:37:00.727 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.727 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.727 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.727 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.727 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.728 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.728 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root DEL REG 8,1 9298 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.728 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.728 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.728 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.729 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.729 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.729 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.729 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.729 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi123.stdout:smartd 58532 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58536 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58536 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.731 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58536 root txt unknown /proc/58536/exe 2023-07-21T22:37:00.731 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58537 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.731 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58537 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.731 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58537 root txt unknown /proc/58537/exe 2023-07-21T22:37:00.731 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58538 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58538 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58538 root txt unknown /proc/58538/exe 2023-07-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58539 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58539 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58539 root txt unknown /proc/58539/exe 2023-07-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58540 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58540 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58540 root txt unknown /proc/58540/exe 2023-07-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58541 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58541 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58541 root txt unknown /proc/58541/exe 2023-07-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58542 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58542 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58542 root txt unknown /proc/58542/exe 2023-07-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58543 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58543 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58543 root txt unknown /proc/58543/exe 2023-07-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58544 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58544 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58544 root txt unknown /proc/58544/exe 2023-07-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58545 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58545 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58545 root txt unknown /proc/58545/exe 2023-07-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58546 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58546 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58546 root txt unknown /proc/58546/exe 2023-07-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58547 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58547 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58547 root txt unknown /proc/58547/exe 2023-07-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58548 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58548 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58548 root txt unknown /proc/58548/exe 2023-07-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58549 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58549 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58549 root txt unknown /proc/58549/exe 2023-07-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58550 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58550 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58550 root txt unknown /proc/58550/exe 2023-07-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58551 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58551 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58551 root txt unknown /proc/58551/exe 2023-07-21T22:37:00.740 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58552 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.740 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58552 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.740 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58552 root txt unknown /proc/58552/exe 2023-07-21T22:37:00.740 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58553 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.740 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58553 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.741 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58553 root txt unknown /proc/58553/exe 2023-07-21T22:37:00.741 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58554 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.741 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58554 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.741 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58554 root txt unknown /proc/58554/exe 2023-07-21T22:37:00.741 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58555 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.742 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58555 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.742 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58555 root txt unknown /proc/58555/exe 2023-07-21T22:37:00.742 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58556 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.742 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58556 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.742 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58556 root txt unknown /proc/58556/exe 2023-07-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58557 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58557 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58557 root txt unknown /proc/58557/exe 2023-07-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58558 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58558 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58558 root txt unknown /proc/58558/exe 2023-07-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58559 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58559 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58559 root txt unknown /proc/58559/exe 2023-07-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58560 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58560 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58560 root txt unknown /proc/58560/exe 2023-07-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58561 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58561 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58561 root txt unknown /proc/58561/exe 2023-07-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58562 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58562 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58562 root txt unknown /proc/58562/exe 2023-07-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58563 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58563 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58563 root txt unknown /proc/58563/exe 2023-07-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58564 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58564 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58564 root txt unknown /proc/58564/exe 2023-07-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58565 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58565 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58565 root txt unknown /proc/58565/exe 2023-07-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58566 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58566 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58566 root txt unknown /proc/58566/exe 2023-07-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58567 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58567 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58567 root txt unknown /proc/58567/exe 2023-07-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58568 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58568 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58568 root txt unknown /proc/58568/exe 2023-07-21T22:37:00.750 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58569 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.750 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58569 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.750 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58569 root txt unknown /proc/58569/exe 2023-07-21T22:37:00.750 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58570 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.750 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58570 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58570 root txt unknown /proc/58570/exe 2023-07-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58571 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58571 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58571 root txt unknown /proc/58571/exe 2023-07-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58572 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58572 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58572 root txt unknown /proc/58572/exe 2023-07-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58573 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58573 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58573 root txt unknown /proc/58573/exe 2023-07-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58574 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58574 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58574 root txt unknown /proc/58574/exe 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58575 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58575 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58575 root txt unknown /proc/58575/exe 2023-07-21T22:37:00.754 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58576 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.754 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58576 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.754 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58576 root txt unknown /proc/58576/exe 2023-07-21T22:37:00.754 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58577 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.754 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58577 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58577 root txt unknown /proc/58577/exe 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58578 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58578 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58578 root txt unknown /proc/58578/exe 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58579 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58579 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58579 root txt unknown /proc/58579/exe 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58580 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58580 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58580 root txt unknown /proc/58580/exe 2023-07-21T22:37:00.757 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58581 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.757 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58581 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.757 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58581 root txt unknown /proc/58581/exe 2023-07-21T22:37:00.757 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58582 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.757 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58582 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.758 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58582 root txt unknown /proc/58582/exe 2023-07-21T22:37:00.758 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58583 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.758 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58583 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.758 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58583 root txt unknown /proc/58583/exe 2023-07-21T22:37:00.758 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58584 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.759 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58584 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.759 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58584 root txt unknown /proc/58584/exe 2023-07-21T22:37:00.759 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58585 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.759 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58585 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.759 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58585 root txt unknown /proc/58585/exe 2023-07-21T22:37:00.759 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58586 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.760 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58586 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.760 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58586 root txt unknown /proc/58586/exe 2023-07-21T22:37:00.760 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58587 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.760 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58587 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.760 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58587 root txt unknown /proc/58587/exe 2023-07-21T22:37:00.761 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58588 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.761 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58588 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.761 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58588 root txt unknown /proc/58588/exe 2023-07-21T22:37:00.761 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58589 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.761 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58589 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.762 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58589 root txt unknown /proc/58589/exe 2023-07-21T22:37:00.762 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58590 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.762 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58590 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.762 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58590 root txt unknown /proc/58590/exe 2023-07-21T22:37:00.762 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58591 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.763 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58591 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.763 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58591 root txt unknown /proc/58591/exe 2023-07-21T22:37:00.763 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58592 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.763 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58592 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.763 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58592 root txt unknown /proc/58592/exe 2023-07-21T22:37:00.764 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58593 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.764 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58593 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.764 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58593 root txt unknown /proc/58593/exe 2023-07-21T22:37:00.764 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58594 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.764 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58594 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.765 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58594 root txt unknown /proc/58594/exe 2023-07-21T22:37:00.765 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58595 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.765 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58595 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.765 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58595 root txt unknown /proc/58595/exe 2023-07-21T22:37:00.765 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58596 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.766 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58596 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.766 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/5 58596 root txt unknown /proc/58596/exe 2023-07-21T22:37:00.766 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65762 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.766 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65762 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.766 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65762 root txt unknown /proc/65762/exe 2023-07-21T22:37:00.766 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65763 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.767 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65763 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.767 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65763 root txt unknown /proc/65763/exe 2023-07-21T22:37:00.767 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65764 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.767 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65764 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.767 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65764 root txt unknown /proc/65764/exe 2023-07-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65765 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65765 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65765 root txt unknown /proc/65765/exe 2023-07-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65766 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65766 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65766 root txt unknown /proc/65766/exe 2023-07-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65767 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65767 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65767 root txt unknown /proc/65767/exe 2023-07-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65768 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65768 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65768 root txt unknown /proc/65768/exe 2023-07-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65769 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65769 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65769 root txt unknown /proc/65769/exe 2023-07-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65770 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65770 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65770 root txt unknown /proc/65770/exe 2023-07-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65771 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65771 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.772 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65771 root txt unknown /proc/65771/exe 2023-07-21T22:37:00.772 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65772 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.772 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65772 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.772 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65772 root txt unknown /proc/65772/exe 2023-07-21T22:37:00.772 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65773 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.773 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65773 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.773 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65773 root txt unknown /proc/65773/exe 2023-07-21T22:37:00.773 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65774 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.773 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65774 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.773 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/7 65774 root txt unknown /proc/65774/exe 2023-07-21T22:37:00.774 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 66256 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.774 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 66256 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.774 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/3 66256 root txt unknown /proc/66256/exe 2023-07-21T22:37:00.774 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 66372 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.774 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 66372 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.774 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/u 66372 root txt unknown /proc/66372/exe 2023-07-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68051 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68051 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68051 root txt unknown /proc/68051/exe 2023-07-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68171 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68171 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68171 root txt unknown /proc/68171/exe 2023-07-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68291 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68291 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68291 root txt unknown /proc/68291/exe 2023-07-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68411 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68411 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68411 root txt unknown /proc/68411/exe 2023-07-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68531 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68531 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi123.stdout:kdmflush/ 68531 root txt unknown /proc/68531/exe 2023-07-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi123.stdout:xfsalloc 69424 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi123.stdout:xfsalloc 69424 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi123.stdout:xfsalloc 69424 root txt unknown /proc/69424/exe 2023-07-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi123.stdout:xfs_mru_c 69425 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi123.stdout:xfs_mru_c 69425 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi123.stdout:xfs_mru_c 69425 root txt unknown /proc/69425/exe 2023-07-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-buf/d 69426 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-buf/d 69426 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-buf/d 69426 root txt unknown /proc/69426/exe 2023-07-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-conv/ 69427 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-conv/ 69427 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-conv/ 69427 root txt unknown /proc/69427/exe 2023-07-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-recla 69428 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-recla 69428 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-recla 69428 root txt unknown /proc/69428/exe 2023-07-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-block 69429 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-block 69429 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-block 69429 root txt unknown /proc/69429/exe 2023-07-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-inode 69430 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-inode 69430 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-inode 69430 root txt unknown /proc/69430/exe 2023-07-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-log/d 69431 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-log/d 69431 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-log/d 69431 root txt unknown /proc/69431/exe 2023-07-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-cil/d 69432 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-cil/d 69432 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi123.stdout:xfs-cil/d 69432 root txt unknown /proc/69432/exe 2023-07-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi123.stdout:xfsaild/d 69433 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi123.stdout:xfsaild/d 69433 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi123.stdout:xfsaild/d 69433 root txt unknown /proc/69433/exe 2023-07-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 72545 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 72545 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/2 72545 root txt unknown /proc/72545/exe 2023-07-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 19512 26894 /usr/lib64/security/pam_lastlog.so 2023-07-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15184 26920 /usr/lib64/security/pam_umask.so 2023-07-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15264 26901 /usr/lib64/security/pam_motd.so 2023-07-21T22:37:00.787 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:00.787 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 44152 26902 /usr/lib64/security/pam_namespace.so 2023-07-21T22:37:00.787 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:00.787 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:00.787 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:00.787 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:00.788 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:00.788 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15232 26903 /usr/lib64/security/pam_nologin.so 2023-07-21T22:37:00.788 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 19368 26912 /usr/lib64/security/pam_sepermit.so 2023-07-21T22:37:00.788 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:00.788 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:00.789 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:00.789 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.789 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.789 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 1288504 2548 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.789 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.790 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.790 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.790 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.790 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.790 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.791 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.791 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.791 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.791 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.791 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.792 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.792 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.792 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.792 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.792 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.793 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.793 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.793 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.793 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.793 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.794 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.794 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.794 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:00.794 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.794 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.794 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.795 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.795 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.795 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 3u unix 0xffff903dd80ee1c0 0t0 162056 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.795 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 4u IPv4 159555 0t0 TCP smithi123.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:57202 (ESTABLISHED) 2023-07-21T22:37:00.795 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 6u unix 0xffff903dd3546a40 0t0 162031 type=STREAM (CONNECTED) 2023-07-21T22:37:00.796 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 7w FIFO 0,24 0t0 1634 /run/systemd/sessions/4.ref 2023-07-21T22:37:00.796 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73511 root 8u unix 0xffff903dd35450c0 0t0 162060 type=STREAM (CONNECTED) 2023-07-21T22:37:00.796 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.796 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.796 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:00.797 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.797 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 19512 26894 /usr/lib64/security/pam_lastlog.so 2023-07-21T22:37:00.797 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15184 26920 /usr/lib64/security/pam_umask.so 2023-07-21T22:37:00.797 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.797 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.798 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:00.798 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:00.798 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:00.798 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:00.798 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15264 26901 /usr/lib64/security/pam_motd.so 2023-07-21T22:37:00.799 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:00.799 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 44152 26902 /usr/lib64/security/pam_namespace.so 2023-07-21T22:37:00.799 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:00.799 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:00.799 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:00.800 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:00.800 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:00.800 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15232 26903 /usr/lib64/security/pam_nologin.so 2023-07-21T22:37:00.800 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 19368 26912 /usr/lib64/security/pam_sepermit.so 2023-07-21T22:37:00.800 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:00.801 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:00.801 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:00.801 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.801 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.801 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 1288504 2548 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.802 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.802 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.802 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.802 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.802 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.802 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.803 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.803 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.803 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.803 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.803 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.804 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.804 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.804 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.804 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.804 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.805 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.805 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.805 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.805 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.805 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.806 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:00.807 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.807 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.807 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.807 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 3u unix 0xffff903dd80ee1c0 0t0 162056 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.807 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 4u IPv4 159555 0t0 TCP smithi123.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:57202 (ESTABLISHED) 2023-07-21T22:37:00.808 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 5u unix 0xffff903dd35461c0 0t0 162059 type=STREAM (CONNECTED) 2023-07-21T22:37:00.808 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 6u unix 0xffff903dd3546a40 0t0 162031 type=STREAM (CONNECTED) 2023-07-21T22:37:00.808 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 7w FIFO 0,24 0t0 1634 /run/systemd/sessions/4.ref 2023-07-21T22:37:00.808 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 12r FIFO 0,13 0t0 162175 pipe 2023-07-21T22:37:00.808 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73514 ubuntu 14r FIFO 0,13 0t0 162176 pipe 2023-07-21T22:37:00.808 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 73563 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.809 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 73563 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.809 INFO:teuthology.orchestra.run.smithi123.stdout:kworker/4 73563 root txt unknown /proc/73563/exe 2023-07-21T22:37:00.809 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony cwd DIR 8,1 4096 2 / 2023-07-21T22:37:00.809 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.809 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony txt REG 8,1 353408 11904 /usr/sbin/chronyd 2023-07-21T22:37:00.810 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.810 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 626152 9403 /usr/lib64/libhogweed.so.6.5 2023-07-21T22:37:00.810 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.810 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 340456 9405 /usr/lib64/libnettle.so.8.5 2023-07-21T22:37:00.811 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 94112 9315 /usr/lib64/libtasn1.so.6.6.0 2023-07-21T22:37:00.811 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 1591920 9148 /usr/lib64/libunistring.so.2.1.0 2023-07-21T22:37:00.811 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 2291592 9409 /usr/lib64/libgnutls.so.30.33.1 2023-07-21T22:37:00.811 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 130952 9186 /usr/lib64/libidn2.so.0.3.7 2023-07-21T22:37:00.811 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.812 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 127680 9386 /usr/lib64/libseccomp.so.2.5.2 2023-07-21T22:37:00.812 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.812 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.812 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.813 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.813 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.813 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:00.813 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 3u unix 0xffff903dd838ee80 0t0 159616 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.813 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 5u IPv4 159621 0t0 UDP localhost:323 2023-07-21T22:37:00.813 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 6u IPv6 159622 0t0 UDP localhost:323 2023-07-21T22:37:00.814 INFO:teuthology.orchestra.run.smithi123.stdout:chronyd 73575 chrony 7u unix 0xffff903dd838b300 0t0 159623 /run/chrony/chronyd.sock type=DGRAM (UNCONNECTED) 2023-07-21T22:37:00.814 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root cwd DIR 8,1 4096 1141 /home/ubuntu 2023-07-21T22:37:00.814 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.814 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root txt REG 8,1 185296 11174 /usr/bin/sudo 2023-07-21T22:37:00.814 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:00.815 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.815 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.815 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:00.815 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.815 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:00.816 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:00.816 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:00.816 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:00.816 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:00.816 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:00.817 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:00.817 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.817 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:00.817 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:00.817 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:00.818 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.818 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.818 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.818 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.818 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.819 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.819 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.819 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.819 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 366424 9825 /usr/lib64/libevent-2.1.so.7.0.1 2023-07-21T22:37:00.819 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.820 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.820 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.820 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.820 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:00.820 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.821 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 70400 10834 /usr/lib64/liblber.so.2.0.200 2023-07-21T22:37:00.821 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 417696 10838 /usr/lib64/libldap_r.so.2.0.200 2023-07-21T22:37:00.821 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:00.821 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 472584 48691 /usr/libexec/sudo/sudoers.so 2023-07-21T22:37:00.821 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.822 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.822 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:00.822 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:00.822 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.822 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.823 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.823 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.823 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.823 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.823 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 119832 48687 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-07-21T22:37:00.824 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.824 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.824 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.824 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.824 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.825 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.825 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.825 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.825 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.825 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.826 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 0r FIFO 0,13 0t0 162174 pipe 2023-07-21T22:37:00.826 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 1w FIFO 0,13 0t0 162175 pipe 2023-07-21T22:37:00.826 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 2w FIFO 0,13 0t0 162176 pipe 2023-07-21T22:37:00.826 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 3r FIFO 0,13 0t0 159735 pipe 2023-07-21T22:37:00.826 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 4w FIFO 0,13 0t0 159735 pipe 2023-07-21T22:37:00.827 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 5u netlink 0t0 159740 AUDIT 2023-07-21T22:37:00.827 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73680 root 6u unix 0xffff903dd8389dc0 0t0 159741 type=DGRAM (CONNECTED) 2023-07-21T22:37:00.827 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root cwd DIR 8,1 4096 1141 /home/ubuntu 2023-07-21T22:37:00.827 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:00.827 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root txt REG 8,1 15448 9913 /usr/bin/python3.9 2023-07-21T22:37:00.827 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem-r REG 8,1 32768 1139 /var/lib/dnf/history.sqlite-shm 2023-07-21T22:37:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 96936 32358 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 50824 33919 /usr/lib64/python3.9/site-packages/systemd/_reader.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 32192 9127 /usr/lib64/libuuid.so.1.3.0 2023-07-21T22:37:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 212896 32359 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 287608 32341 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 71416 32375 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1288504 2548 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 343744 9543 /usr/lib64/libdbus-1.so.3.19.13 2023-07-21T22:37:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 171376 33336 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-07-21T22:37:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 191600 9079 /usr/lib64/libtinfo.so.6.2 2023-07-21T22:37:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 263192 9071 /usr/lib64/libncursesw.so.6.2 2023-07-21T22:37:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 129336 32337 /usr/lib64/python3.9/lib-dynload/_curses.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 23800 32354 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 50048 32346 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 248544 48957 /usr/lib64/python3.9/site-packages/libdnf/_smartcols.so 2023-07-21T22:37:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 124192 32352 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 23832 32369 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 31976 32381 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.832 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 852144 48992 /usr/lib64/python3.9/site-packages/gpg/_gpgme.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.832 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 197952 9190 /usr/lib64/libexpat.so.1.8.10 2023-07-21T22:37:00.832 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 193072 10121 /usr/lib64/libcomps.so.0 2023-07-21T22:37:00.832 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 20024 33921 /usr/lib64/python3.9/site-packages/systemd/id128.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.832 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 145880 36438 /usr/lib64/python3.9/site-packages/libcomps/_libpycomps.so 2023-07-21T22:37:00.833 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 249136 48980 /usr/lib64/python3.9/site-packages/hawkey/_hawkey.so 2023-07-21T22:37:00.833 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 20000 32370 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.833 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 46560 32348 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.833 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 310296 10989 /usr/lib64/libtss2-mu.so.0.0.0 2023-07-21T22:37:00.833 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 583288 10985 /usr/lib64/libtss2-esys.so.0.0.0 2023-07-21T22:37:00.834 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:00.834 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 41752 32384 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.834 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 159504 10993 /usr/lib64/libtss2-sys.so.1.0.0 2023-07-21T22:37:00.834 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 36888 10991 /usr/lib64/libtss2-rc.so.0.0.0 2023-07-21T22:37:00.834 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 36704 11070 /usr/lib64/libimaevm.so.3.0.0 2023-07-21T22:37:00.835 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 294392 9313 /usr/lib64/libgomp.so.1.0.0 2023-07-21T22:37:00.835 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 622896 10688 /usr/lib64/libdw-0.188.so 2023-07-21T22:37:00.835 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 107464 9157 /usr/lib64/libelf-0.188.so 2023-07-21T22:37:00.835 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 27576 11260 /usr/lib64/librpmsign.so.9.1.3 2023-07-21T22:37:00.835 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 198368 11166 /usr/lib64/librpmbuild.so.9.1.3 2023-07-21T22:37:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1120952 32382 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 15744 33918 /usr/lib64/python3.9/site-packages/systemd/_journal.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 15800 32380 /usr/lib64/python3.9/lib-dynload/syslog.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 15504 32362 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 483896 48958 /usr/lib64/python3.9/site-packages/libdnf/_transaction.so 2023-07-21T22:37:00.837 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 308944 48956 /usr/lib64/python3.9/site-packages/libdnf/_repo.so 2023-07-21T22:37:00.837 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 908368 48955 /usr/lib64/python3.9/site-packages/libdnf/_module.so 2023-07-21T22:37:00.837 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:00.837 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 138712 9304 /usr/lib64/libbrotlicommon.so.1.0.9 2023-07-21T22:37:00.837 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:00.837 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 366424 9825 /usr/lib64/libevent-2.1.so.7.0.1 2023-07-21T22:37:00.838 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:00.838 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:00.838 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:00.838 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1591920 9148 /usr/lib64/libunistring.so.2.1.0 2023-07-21T22:37:00.838 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:00.839 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 28552 9218 /usr/lib64/libattr.so.1.1.2501 2023-07-21T22:37:00.839 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:00.839 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 229320 9541 /usr/lib64/libblkid.so.1.1.0 2023-07-21T22:37:00.839 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 53048 9306 /usr/lib64/libbrotlidec.so.1.0.9 2023-07-21T22:37:00.839 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 70400 10834 /usr/lib64/liblber.so.2.0.200 2023-07-21T22:37:00.840 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 417696 10838 /usr/lib64/libldap_r.so.2.0.200 2023-07-21T22:37:00.840 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:00.840 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:00.840 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:00.840 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:00.841 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:00.841 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 77488 9302 /usr/lib64/libpsl.so.5.3.3 2023-07-21T22:37:00.841 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 479560 10896 /usr/lib64/libssh.so.4.9.4 2023-07-21T22:37:00.841 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 130952 9186 /usr/lib64/libidn2.so.0.3.7 2023-07-21T22:37:00.841 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 169704 10791 /usr/lib64/libnghttp2.so.14.20.1 2023-07-21T22:37:00.842 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:00.842 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 86944 9324 /usr/lib64/libassuan.so.0.8.5 2023-07-21T22:37:00.842 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 136048 11222 /usr/lib64/libyaml-0.so.2.0.9 2023-07-21T22:37:00.842 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 185432 9288 /usr/lib64/libmagic.so.1.0.0 2023-07-21T22:37:00.842 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:00.842 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 41120 9220 /usr/lib64/libacl.so.1.1.2301 2023-07-21T22:37:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 58368 9103 /usr/lib64/libpopt.so.0.0.1 2023-07-21T22:37:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 287248 9184 /usr/lib64/liblua-5.4.so 2023-07-21T22:37:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 76792 9115 /usr/lib64/libbz2.so.1.0.8 2023-07-21T22:37:00.844 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:00.844 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:00.844 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:00.844 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 283152 9571 /usr/lib64/libmount.so.1.1.0 2023-07-21T22:37:00.844 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 19480 9584 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-07-21T22:37:00.845 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 489696 9414 /usr/lib64/libpcre.so.1.2.12 2023-07-21T22:37:00.845 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 662296 10900 /usr/lib64/libcurl.so.4.7.0 2023-07-21T22:37:00.845 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1640984 9133 /usr/lib64/libxml2.so.2.9.13 2023-07-21T22:37:00.845 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 350864 11254 /usr/lib64/libgpgme.so.11.24.1 2023-07-21T22:37:00.845 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 107832 9295 /usr/lib64/libsmartcols.so.1.1.0 2023-07-21T22:37:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 634720 11225 /usr/lib64/libmodulemd.so.2.13.0 2023-07-21T22:37:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1294848 9135 /usr/lib64/libsqlite3.so.0.8.6 2023-07-21T22:37:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 231048 11094 /usr/lib64/librpmio.so.9.1.3 2023-07-21T22:37:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 533664 11092 /usr/lib64/librpm.so.9.1.3 2023-07-21T22:37:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 266168 11131 /usr/lib64/libsolvext.so.1 2023-07-21T22:37:00.847 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 614976 11130 /usr/lib64/libsolv.so.1 2023-07-21T22:37:00.847 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 375136 9586 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-07-21T22:37:00.847 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1932640 9580 /usr/lib64/libgio-2.0.so.0.6800.4 2023-07-21T22:37:00.847 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1298936 9582 /usr/lib64/libglib-2.0.so.0.6800.4 2023-07-21T22:37:00.847 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 1644080 11256 /usr/lib64/libdnf.so.2 2023-07-21T22:37:00.848 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 672304 48953 /usr/lib64/python3.9/site-packages/libdnf/_conf.so 2023-07-21T22:37:00.848 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 2306496 9106 /usr/lib64/libstdc++.so.6.0.29 2023-07-21T22:37:00.848 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 15560 32351 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.848 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 75928 9198 /usr/lib64/libjson-c.so.5.0.0 2023-07-21T22:37:00.848 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 189704 11255 /usr/lib64/librepo.so.0 2023-07-21T22:37:00.849 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 491576 48952 /usr/lib64/python3.9/site-packages/libdnf/_common_types.so 2023-07-21T22:37:00.849 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:00.849 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:00.849 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 29232 32326 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.849 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 24912 48954 /usr/lib64/python3.9/site-packages/libdnf/_error.so 2023-07-21T22:37:00.850 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 107744 32339 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.850 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 179432 49062 /usr/lib64/python3.9/site-packages/rpm/_rpm.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.850 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 106440 48959 /usr/lib64/python3.9/site-packages/libdnf/_utils.so 2023-07-21T22:37:00.850 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 101216 32357 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.850 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 50224 32325 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.851 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 69040 32344 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.851 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 24160 32356 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.851 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 71616 32371 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.851 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:00.851 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 56416 32361 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.851 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:00.852 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:00.852 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 20528 32355 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.852 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 68000 32365 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.852 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 37592 32378 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.852 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:00.853 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:00.853 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:00.853 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 41384 32367 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.853 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 28064 32345 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.853 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:00.854 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:00.854 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 3474032 9915 /usr/lib64/libpython3.9.so.1.0 2023-07-21T22:37:00.854 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:00.854 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:00.854 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:00.855 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:00.855 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:00.855 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:00.855 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 15984 32324 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-07-21T22:37:00.855 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:00.856 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:00.856 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 0r FIFO 0,13 0t0 162174 pipe 2023-07-21T22:37:00.856 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 1w FIFO 0,13 0t0 162175 pipe 2023-07-21T22:37:00.856 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 2w FIFO 0,13 0t0 162176 pipe 2023-07-21T22:37:00.856 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 3w REG 8,1 164613 1702 /var/log/dnf.log 2023-07-21T22:37:00.857 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 4w REG 8,1 87607 1703 /var/log/dnf.librepo.log 2023-07-21T22:37:00.857 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 5w REG 8,1 87607 1703 /var/log/dnf.librepo.log 2023-07-21T22:37:00.857 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 6w REG 8,1 11676 1704 /var/log/dnf.rpm.log 2023-07-21T22:37:00.857 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 7w REG 8,1 3660 1705 /var/log/hawkey.log 2023-07-21T22:37:00.857 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 8ur REG 8,1 286720 1137 /var/lib/dnf/history.sqlite 2023-07-21T22:37:00.858 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 9r REG 8,1 34040 1633 /var/cache/dnf/ceph.solv (deleted) 2023-07-21T22:37:00.858 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 10r REG 8,1 62158 1641 /var/cache/dnf/ceph-filenames.solvx 2023-07-21T22:37:00.858 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 11r REG 8,1 5999 1644 /var/cache/dnf/ceph-noarch.solv (deleted) 2023-07-21T22:37:00.858 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 12r REG 8,1 6188 1707 /var/cache/dnf/ceph-noarch-filenames.solvx 2023-07-21T22:37:00.858 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 13r REG 8,1 3336 1764 /var/cache/dnf/ceph-source.solv (deleted) 2023-07-21T22:37:00.859 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 14r REG 8,1 243 2557 /var/cache/dnf/ceph-source-filenames.solvx 2023-07-21T22:37:00.859 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 15r REG 8,1 2353707 54551 /var/cache/dnf/CentOS-AppStream.solv (deleted) 2023-07-21T22:37:00.859 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 16r REG 8,1 5140327 54556 /var/cache/dnf/CentOS-AppStream-filenames.solvx 2023-07-21T22:37:00.859 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 17r REG 8,1 1680968 56559 /var/cache/dnf/CentOS-BaseOS.solv (deleted) 2023-07-21T22:37:00.859 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 18r REG 8,1 642171 56597 /var/cache/dnf/CentOS-BaseOS-filenames.solvx 2023-07-21T22:37:00.859 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 19r REG 8,1 3655239 56598 /var/cache/dnf/baseos.solv (deleted) 2023-07-21T22:37:00.860 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 20r REG 8,1 1877340 56599 /var/cache/dnf/baseos-filenames.solvx 2023-07-21T22:37:00.860 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 21r REG 8,1 4966228 56600 /var/cache/dnf/appstream.solv (deleted) 2023-07-21T22:37:00.860 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 22r REG 8,1 14664017 56601 /var/cache/dnf/appstream-filenames.solvx 2023-07-21T22:37:00.860 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 23r REG 8,1 1157663 56602 /var/cache/dnf/crb.solv (deleted) 2023-07-21T22:37:00.861 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 24r REG 8,1 4991621 56603 /var/cache/dnf/crb-filenames.solvx 2023-07-21T22:37:00.861 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 25r REG 8,1 19375 56604 /var/cache/dnf/extras-common.solv (deleted) 2023-07-21T22:37:00.861 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 26r REG 8,1 1297 56605 /var/cache/dnf/extras-common-filenames.solvx 2023-07-21T22:37:00.861 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 27r REG 8,1 6131916 56606 /var/cache/dnf/epel.solv (deleted) 2023-07-21T22:37:00.861 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 28r REG 8,1 14567790 56607 /var/cache/dnf/epel-filenames.solvx 2023-07-21T22:37:00.861 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 29r REG 8,1 16611 56608 /var/cache/dnf/epel-presto.solvx 2023-07-21T22:37:00.862 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 30u REG 8,1 5034672 1138 /var/lib/dnf/history.sqlite-wal 2023-07-21T22:37:00.862 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 31ur REG 8,1 32768 1139 /var/lib/dnf/history.sqlite-shm 2023-07-21T22:37:00.862 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 32u REG 8,1 7137 56620 /tmp/librepo-tmp-VDFTJu (deleted) 2023-07-21T22:37:00.862 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 33u REG 8,1 29721 56621 /tmp/librepo-tmp-MdAzxc (deleted) 2023-07-21T22:37:00.862 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 34u unix 0xffff903dc7b66600 0t0 160173 type=STREAM (CONNECTED) 2023-07-21T22:37:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 35u unix 0xffff903dc7b65d80 0t0 160174 type=STREAM (CONNECTED) 2023-07-21T22:37:02.587 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 36u REG 8,1 262144 263885 /var/cache/dnf/epel-4b20c555de8aed94/packages/python3-cherrypy-18.6.1-2.el9.noarch.rpm 2023-07-21T22:37:02.588 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 37u REG 8,1 1425408 263875 /var/cache/dnf/epel-4b20c555de8aed94/packages/libarrow-9.0.0-9.el9.x86_64.rpm 2023-07-21T22:37:02.588 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 38u REG 8,1 0 263886 /var/cache/dnf/epel-4b20c555de8aed94/packages/python3-google-auth-2.21.0-1.el9.noarch.rpm 2023-07-21T22:37:02.588 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 39u IPv4 160181 0t0 TCP smithi123.front.sepia.ceph.com:42218->158.69.78.70:https (ESTABLISHED) 2023-07-21T22:37:02.589 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 40u IPv4 160182 0t0 TCP smithi123.front.sepia.ceph.com:42224->158.69.78.70:https (ESTABLISHED) 2023-07-21T22:37:02.589 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 41u IPv4 160186 0t0 TCP smithi123.front.sepia.ceph.com:38730->server-18-67-76-107.iad89.r.cloudfront.net:https (ESTABLISHED) 2023-07-21T22:37:02.589 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 42u IPv4 160189 0t0 TCP smithi123.front.sepia.ceph.com:60140->mirror.siena.edu:http (ESTABLISHED) 2023-07-21T22:37:02.589 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 43u IPv4 160183 0t0 TCP smithi123.front.sepia.ceph.com:42238->158.69.78.70:https (ESTABLISHED) 2023-07-21T22:37:02.590 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 44u IPv4 160190 0t0 TCP smithi123.front.sepia.ceph.com:60152->mirror.siena.edu:http (ESTABLISHED) 2023-07-21T22:37:02.590 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 45u IPv4 160193 0t0 TCP smithi123.front.sepia.ceph.com:44894->ftp-osl.osuosl.org:https (ESTABLISHED) 2023-07-21T22:37:02.590 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 46u IPv4 160194 0t0 TCP smithi123.front.sepia.ceph.com:44908->ftp-osl.osuosl.org:https (ESTABLISHED) 2023-07-21T22:37:02.591 INFO:teuthology.orchestra.run.smithi123.stdout:yum 73697 root 47u IPv4 160195 0t0 TCP smithi123.front.sepia.ceph.com:44914->ftp-osl.osuosl.org:https (ESTABLISHED) 2023-07-21T22:37:02.591 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root cwd DIR 8,1 4096 2 / 2023-07-21T22:37:02.591 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:02.591 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:02.591 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:02.592 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 19512 26894 /usr/lib64/security/pam_lastlog.so 2023-07-21T22:37:02.592 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15184 26920 /usr/lib64/security/pam_umask.so 2023-07-21T22:37:02.592 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:02.592 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:02.593 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:02.593 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:02.593 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:02.593 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:02.594 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15264 26901 /usr/lib64/security/pam_motd.so 2023-07-21T22:37:02.594 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:02.594 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 44152 26902 /usr/lib64/security/pam_namespace.so 2023-07-21T22:37:02.594 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:02.594 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:02.595 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:02.595 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:02.595 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:02.595 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15232 26903 /usr/lib64/security/pam_nologin.so 2023-07-21T22:37:02.595 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 19368 26912 /usr/lib64/security/pam_sepermit.so 2023-07-21T22:37:02.596 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:02.596 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:02.596 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:02.596 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:02.597 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:02.597 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:02.597 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:02.597 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 1288504 2548 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:02.598 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:02.599 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:02.599 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:02.599 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:02.599 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:02.599 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:02.600 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:02.600 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:02.600 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:02.600 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:02.601 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:02.601 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:02.601 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:02.601 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:02.602 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:02.602 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:02.602 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:02.602 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:02.602 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:02.603 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:02.603 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:02.603 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:02.603 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:02.603 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 3u unix 0xffff903dcb6a4840 0t0 158595 type=DGRAM (CONNECTED) 2023-07-21T22:37:02.603 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 4u IPv4 163863 0t0 TCP smithi123.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:58012 (ESTABLISHED) 2023-07-21T22:37:02.604 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 6u unix 0xffff903dc7eb2640 0t0 158570 type=STREAM (CONNECTED) 2023-07-21T22:37:02.604 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 7w FIFO 0,24 0t0 1647 /run/systemd/sessions/5.ref 2023-07-21T22:37:02.604 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73747 root 8u unix 0xffff903dc7eb5d80 0t0 158599 type=STREAM (CONNECTED) 2023-07-21T22:37:02.604 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu cwd DIR 8,1 4096 2 / 2023-07-21T22:37:02.604 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu rtd DIR 8,1 4096 2 / 2023-07-21T22:37:02.605 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu txt REG 8,1 956448 11769 /usr/sbin/sshd 2023-07-21T22:37:02.605 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:02.605 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 19512 26894 /usr/lib64/security/pam_lastlog.so 2023-07-21T22:37:02.605 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15184 26920 /usr/lib64/security/pam_umask.so 2023-07-21T22:37:02.605 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:02.606 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:02.606 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:02.606 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:02.606 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:02.607 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:02.607 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15264 26901 /usr/lib64/security/pam_motd.so 2023-07-21T22:37:02.607 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:02.607 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 44152 26902 /usr/lib64/security/pam_namespace.so 2023-07-21T22:37:02.608 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 27616 26910 /usr/lib64/security/pam_selinux.so 2023-07-21T22:37:02.608 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:02.608 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:02.608 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15240 26898 /usr/lib64/security/pam_loginuid.so 2023-07-21T22:37:02.608 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:02.609 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15232 26903 /usr/lib64/security/pam_nologin.so 2023-07-21T22:37:02.609 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 19368 26912 /usr/lib64/security/pam_sepermit.so 2023-07-21T22:37:02.609 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:02.609 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:02.609 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:02.609 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 153600 9223 /usr/lib64/libgpg-error.so.0.32.0 2023-07-21T22:37:02.610 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:02.610 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:02.610 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:02.610 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 144120 9281 /usr/lib64/liblz4.so.1.9.3 2023-07-21T22:37:02.610 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 1288504 2548 /usr/lib64/libgcrypt.so.20.4.0 2023-07-21T22:37:02.611 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:02.611 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:02.611 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:02.612 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 882376 9113 /usr/lib64/libzstd.so.1.5.1 2023-07-21T22:37:02.612 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 178728 9108 /usr/lib64/liblzma.so.5.2.5 2023-07-21T22:37:02.612 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:02.612 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:02.613 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:02.613 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:02.613 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:02.613 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:02.613 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:02.614 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:02.614 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:02.614 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:02.614 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:02.614 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:02.615 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 915720 9537 /usr/lib64/libsystemd.so.0.35.0 2023-07-21T22:37:02.615 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:02.615 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:02.615 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:02.615 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:02.616 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-07-21T22:37:02.616 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:02.616 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:02.617 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-07-21T22:37:02.617 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 3u unix 0xffff903dcb6a4840 0t0 158595 type=DGRAM (CONNECTED) 2023-07-21T22:37:02.617 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 4u IPv4 163863 0t0 TCP smithi123.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:58012 (ESTABLISHED) 2023-07-21T22:37:02.617 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 5u unix 0xffff903dc7eb6600 0t0 158598 type=STREAM (CONNECTED) 2023-07-21T22:37:02.618 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 6u unix 0xffff903dc7eb2640 0t0 158570 type=STREAM (CONNECTED) 2023-07-21T22:37:02.618 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 7w FIFO 0,24 0t0 1647 /run/systemd/sessions/5.ref 2023-07-21T22:37:02.618 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 12r FIFO 0,13 0t0 164892 pipe 2023-07-21T22:37:02.618 INFO:teuthology.orchestra.run.smithi123.stdout:sshd 73750 ubuntu 14r FIFO 0,13 0t0 164893 pipe 2023-07-21T22:37:02.618 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu cwd DIR 8,1 4096 1141 /home/ubuntu 2023-07-21T22:37:02.619 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu rtd DIR 8,1 4096 2 / 2023-07-21T22:37:02.619 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu txt REG 8,1 1388920 9081 /usr/bin/bash 2023-07-21T22:37:02.619 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:02.619 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:02.619 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:02.620 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:02.620 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:02.620 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:02.620 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:02.620 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 191600 9079 /usr/lib64/libtinfo.so.6.2 2023-07-21T22:37:02.621 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:02.621 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:02.621 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:02.621 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:02.621 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:02.622 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:02.622 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:02.622 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:02.622 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu 0r FIFO 0,13 0t0 164891 pipe 2023-07-21T22:37:02.623 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu 1w FIFO 0,13 0t0 164892 pipe 2023-07-21T22:37:02.623 INFO:teuthology.orchestra.run.smithi123.stdout:bash 73822 ubuntu 2w FIFO 0,13 0t0 164893 pipe 2023-07-21T22:37:02.623 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root cwd DIR 8,1 4096 1141 /home/ubuntu 2023-07-21T22:37:02.623 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:02.623 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root txt REG 8,1 185296 11174 /usr/bin/sudo 2023-07-21T22:37:02.624 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 357408 9535 /usr/lib64/libnss_systemd.so.2 2023-07-21T22:37:02.624 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 45408 9200 /usr/lib64/libffi.so.8.1.0 2023-07-21T22:37:02.624 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 108144 3514 /usr/lib64/libgcc_s-11-20221121.so.1 2023-07-21T22:37:02.624 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 1293840 9203 /usr/lib64/libp11-kit.so.0.3.0 2023-07-21T22:37:02.624 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 36944 9117 /usr/lib64/libcap.so.2.48 2023-07-21T22:37:02.625 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 19600 10382 /usr/lib64/libpam_misc.so.0.82.1 2023-07-21T22:37:02.625 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 19400 26916 /usr/lib64/security/pam_succeed_if.so 2023-07-21T22:37:02.625 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 514272 27100 /usr/lib64/security/pam_systemd.so 2023-07-21T22:37:02.625 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 27536 26895 /usr/lib64/security/pam_limits.so 2023-07-21T22:37:02.625 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 48392 9642 /usr/lib64/libcrack.so.2.9.0 2023-07-21T22:37:02.626 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 32608 10375 /usr/lib64/libpwquality.so.1.0.2 2023-07-21T22:37:02.626 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 15352 26893 /usr/lib64/security/pam_keyinit.so 2023-07-21T22:37:02.626 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 15840 26832 /usr/lib64/security/pam_pwquality.so 2023-07-21T22:37:02.626 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 56712 26921 /usr/lib64/security/pam_unix.so 2023-07-21T22:37:02.626 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:02.626 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:02.627 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:02.627 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 14928 26881 /usr/lib64/security/pam_deny.so 2023-07-21T22:37:02.627 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:02.627 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:02.628 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:02.628 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 201808 9110 /usr/lib64/libcrypt.so.2.0.0 2023-07-21T22:37:02.628 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 688232 9424 /usr/lib64/libssl.so.3.0.7 2023-07-21T22:37:02.628 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 366424 9825 /usr/lib64/libevent-2.1.so.7.0.1 2023-07-21T22:37:02.629 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 904656 9042 /usr/lib64/libm.so.6 2023-07-21T22:37:02.629 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 417696 10838 /usr/lib64/libldap_r.so.2.0.200 2023-07-21T22:37:02.629 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 2586930 14335 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-21T22:37:02.629 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:02.629 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:02.630 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 128416 10829 /usr/lib64/libsasl2.so.3.0.0 2023-07-21T22:37:02.630 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 41056 10371 /usr/lib64/libeconf.so.0.4.1 2023-07-21T22:37:02.630 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:02.630 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 70400 10834 /usr/lib64/liblber.so.2.0.200 2023-07-21T22:37:02.630 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 69472 10380 /usr/lib64/libpam.so.0.85.1 2023-07-21T22:37:02.630 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 472584 48691 /usr/libexec/sudo/sudoers.so 2023-07-21T22:37:02.631 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:02.631 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:02.631 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 15184 26885 /usr/lib64/security/pam_faildelay.so 2023-07-21T22:37:02.631 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 19464 26883 /usr/lib64/security/pam_env.so 2023-07-21T22:37:02.631 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:02.632 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 54 14338 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-21T22:37:02.632 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 3284 25018 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-21T22:37:02.632 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 286 25016 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-21T22:37:02.632 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:02.633 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 32528 9137 /usr/lib64/libcap-ng.so.0.0.0 2023-07-21T22:37:02.633 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 119832 48687 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-07-21T22:37:02.633 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:02.633 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 135272 9142 /usr/lib64/libaudit.so.1.0.0 2023-07-21T22:37:02.634 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 57 22751 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-21T22:37:02.634 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 34 25068 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-21T22:37:02.634 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 77 14337 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-21T22:37:02.634 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 167 25011 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-21T22:37:02.634 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 59 25017 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-21T22:37:02.635 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 23 25014 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-21T22:37:02.635 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:02.635 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root mem REG 8,1 369 25013 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-21T22:37:02.635 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 0r FIFO 0,13 0t0 164891 pipe 2023-07-21T22:37:02.635 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 1w FIFO 0,13 0t0 164892 pipe 2023-07-21T22:37:02.635 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 2w FIFO 0,13 0t0 164893 pipe 2023-07-21T22:37:02.636 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 3r FIFO 0,13 0t0 162260 pipe 2023-07-21T22:37:02.636 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 4w FIFO 0,13 0t0 162260 pipe 2023-07-21T22:37:02.636 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 5u netlink 0t0 162266 AUDIT 2023-07-21T22:37:02.636 INFO:teuthology.orchestra.run.smithi123.stdout:sudo 73838 root 6u unix 0xffff903dd80eb740 0t0 162267 type=DGRAM (CONNECTED) 2023-07-21T22:37:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root cwd DIR 8,1 4096 1141 /home/ubuntu 2023-07-21T22:37:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root txt REG 8,1 179232 11757 /usr/bin/lsof 2023-07-21T22:37:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:02.640 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:02.640 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 196120 10846 /usr/lib64/libtirpc.so.3.0.0 2023-07-21T22:37:02.640 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:02.640 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:02.640 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 0r FIFO 0,13 0t0 164891 pipe 2023-07-21T22:37:02.641 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 1w FIFO 0,13 0t0 164892 pipe 2023-07-21T22:37:02.641 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 2w FIFO 0,13 0t0 164893 pipe 2023-07-21T22:37:02.641 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 3r DIR 0,20 0 1 /proc 2023-07-21T22:37:02.641 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 4r DIR 0,20 0 163918 /proc/73840/fd 2023-07-21T22:37:02.641 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 5w FIFO 0,13 0t0 163923 pipe 2023-07-21T22:37:02.642 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73840 root 6r FIFO 0,13 0t0 163924 pipe 2023-07-21T22:37:02.642 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root cwd DIR 8,1 4096 1141 /home/ubuntu 2023-07-21T22:37:02.642 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root rtd DIR 8,1 4096 2 / 2023-07-21T22:37:02.642 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root txt REG 8,1 179232 11757 /usr/bin/lsof 2023-07-21T22:37:02.642 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 4474688 9422 /usr/lib64/libcrypto.so.3.0.7 2023-07-21T22:37:02.643 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 346132 25099 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-21T22:37:02.643 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 102568 9101 /usr/lib64/libz.so.1.2.11 2023-07-21T22:37:02.643 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 70512 9048 /usr/lib64/libresolv.so.2 2023-07-21T22:37:02.643 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 920296 10818 /usr/lib64/libkrb5.so.3.3 2023-07-21T22:37:02.644 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 359680 10808 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-21T22:37:02.644 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 637872 9154 /usr/lib64/libpcre2-8.so.0.11.0 2023-07-21T22:37:02.644 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 2387200 9039 /usr/lib64/libc.so.6 2023-07-21T22:37:02.644 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 26988 25176 /usr/lib64/gconv/gconv-modules.cache 2023-07-21T22:37:02.645 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 23992 9174 /usr/lib64/libkeyutils.so.1.10 2023-07-21T22:37:02.645 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 66896 10820 /usr/lib64/libkrb5support.so.0.1 2023-07-21T22:37:02.645 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 24400 9125 /usr/lib64/libcom_err.so.2.1 2023-07-21T22:37:02.645 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 100488 10812 /usr/lib64/libk5crypto.so.3.1 2023-07-21T22:37:02.645 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 196120 10846 /usr/lib64/libtirpc.so.3.0.0 2023-07-21T22:37:02.646 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 175592 9239 /usr/lib64/libselinux.so.1 2023-07-21T22:37:02.646 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root mem REG 8,1 842848 9035 /usr/lib64/ld-linux-x86-64.so.2 2023-07-21T22:37:02.646 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root 4r FIFO 0,13 0t0 163923 pipe 2023-07-21T22:37:02.646 INFO:teuthology.orchestra.run.smithi123.stdout:lsof 73841 root 7w FIFO 0,13 0t0 163924 pipe 2023-07-21T22:37:02.648 INFO:teuthology.orchestra.run.smithi123.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-07-21T22:37:02.648 INFO:teuthology.orchestra.run.smithi123.stdout:root 2 0.0 0.0 0 0 ? S 22:29 0:00 [kthreadd] 2023-07-21T22:37:02.648 INFO:teuthology.orchestra.run.smithi123.stdout:root 3 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [rcu_gp] 2023-07-21T22:37:02.648 INFO:teuthology.orchestra.run.smithi123.stdout:root 4 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [rcu_par_gp] 2023-07-21T22:37:02.649 INFO:teuthology.orchestra.run.smithi123.stdout:root 5 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [slub_flushwq] 2023-07-21T22:37:02.649 INFO:teuthology.orchestra.run.smithi123.stdout:root 6 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [netns] 2023-07-21T22:37:02.649 INFO:teuthology.orchestra.run.smithi123.stdout:root 8 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/0:0H-events_highpri] 2023-07-21T22:37:02.649 INFO:teuthology.orchestra.run.smithi123.stdout:root 10 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [mm_percpu_wq] 2023-07-21T22:37:02.650 INFO:teuthology.orchestra.run.smithi123.stdout:root 12 0.0 0.0 0 0 ? I 22:29 0:00 \_ [rcu_tasks_kthre] 2023-07-21T22:37:02.650 INFO:teuthology.orchestra.run.smithi123.stdout:root 13 0.0 0.0 0 0 ? I 22:29 0:00 \_ [rcu_tasks_rude_] 2023-07-21T22:37:02.650 INFO:teuthology.orchestra.run.smithi123.stdout:root 14 0.0 0.0 0 0 ? I 22:29 0:00 \_ [rcu_tasks_trace] 2023-07-21T22:37:02.650 INFO:teuthology.orchestra.run.smithi123.stdout:root 15 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/0] 2023-07-21T22:37:02.650 INFO:teuthology.orchestra.run.smithi123.stdout:root 16 1.0 0.0 0 0 ? S 22:29 0:04 \_ [pr/ttyS1] 2023-07-21T22:37:02.650 INFO:teuthology.orchestra.run.smithi123.stdout:root 17 0.0 0.0 0 0 ? I 22:29 0:00 \_ [rcu_preempt] 2023-07-21T22:37:02.651 INFO:teuthology.orchestra.run.smithi123.stdout:root 18 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/0] 2023-07-21T22:37:02.651 INFO:teuthology.orchestra.run.smithi123.stdout:root 19 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/0] 2023-07-21T22:37:02.651 INFO:teuthology.orchestra.run.smithi123.stdout:root 20 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/0:1-mm_percpu_wq] 2023-07-21T22:37:02.651 INFO:teuthology.orchestra.run.smithi123.stdout:root 21 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/0] 2023-07-21T22:37:02.651 INFO:teuthology.orchestra.run.smithi123.stdout:root 22 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/1] 2023-07-21T22:37:02.652 INFO:teuthology.orchestra.run.smithi123.stdout:root 23 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/1] 2023-07-21T22:37:02.652 INFO:teuthology.orchestra.run.smithi123.stdout:root 24 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/1] 2023-07-21T22:37:02.652 INFO:teuthology.orchestra.run.smithi123.stdout:root 25 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/1] 2023-07-21T22:37:02.652 INFO:teuthology.orchestra.run.smithi123.stdout:root 27 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/1:0H-events_highpri] 2023-07-21T22:37:02.652 INFO:teuthology.orchestra.run.smithi123.stdout:root 28 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/2] 2023-07-21T22:37:02.653 INFO:teuthology.orchestra.run.smithi123.stdout:root 29 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/2] 2023-07-21T22:37:02.653 INFO:teuthology.orchestra.run.smithi123.stdout:root 30 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/2] 2023-07-21T22:37:02.653 INFO:teuthology.orchestra.run.smithi123.stdout:root 31 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/2] 2023-07-21T22:37:02.653 INFO:teuthology.orchestra.run.smithi123.stdout:root 32 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/2:0-events] 2023-07-21T22:37:02.654 INFO:teuthology.orchestra.run.smithi123.stdout:root 33 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/2:0H-events_highpri] 2023-07-21T22:37:02.654 INFO:teuthology.orchestra.run.smithi123.stdout:root 34 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/3] 2023-07-21T22:37:02.654 INFO:teuthology.orchestra.run.smithi123.stdout:root 35 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/3] 2023-07-21T22:37:02.654 INFO:teuthology.orchestra.run.smithi123.stdout:root 36 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/3] 2023-07-21T22:37:02.654 INFO:teuthology.orchestra.run.smithi123.stdout:root 37 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/3] 2023-07-21T22:37:02.655 INFO:teuthology.orchestra.run.smithi123.stdout:root 38 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/3:0-mm_percpu_wq] 2023-07-21T22:37:02.655 INFO:teuthology.orchestra.run.smithi123.stdout:root 39 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/3:0H-events_highpri] 2023-07-21T22:37:02.655 INFO:teuthology.orchestra.run.smithi123.stdout:root 40 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/4] 2023-07-21T22:37:02.655 INFO:teuthology.orchestra.run.smithi123.stdout:root 41 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/4] 2023-07-21T22:37:02.655 INFO:teuthology.orchestra.run.smithi123.stdout:root 42 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/4] 2023-07-21T22:37:02.656 INFO:teuthology.orchestra.run.smithi123.stdout:root 43 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/4] 2023-07-21T22:37:02.656 INFO:teuthology.orchestra.run.smithi123.stdout:root 44 0.1 0.0 0 0 ? I 22:29 0:00 \_ [kworker/4:0-events] 2023-07-21T22:37:02.656 INFO:teuthology.orchestra.run.smithi123.stdout:root 45 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/4:0H-events_highpri] 2023-07-21T22:37:02.656 INFO:teuthology.orchestra.run.smithi123.stdout:root 46 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/5] 2023-07-21T22:37:02.656 INFO:teuthology.orchestra.run.smithi123.stdout:root 47 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/5] 2023-07-21T22:37:02.657 INFO:teuthology.orchestra.run.smithi123.stdout:root 48 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/5] 2023-07-21T22:37:02.657 INFO:teuthology.orchestra.run.smithi123.stdout:root 49 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/5] 2023-07-21T22:37:02.657 INFO:teuthology.orchestra.run.smithi123.stdout:root 50 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/5:0-inode_switch_wbs] 2023-07-21T22:37:02.657 INFO:teuthology.orchestra.run.smithi123.stdout:root 51 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/5:0H-events_highpri] 2023-07-21T22:37:02.657 INFO:teuthology.orchestra.run.smithi123.stdout:root 52 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/6] 2023-07-21T22:37:02.658 INFO:teuthology.orchestra.run.smithi123.stdout:root 53 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/6] 2023-07-21T22:37:02.658 INFO:teuthology.orchestra.run.smithi123.stdout:root 54 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/6] 2023-07-21T22:37:02.658 INFO:teuthology.orchestra.run.smithi123.stdout:root 55 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/6] 2023-07-21T22:37:02.658 INFO:teuthology.orchestra.run.smithi123.stdout:root 57 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/6:0H-events_highpri] 2023-07-21T22:37:02.659 INFO:teuthology.orchestra.run.smithi123.stdout:root 58 0.0 0.0 0 0 ? S 22:29 0:00 \_ [cpuhp/7] 2023-07-21T22:37:02.659 INFO:teuthology.orchestra.run.smithi123.stdout:root 59 0.0 0.0 0 0 ? S 22:29 0:00 \_ [idle_inject/7] 2023-07-21T22:37:02.659 INFO:teuthology.orchestra.run.smithi123.stdout:root 60 0.0 0.0 0 0 ? S 22:29 0:00 \_ [migration/7] 2023-07-21T22:37:02.659 INFO:teuthology.orchestra.run.smithi123.stdout:root 61 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ksoftirqd/7] 2023-07-21T22:37:02.659 INFO:teuthology.orchestra.run.smithi123.stdout:root 63 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/7:0H-events_highpri] 2023-07-21T22:37:02.660 INFO:teuthology.orchestra.run.smithi123.stdout:root 67 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:4-writeback] 2023-07-21T22:37:02.660 INFO:teuthology.orchestra.run.smithi123.stdout:root 69 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:6-writeback] 2023-07-21T22:37:02.660 INFO:teuthology.orchestra.run.smithi123.stdout:root 70 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:7-flush-8:0] 2023-07-21T22:37:02.660 INFO:teuthology.orchestra.run.smithi123.stdout:root 71 0.0 0.0 0 0 ? S 22:29 0:00 \_ [kdevtmpfs] 2023-07-21T22:37:02.660 INFO:teuthology.orchestra.run.smithi123.stdout:root 72 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [inet_frag_wq] 2023-07-21T22:37:02.661 INFO:teuthology.orchestra.run.smithi123.stdout:root 73 0.0 0.0 0 0 ? S 22:29 0:00 \_ [kauditd] 2023-07-21T22:37:02.661 INFO:teuthology.orchestra.run.smithi123.stdout:root 75 0.0 0.0 0 0 ? S 22:29 0:00 \_ [khungtaskd] 2023-07-21T22:37:02.661 INFO:teuthology.orchestra.run.smithi123.stdout:root 76 0.0 0.0 0 0 ? S 22:29 0:00 \_ [oom_reaper] 2023-07-21T22:37:02.661 INFO:teuthology.orchestra.run.smithi123.stdout:root 77 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [writeback] 2023-07-21T22:37:02.661 INFO:teuthology.orchestra.run.smithi123.stdout:root 78 0.0 0.0 0 0 ? S 22:29 0:00 \_ [kcompactd0] 2023-07-21T22:37:02.662 INFO:teuthology.orchestra.run.smithi123.stdout:root 79 0.0 0.0 0 0 ? SN 22:29 0:00 \_ [ksmd] 2023-07-21T22:37:02.662 INFO:teuthology.orchestra.run.smithi123.stdout:root 80 0.0 0.0 0 0 ? SN 22:29 0:00 \_ [khugepaged] 2023-07-21T22:37:02.662 INFO:teuthology.orchestra.run.smithi123.stdout:root 81 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [cryptd] 2023-07-21T22:37:02.662 INFO:teuthology.orchestra.run.smithi123.stdout:root 82 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kintegrityd] 2023-07-21T22:37:02.663 INFO:teuthology.orchestra.run.smithi123.stdout:root 83 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kblockd] 2023-07-21T22:37:02.663 INFO:teuthology.orchestra.run.smithi123.stdout:root 84 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [blkcg_punt_bio] 2023-07-21T22:37:02.663 INFO:teuthology.orchestra.run.smithi123.stdout:root 85 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/3:1-cgroup_destroy] 2023-07-21T22:37:02.663 INFO:teuthology.orchestra.run.smithi123.stdout:root 86 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [tpm_dev_wq] 2023-07-21T22:37:02.664 INFO:teuthology.orchestra.run.smithi123.stdout:root 87 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [md] 2023-07-21T22:37:02.664 INFO:teuthology.orchestra.run.smithi123.stdout:root 88 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [edac-poller] 2023-07-21T22:37:02.664 INFO:teuthology.orchestra.run.smithi123.stdout:root 89 0.0 0.0 0 0 ? S 22:29 0:00 \_ [watchdogd] 2023-07-21T22:37:02.664 INFO:teuthology.orchestra.run.smithi123.stdout:root 91 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/2:1H-kblockd] 2023-07-21T22:37:02.665 INFO:teuthology.orchestra.run.smithi123.stdout:root 92 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/5:1-inode_switch_wbs] 2023-07-21T22:37:02.665 INFO:teuthology.orchestra.run.smithi123.stdout:root 93 0.0 0.0 0 0 ? S 22:29 0:00 \_ [kswapd0] 2023-07-21T22:37:02.665 INFO:teuthology.orchestra.run.smithi123.stdout:root 99 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kthrotld] 2023-07-21T22:37:02.665 INFO:teuthology.orchestra.run.smithi123.stdout:root 104 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/1:1-mm_percpu_wq] 2023-07-21T22:37:02.665 INFO:teuthology.orchestra.run.smithi123.stdout:root 105 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/6:1-mm_percpu_wq] 2023-07-21T22:37:02.665 INFO:teuthology.orchestra.run.smithi123.stdout:root 106 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/7:1-inode_switch_wbs] 2023-07-21T22:37:02.666 INFO:teuthology.orchestra.run.smithi123.stdout:root 107 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [acpi_thermal_pm] 2023-07-21T22:37:02.666 INFO:teuthology.orchestra.run.smithi123.stdout:root 108 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kmpath_rdacd] 2023-07-21T22:37:02.666 INFO:teuthology.orchestra.run.smithi123.stdout:root 109 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kaluad] 2023-07-21T22:37:02.666 INFO:teuthology.orchestra.run.smithi123.stdout:root 110 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [mld] 2023-07-21T22:37:02.666 INFO:teuthology.orchestra.run.smithi123.stdout:root 111 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/3:1H-kblockd] 2023-07-21T22:37:02.667 INFO:teuthology.orchestra.run.smithi123.stdout:root 112 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [ipv6_addrconf] 2023-07-21T22:37:02.667 INFO:teuthology.orchestra.run.smithi123.stdout:root 121 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kstrp] 2023-07-21T22:37:02.667 INFO:teuthology.orchestra.run.smithi123.stdout:root 129 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/4:2-cgroup_destroy] 2023-07-21T22:37:02.667 INFO:teuthology.orchestra.run.smithi123.stdout:root 134 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [zswap-shrink] 2023-07-21T22:37:02.667 INFO:teuthology.orchestra.run.smithi123.stdout:root 246 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/1:2-cgroup_destroy] 2023-07-21T22:37:02.668 INFO:teuthology.orchestra.run.smithi123.stdout:root 249 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/u17:0] 2023-07-21T22:37:02.668 INFO:teuthology.orchestra.run.smithi123.stdout:root 251 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/0:2-cgroup_destroy] 2023-07-21T22:37:02.668 INFO:teuthology.orchestra.run.smithi123.stdout:root 300 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/4:1H-kblockd] 2023-07-21T22:37:02.668 INFO:teuthology.orchestra.run.smithi123.stdout:root 301 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/5:1H-kblockd] 2023-07-21T22:37:02.669 INFO:teuthology.orchestra.run.smithi123.stdout:root 304 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/5:2-inode_switch_wbs] 2023-07-21T22:37:02.669 INFO:teuthology.orchestra.run.smithi123.stdout:root 305 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/6:1H-kblockd] 2023-07-21T22:37:02.669 INFO:teuthology.orchestra.run.smithi123.stdout:root 394 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/1:1H-kblockd] 2023-07-21T22:37:02.669 INFO:teuthology.orchestra.run.smithi123.stdout:root 427 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/7:1H-kblockd] 2023-07-21T22:37:02.670 INFO:teuthology.orchestra.run.smithi123.stdout:root 436 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [kworker/0:1H-kblockd] 2023-07-21T22:37:02.670 INFO:teuthology.orchestra.run.smithi123.stdout:root 438 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [ata_sff] 2023-07-21T22:37:02.670 INFO:teuthology.orchestra.run.smithi123.stdout:root 442 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [nvme-wq] 2023-07-21T22:37:02.670 INFO:teuthology.orchestra.run.smithi123.stdout:root 447 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [nvme-reset-wq] 2023-07-21T22:37:02.670 INFO:teuthology.orchestra.run.smithi123.stdout:root 448 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [nvme-delete-wq] 2023-07-21T22:37:02.671 INFO:teuthology.orchestra.run.smithi123.stdout:root 449 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [nvme-auth-wq] 2023-07-21T22:37:02.671 INFO:teuthology.orchestra.run.smithi123.stdout:root 452 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [ixgbe] 2023-07-21T22:37:02.671 INFO:teuthology.orchestra.run.smithi123.stdout:root 453 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_0] 2023-07-21T22:37:02.671 INFO:teuthology.orchestra.run.smithi123.stdout:root 454 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_0] 2023-07-21T22:37:02.671 INFO:teuthology.orchestra.run.smithi123.stdout:root 455 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_1] 2023-07-21T22:37:02.672 INFO:teuthology.orchestra.run.smithi123.stdout:root 456 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_1] 2023-07-21T22:37:02.672 INFO:teuthology.orchestra.run.smithi123.stdout:root 457 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_2] 2023-07-21T22:37:02.672 INFO:teuthology.orchestra.run.smithi123.stdout:root 458 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_2] 2023-07-21T22:37:02.672 INFO:teuthology.orchestra.run.smithi123.stdout:root 459 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_3] 2023-07-21T22:37:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:root 460 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_3] 2023-07-21T22:37:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:root 464 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_4] 2023-07-21T22:37:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:root 465 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_4] 2023-07-21T22:37:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:root 466 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_5] 2023-07-21T22:37:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:root 467 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_5] 2023-07-21T22:37:02.674 INFO:teuthology.orchestra.run.smithi123.stdout:root 468 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_6] 2023-07-21T22:37:02.674 INFO:teuthology.orchestra.run.smithi123.stdout:root 469 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_6] 2023-07-21T22:37:02.674 INFO:teuthology.orchestra.run.smithi123.stdout:root 470 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_7] 2023-07-21T22:37:02.675 INFO:teuthology.orchestra.run.smithi123.stdout:root 471 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_7] 2023-07-21T22:37:02.675 INFO:teuthology.orchestra.run.smithi123.stdout:root 472 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_8] 2023-07-21T22:37:02.675 INFO:teuthology.orchestra.run.smithi123.stdout:root 474 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_8] 2023-07-21T22:37:02.675 INFO:teuthology.orchestra.run.smithi123.stdout:root 475 0.0 0.0 0 0 ? S 22:29 0:00 \_ [scsi_eh_9] 2023-07-21T22:37:02.676 INFO:teuthology.orchestra.run.smithi123.stdout:root 476 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [scsi_tmf_9] 2023-07-21T22:37:02.676 INFO:teuthology.orchestra.run.smithi123.stdout:root 477 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:8-events_unbound] 2023-07-21T22:37:02.676 INFO:teuthology.orchestra.run.smithi123.stdout:root 478 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:9-flush-8:0] 2023-07-21T22:37:02.676 INFO:teuthology.orchestra.run.smithi123.stdout:root 479 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:10-flush-8:0] 2023-07-21T22:37:02.677 INFO:teuthology.orchestra.run.smithi123.stdout:root 480 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/u16:11-flush-8:0] 2023-07-21T22:37:02.677 INFO:teuthology.orchestra.run.smithi123.stdout:root 483 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/5:3-inode_switch_wbs] 2023-07-21T22:37:02.677 INFO:teuthology.orchestra.run.smithi123.stdout:root 504 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/6:2-events] 2023-07-21T22:37:02.677 INFO:teuthology.orchestra.run.smithi123.stdout:root 507 0.0 0.0 0 0 ? S 22:29 0:00 \_ [jbd2/sda1-8] 2023-07-21T22:37:02.677 INFO:teuthology.orchestra.run.smithi123.stdout:root 508 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [ext4-rsv-conver] 2023-07-21T22:37:02.678 INFO:teuthology.orchestra.run.smithi123.stdout:root 583 0.0 0.0 0 0 ? S 22:29 0:00 \_ [ext4lazyinit] 2023-07-21T22:37:02.678 INFO:teuthology.orchestra.run.smithi123.stdout:root 641 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [ipmi-msghandler] 2023-07-21T22:37:02.678 INFO:teuthology.orchestra.run.smithi123.stdout:root 662 0.0 0.0 0 0 ? SN 22:29 0:00 \_ [kipmi0] 2023-07-21T22:37:02.678 INFO:teuthology.orchestra.run.smithi123.stdout:root 667 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/7:2-inode_switch_wbs] 2023-07-21T22:37:02.678 INFO:teuthology.orchestra.run.smithi123.stdout:root 688 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [rpciod] 2023-07-21T22:37:02.679 INFO:teuthology.orchestra.run.smithi123.stdout:root 689 0.0 0.0 0 0 ? I< 22:29 0:00 \_ [xprtiod] 2023-07-21T22:37:02.679 INFO:teuthology.orchestra.run.smithi123.stdout:root 2743 0.0 0.0 0 0 ? I 22:29 0:00 \_ [kworker/2:3-mm_percpu_wq] 2023-07-21T22:37:02.679 INFO:teuthology.orchestra.run.smithi123.stdout:root 58187 0.0 0.0 0 0 ? I< 22:33 0:00 \_ [tls-strp] 2023-07-21T22:37:02.679 INFO:teuthology.orchestra.run.smithi123.stdout:root 58536 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:4-inode_switch_wbs] 2023-07-21T22:37:02.680 INFO:teuthology.orchestra.run.smithi123.stdout:root 58537 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:5-inode_switch_wbs] 2023-07-21T22:37:02.680 INFO:teuthology.orchestra.run.smithi123.stdout:root 58538 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:6-inode_switch_wbs] 2023-07-21T22:37:02.680 INFO:teuthology.orchestra.run.smithi123.stdout:root 58539 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:7-inode_switch_wbs] 2023-07-21T22:37:02.680 INFO:teuthology.orchestra.run.smithi123.stdout:root 58540 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:8-inode_switch_wbs] 2023-07-21T22:37:02.680 INFO:teuthology.orchestra.run.smithi123.stdout:root 58541 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:9-inode_switch_wbs] 2023-07-21T22:37:02.681 INFO:teuthology.orchestra.run.smithi123.stdout:root 58542 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:10-inode_switch_wbs] 2023-07-21T22:37:02.681 INFO:teuthology.orchestra.run.smithi123.stdout:root 58543 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:11-inode_switch_wbs] 2023-07-21T22:37:02.681 INFO:teuthology.orchestra.run.smithi123.stdout:root 58544 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:12-inode_switch_wbs] 2023-07-21T22:37:02.681 INFO:teuthology.orchestra.run.smithi123.stdout:root 58545 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:13-inode_switch_wbs] 2023-07-21T22:37:02.681 INFO:teuthology.orchestra.run.smithi123.stdout:root 58546 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:14-inode_switch_wbs] 2023-07-21T22:37:02.682 INFO:teuthology.orchestra.run.smithi123.stdout:root 58547 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:15-inode_switch_wbs] 2023-07-21T22:37:02.682 INFO:teuthology.orchestra.run.smithi123.stdout:root 58548 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:16-inode_switch_wbs] 2023-07-21T22:37:02.682 INFO:teuthology.orchestra.run.smithi123.stdout:root 58549 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:17-inode_switch_wbs] 2023-07-21T22:37:02.682 INFO:teuthology.orchestra.run.smithi123.stdout:root 58550 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:18-inode_switch_wbs] 2023-07-21T22:37:02.682 INFO:teuthology.orchestra.run.smithi123.stdout:root 58551 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:19-inode_switch_wbs] 2023-07-21T22:37:02.683 INFO:teuthology.orchestra.run.smithi123.stdout:root 58552 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:20-inode_switch_wbs] 2023-07-21T22:37:02.683 INFO:teuthology.orchestra.run.smithi123.stdout:root 58553 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:21-inode_switch_wbs] 2023-07-21T22:37:02.683 INFO:teuthology.orchestra.run.smithi123.stdout:root 58554 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:22-inode_switch_wbs] 2023-07-21T22:37:02.683 INFO:teuthology.orchestra.run.smithi123.stdout:root 58555 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:23-inode_switch_wbs] 2023-07-21T22:37:02.684 INFO:teuthology.orchestra.run.smithi123.stdout:root 58556 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:24-inode_switch_wbs] 2023-07-21T22:37:02.684 INFO:teuthology.orchestra.run.smithi123.stdout:root 58557 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:25-inode_switch_wbs] 2023-07-21T22:37:02.684 INFO:teuthology.orchestra.run.smithi123.stdout:root 58558 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:26-inode_switch_wbs] 2023-07-21T22:37:02.684 INFO:teuthology.orchestra.run.smithi123.stdout:root 58559 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:27-inode_switch_wbs] 2023-07-21T22:37:02.685 INFO:teuthology.orchestra.run.smithi123.stdout:root 58560 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:28-inode_switch_wbs] 2023-07-21T22:37:02.685 INFO:teuthology.orchestra.run.smithi123.stdout:root 58561 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:29-inode_switch_wbs] 2023-07-21T22:37:02.685 INFO:teuthology.orchestra.run.smithi123.stdout:root 58562 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:30-inode_switch_wbs] 2023-07-21T22:37:02.685 INFO:teuthology.orchestra.run.smithi123.stdout:root 58563 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:31-inode_switch_wbs] 2023-07-21T22:37:02.686 INFO:teuthology.orchestra.run.smithi123.stdout:root 58564 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:32-inode_switch_wbs] 2023-07-21T22:37:02.686 INFO:teuthology.orchestra.run.smithi123.stdout:root 58565 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:33-inode_switch_wbs] 2023-07-21T22:37:02.686 INFO:teuthology.orchestra.run.smithi123.stdout:root 58566 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:34-inode_switch_wbs] 2023-07-21T22:37:02.686 INFO:teuthology.orchestra.run.smithi123.stdout:root 58567 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:35-inode_switch_wbs] 2023-07-21T22:37:02.686 INFO:teuthology.orchestra.run.smithi123.stdout:root 58568 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:36-inode_switch_wbs] 2023-07-21T22:37:02.687 INFO:teuthology.orchestra.run.smithi123.stdout:root 58569 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:37-inode_switch_wbs] 2023-07-21T22:37:02.687 INFO:teuthology.orchestra.run.smithi123.stdout:root 58570 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:38-inode_switch_wbs] 2023-07-21T22:37:02.687 INFO:teuthology.orchestra.run.smithi123.stdout:root 58571 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:39-inode_switch_wbs] 2023-07-21T22:37:02.687 INFO:teuthology.orchestra.run.smithi123.stdout:root 58572 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:40-inode_switch_wbs] 2023-07-21T22:37:02.687 INFO:teuthology.orchestra.run.smithi123.stdout:root 58573 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:41-inode_switch_wbs] 2023-07-21T22:37:02.688 INFO:teuthology.orchestra.run.smithi123.stdout:root 58574 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:42-inode_switch_wbs] 2023-07-21T22:37:02.688 INFO:teuthology.orchestra.run.smithi123.stdout:root 58575 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:43-inode_switch_wbs] 2023-07-21T22:37:02.688 INFO:teuthology.orchestra.run.smithi123.stdout:root 58576 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:44-inode_switch_wbs] 2023-07-21T22:37:02.688 INFO:teuthology.orchestra.run.smithi123.stdout:root 58577 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:45-inode_switch_wbs] 2023-07-21T22:37:02.688 INFO:teuthology.orchestra.run.smithi123.stdout:root 58578 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:46-inode_switch_wbs] 2023-07-21T22:37:02.689 INFO:teuthology.orchestra.run.smithi123.stdout:root 58579 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:47-inode_switch_wbs] 2023-07-21T22:37:02.689 INFO:teuthology.orchestra.run.smithi123.stdout:root 58580 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:48-inode_switch_wbs] 2023-07-21T22:37:02.689 INFO:teuthology.orchestra.run.smithi123.stdout:root 58581 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:49-inode_switch_wbs] 2023-07-21T22:37:02.689 INFO:teuthology.orchestra.run.smithi123.stdout:root 58582 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:50-inode_switch_wbs] 2023-07-21T22:37:02.689 INFO:teuthology.orchestra.run.smithi123.stdout:root 58583 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:51-inode_switch_wbs] 2023-07-21T22:37:02.690 INFO:teuthology.orchestra.run.smithi123.stdout:root 58584 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:52-inode_switch_wbs] 2023-07-21T22:37:02.690 INFO:teuthology.orchestra.run.smithi123.stdout:root 58585 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:53-inode_switch_wbs] 2023-07-21T22:37:02.690 INFO:teuthology.orchestra.run.smithi123.stdout:root 58586 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:54-inode_switch_wbs] 2023-07-21T22:37:02.690 INFO:teuthology.orchestra.run.smithi123.stdout:root 58587 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:55-inode_switch_wbs] 2023-07-21T22:37:02.691 INFO:teuthology.orchestra.run.smithi123.stdout:root 58588 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:56-inode_switch_wbs] 2023-07-21T22:37:02.691 INFO:teuthology.orchestra.run.smithi123.stdout:root 58589 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:57-inode_switch_wbs] 2023-07-21T22:37:02.691 INFO:teuthology.orchestra.run.smithi123.stdout:root 58590 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:58-inode_switch_wbs] 2023-07-21T22:37:02.692 INFO:teuthology.orchestra.run.smithi123.stdout:root 58591 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:59-inode_switch_wbs] 2023-07-21T22:37:02.692 INFO:teuthology.orchestra.run.smithi123.stdout:root 58592 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:60-inode_switch_wbs] 2023-07-21T22:37:02.692 INFO:teuthology.orchestra.run.smithi123.stdout:root 58593 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:61-inode_switch_wbs] 2023-07-21T22:37:02.693 INFO:teuthology.orchestra.run.smithi123.stdout:root 58594 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:62-cgroup_destroy] 2023-07-21T22:37:02.693 INFO:teuthology.orchestra.run.smithi123.stdout:root 58595 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:63-mm_percpu_wq] 2023-07-21T22:37:02.693 INFO:teuthology.orchestra.run.smithi123.stdout:root 58596 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/5:64] 2023-07-21T22:37:02.694 INFO:teuthology.orchestra.run.smithi123.stdout:root 65762 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:0-inode_switch_wbs] 2023-07-21T22:37:02.694 INFO:teuthology.orchestra.run.smithi123.stdout:root 65763 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:3-inode_switch_wbs] 2023-07-21T22:37:02.694 INFO:teuthology.orchestra.run.smithi123.stdout:root 65764 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:4-inode_switch_wbs] 2023-07-21T22:37:02.694 INFO:teuthology.orchestra.run.smithi123.stdout:root 65765 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:5-inode_switch_wbs] 2023-07-21T22:37:02.695 INFO:teuthology.orchestra.run.smithi123.stdout:root 65766 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:6-inode_switch_wbs] 2023-07-21T22:37:02.695 INFO:teuthology.orchestra.run.smithi123.stdout:root 65767 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:7-inode_switch_wbs] 2023-07-21T22:37:02.695 INFO:teuthology.orchestra.run.smithi123.stdout:root 65768 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:8-inode_switch_wbs] 2023-07-21T22:37:02.695 INFO:teuthology.orchestra.run.smithi123.stdout:root 65769 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:9-inode_switch_wbs] 2023-07-21T22:37:02.696 INFO:teuthology.orchestra.run.smithi123.stdout:root 65770 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:10-inode_switch_wbs] 2023-07-21T22:37:02.696 INFO:teuthology.orchestra.run.smithi123.stdout:root 65771 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:11-inode_switch_wbs] 2023-07-21T22:37:02.696 INFO:teuthology.orchestra.run.smithi123.stdout:root 65772 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:12-mm_percpu_wq] 2023-07-21T22:37:02.696 INFO:teuthology.orchestra.run.smithi123.stdout:root 65773 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:13-events] 2023-07-21T22:37:02.696 INFO:teuthology.orchestra.run.smithi123.stdout:root 65774 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/7:14] 2023-07-21T22:37:02.697 INFO:teuthology.orchestra.run.smithi123.stdout:root 66256 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/3:2-cgroup_destroy] 2023-07-21T22:37:02.697 INFO:teuthology.orchestra.run.smithi123.stdout:root 66372 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/u16:0-flush-8:0] 2023-07-21T22:37:02.697 INFO:teuthology.orchestra.run.smithi123.stdout:root 68051 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [kdmflush/253:0] 2023-07-21T22:37:02.697 INFO:teuthology.orchestra.run.smithi123.stdout:root 68171 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [kdmflush/253:1] 2023-07-21T22:37:02.697 INFO:teuthology.orchestra.run.smithi123.stdout:root 68291 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [kdmflush/253:2] 2023-07-21T22:37:02.698 INFO:teuthology.orchestra.run.smithi123.stdout:root 68411 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [kdmflush/253:3] 2023-07-21T22:37:02.698 INFO:teuthology.orchestra.run.smithi123.stdout:root 68531 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [kdmflush/253:4] 2023-07-21T22:37:02.698 INFO:teuthology.orchestra.run.smithi123.stdout:root 69424 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfsalloc] 2023-07-21T22:37:02.698 INFO:teuthology.orchestra.run.smithi123.stdout:root 69425 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs_mru_cache] 2023-07-21T22:37:02.698 INFO:teuthology.orchestra.run.smithi123.stdout:root 69426 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-buf/dm-4] 2023-07-21T22:37:02.699 INFO:teuthology.orchestra.run.smithi123.stdout:root 69427 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-conv/dm-4] 2023-07-21T22:37:02.699 INFO:teuthology.orchestra.run.smithi123.stdout:root 69428 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-reclaim/dm-] 2023-07-21T22:37:02.699 INFO:teuthology.orchestra.run.smithi123.stdout:root 69429 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-blockgc/dm-] 2023-07-21T22:37:02.699 INFO:teuthology.orchestra.run.smithi123.stdout:root 69430 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-inodegc/dm-] 2023-07-21T22:37:02.699 INFO:teuthology.orchestra.run.smithi123.stdout:root 69431 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-log/dm-4] 2023-07-21T22:37:02.700 INFO:teuthology.orchestra.run.smithi123.stdout:root 69432 0.0 0.0 0 0 ? I< 22:35 0:00 \_ [xfs-cil/dm-4] 2023-07-21T22:37:02.700 INFO:teuthology.orchestra.run.smithi123.stdout:root 69433 0.0 0.0 0 0 ? S 22:35 0:00 \_ [xfsaild/dm-4] 2023-07-21T22:37:02.700 INFO:teuthology.orchestra.run.smithi123.stdout:root 72545 0.0 0.0 0 0 ? I 22:35 0:00 \_ [kworker/2:1-cgwb_release] 2023-07-21T22:37:02.700 INFO:teuthology.orchestra.run.smithi123.stdout:root 73563 0.0 0.0 0 0 ? I 22:36 0:00 \_ [kworker/4:1] 2023-07-21T22:37:02.701 INFO:teuthology.orchestra.run.smithi123.stdout:root 1 0.5 0.0 175148 19388 ? Ss 22:29 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-07-21T22:37:02.701 INFO:teuthology.orchestra.run.smithi123.stdout:root 577 0.2 0.0 43048 28336 ? Ss 22:29 0:01 /usr/lib/systemd/systemd-journald 2023-07-21T22:37:02.701 INFO:teuthology.orchestra.run.smithi123.stdout:root 596 0.0 0.0 35872 14056 ? Ss 22:29 0:00 /usr/lib/systemd/systemd-udevd 2023-07-21T22:37:02.701 INFO:teuthology.orchestra.run.smithi123.stdout:rpc 687 0.0 0.0 13264 5704 ? Ss 22:29 0:00 /usr/bin/rpcbind -w -f 2023-07-21T22:37:02.701 INFO:teuthology.orchestra.run.smithi123.stdout:root 690 0.1 0.0 91828 4508 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-21T22:37:02.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T22:37:02.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:37:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-21T22:37:02.800 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-21T22:37:02.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T22:37:02.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-21T22:37:02.945 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-21T22:37:02.949 INFO:tasks.ceph:Archiving crash dumps... 2023-07-21T22:37:02.952 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871/remote/smithi123/crash 2023-07-21T22:37:02.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-21T22:37:03.000 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-07-21T22:37:03.000 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2023-07-21T22:37:03.002 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871/remote/smithi145/crash 2023-07-21T22:37:03.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-21T22:37:03.046 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-07-21T22:37:03.047 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2023-07-21T22:37:03.047 INFO:tasks.ceph:Shutting down logrotate 2023-07-21T22:37:03.049 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2744, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2576, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 2342, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 2023-07-21T22:37:03.096 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-21T22:37:03.109 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_81cf785aa7781c4e08381c540f890cb9bc987ef9/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 2023-07-21T22:37:03.123 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-21T22:37:03.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T22:37:03.137 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T22:37:03.217 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-21T22:37:03.230 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-21T22:37:03.231 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:37:03.233 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:37:03.246 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2023-07-21T22:37:03.248 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2023-07-21T22:37:03.250 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T22:37:03.251 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-07-21T22:37:03.251 INFO:teuthology.orchestra.run.smithi123.stdout:^- hv01.front.sepia.ceph.com 2 6 17 50 -828us[ -828us] +/- 259ms 2023-07-21T22:37:03.251 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv02.front.sepia.ceph.com 3 6 17 50 -1032us[-1033us] +/- 59ms 2023-07-21T22:37:03.251 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 17 50 +1287us[+1286us] +/- 73ms 2023-07-21T22:37:03.252 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:37:03.253 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T22:37:03.253 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2023-07-21T22:37:03.253 INFO:teuthology.orchestra.run.smithi145.stdout:^- hv01.front.sepia.ceph.com 2 6 17 49 -833us[ -833us] +/- 259ms 2023-07-21T22:37:03.254 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv02.front.sepia.ceph.com 3 6 17 50 -1046us[-1055us] +/- 59ms 2023-07-21T22:37:03.254 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 17 50 +1301us[+1291us] +/- 73ms 2023-07-21T22:37:03.254 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:37:03.254 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-21T22:37:03.267 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-21T22:37:03.268 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-21T22:37:03.283 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-21T22:37:03.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-21T22:37:03.314 INFO:teuthology.task.internal:Duration was 13490.632062 seconds 2023-07-21T22:37:03.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-21T22:37:03.329 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-21T22:37:03.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T22:37:03.332 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T22:37:03.376 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T22:37:03.376 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T22:37:03.826 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-21T22:37:03.827 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2023-07-21T22:37:03.827 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T22:37:03.848 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2023-07-21T22:37:03.849 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T22:37:03.915 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-21T22:37:03.916 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T22:37:03.919 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T22:37:03.947 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-21T22:37:03.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T22:37:03.990 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T22:37:04.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-21T22:37:04.294 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-21T22:37:04.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T22:37:04.321 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T22:37:04.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-21T22:37:04.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:37:04.371 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:37:04.394 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2023-07-21T22:37:04.414 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2023-07-21T22:37:04.436 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:37:04.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:37:04.469 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:37:04.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:37:04.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-21T22:37:04.503 INFO:teuthology.task.internal:Transferring archived files... 2023-07-21T22:37:04.504 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871/remote/smithi123 2023-07-21T22:37:04.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T22:37:04.540 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346871/remote/smithi145 2023-07-21T22:37:04.541 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T22:37:04.571 INFO:teuthology.task.internal:Removing archive directory... 2023-07-21T22:37:04.571 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T22:37:04.579 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T22:37:04.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-21T22:37:04.637 INFO:teuthology.task.internal:Not uploading archives. 2023-07-21T22:37:04.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-21T22:37:04.656 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-21T22:37:04.657 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T22:37:04.661 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T22:37:04.672 INFO:teuthology.orchestra.run.smithi123.stdout: 264085 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 22:37 /home/ubuntu/cephtest 2023-07-21T22:37:04.677 INFO:teuthology.orchestra.run.smithi145.stdout: 264386 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 22:37 /home/ubuntu/cephtest 2023-07-21T22:37:04.679 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-21T22:37:04.692 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-21T22:37:04.713 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: Cannot connect to remote host smithi123 2023-07-21T22:37:04.713 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T22:37:04.741 INFO:teuthology.nuke:Not nuking smithi123.front.sepia.ceph.com because description doesn't match: rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi != /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346838 2023-07-21T22:37:04.764 INFO:teuthology.nuke:Not nuking smithi145.front.sepia.ceph.com because description doesn't match: rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi != /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346838 2023-07-21T22:37:04.766 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= 2023-07-21T22:37:04.775 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 13490.632062196732 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf mon.b-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9bd78e1a9e41460abb23edaa7c42997d status: fail success: false 2023-07-21T22:37:04.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:37:04.860 INFO:teuthology.run:FAIL